Black Friday50% off your first month on any monthly plan with EARLY50 See plans
All 33 lessons
  1. Start here: cloud and data basics

    1. 1. Start here: the exam, the plan and what you already know
    2. 2. Cloud in plain words: SaaS, PaaS, IaaS and where Fabric fits
    3. 3. Data basics: files, tables, formats and the lakehouse idea
    4. 4. A tour of Microsoft Fabric: OneLake, workspaces and items
    5. 5. The three languages: SQL, PySpark and KQL side by side
    6. 6. Getting data in: the map of Fabric tools
  2. Store, ingest and transform batch data (exam area 2, 30-35%)

    1. 7. Choosing a data store and a transformation tool
    2. 8. Shortcuts and mirroring: use data without copying it
    3. 9. Ingest data with pipelines and Copy job
    4. 10. Transform with PySpark and SQL: join, denormalize, aggregate
    5. 11. Messy data: duplicates, missing values and late arrivals
    6. 12. Full and incremental loads, and loading a star schema
  3. Orchestrate and stream (exam areas 1 and 2)

    1. 13. Pipeline or notebook? Choosing how to orchestrate
    2. 14. Schedules and event-based triggers
    3. 15. Parameters and dynamic expressions
    4. 16. Streaming in Fabric: Eventstreams, Spark streaming and KQL
    5. 17. KQL and windowing functions for real-time data
  4. Set up and secure a Fabric solution (exam area 1, 30-35%)

    1. 18. Workspace settings: Spark, domains, OneLake and data workflows
    2. 19. Version control with Git and database projects
    3. 20. Deployment pipelines: development, test and production
    4. 21. Who can see what: workspace roles and item permissions
    5. 22. Fine-grained security: rows, columns, objects, files and masking
    6. 23. Governance: sensitivity labels and endorsement
  5. Monitor, fix and optimize (exam area 3, 30-35%)

    1. 24. Monitoring hub, alerts and Activator
    2. 25. Fixing errors in pipelines, dataflows and notebooks
    3. 26. Fixing errors in Eventhouse, Eventstream and T-SQL
    4. 27. Optimize lakehouse tables: V-Order, OPTIMIZE, VACUUM and partitions
    5. 28. Optimize Spark, pipelines and warehouses
    6. 29. Optimize eventstreams, eventhouses and queries
  6. Exam practice and final review

    1. 30. Exam day: question types, timing and how to think
    2. 31. Mock exam 1
    3. 32. Mock exam 2
    4. 33. Final review: every decision on one page
See the leaderboard

18 min

Shortcuts and mirroring: use data without copying it

Reach data in other places with shortcuts and keep a live copy of a database with mirroring.

By the end of this lesson you can

  • Tell an internal shortcut from an external one and pick where it goes
  • Explain how shortcut security passes your identity to the source
  • Name the sources mirroring supports and what it costs
  • Choose a shortcut, mirroring or a copy for a scenario

From earlier lessons · 1 of 2

Northwind's station analysts know Power Query but not code. They must reshape station data every week. Which tool fits them?

Pick one answer.

From earlier lessons · 2 of 2

You try to run an INSERT through a Lakehouse's SQL analytics endpoint. What happens?

Pick one answer.

Northwind Rides' maintenance partner keeps its station logs in its own Amazon S3 bucket. Finance wants live payment numbers from the SQL Server database, without slowing down checkout. Your manager asks: "Can we use both in Fabric without writing a single copy pipeline?" You can, with two features.

[4]

What a shortcut is

Exam depth: know it cold.

A shortcut is an object in OneLake that points to data stored somewhere else. No data is copied. The place it points to is the target path. The place it shows up is the shortcut path.

A shortcut looks like an ordinary folder. Every engine that reads OneLake can use it: Spark, the SQL analytics endpoint, KQL and Power BI in Direct Lake mode.

You create shortcuts in a Lakehouse or a KQL database. Deleting a shortcut removes only the pointer. The source data stays where it was. But if you rename or delete the target, the shortcut breaks.

[74]

[74]

Internal and external shortcuts

Exam depth: know it cold.

An internal shortcut points to another place inside OneLake. An external shortcut points to storage outside OneLake.

Internal shortcutExternal shortcut
Points toLakehouse, Warehouse, KQL database, mirrored database, SQL database, semantic model.ADLS Gen2, Azure Blob Storage, Amazon S3, S3 compatible, Google Cloud Storage, Dataverse, OneDrive and SharePoint.
How it signs inYour own identity by default (passthrough).A saved cloud connection, such as a key or service principal.

The item types don't need to match. A Lakehouse shortcut can point to a Warehouse table.

Reading other clouds costs egress fees, the charge a cloud adds when data leaves it. Shortcut caching keeps read files in OneLake for 1 to 28 days. You turn it on in Workspace settings, on the OneLake tab. It works for S3, S3 compatible, Google Cloud Storage and gateway shortcuts. Files over 1 GB aren't cached.

[74][75]

The New shortcut dialog in Fabric. Under Internal sources is one tile, Microsoft OneLake. Under External sources are tiles for Amazon S3, Amazon S3 Compatible, Azure Data Lake Storage Gen2, Dataverse and Google Cloud Storage.
Microsoft Learn, CC BY 4.0

[76]

You are a data engineer at Northwind Rides. A partner keeps station logs in its own Amazon S3 bucket. You need the logs in your Lakehouse without copying them, and you want to cut repeat cross-cloud read fees. What should you do?

Pick one answer.

[74]

Tables or Files: where the shortcut lives

Exam depth: know it cold.

A Lakehouse has two top folders, and shortcuts behave differently in each.

In TablesIn Files
Where you can create itTop level only. No subfolders.Any level.
What it can point toData in a table format, such as Delta.Data in any format.
Becomes a table?Yes, if the target is Delta. Its schema stays in sync.No. Spark reads it by path.
SQL analytics endpoint sees it?Yes.No.

Rule: point a Tables shortcut at Delta data you want to query with SQL. Point a Files shortcut at raw files you'll process with Spark.

[74]

[74]

Who sees the data: shortcut security

Exam depth: know it cold.

To create a shortcut, you need Write permission on the item where it goes and Read access to the target.

To use one, both places count. You get the most restrictive of the two. Write access in your Lakehouse doesn't let you write to a target where you can only read.

There are two ways a shortcut signs in:

  • Passthrough: the shortcut passes your identity to the target. You see only what you could see there. This is the default for internal shortcuts.
  • Delegated: the shortcut uses a fixed credential, such as a service principal (an app identity) or a key. External shortcuts always work this way.

One exception: Power BI in Direct Lake over SQL mode, or T-SQL in Delegated identity mode, uses the item owner's identity instead of yours.

[74][75]

You are a data engineer at Northwind Rides. Ana has Write access in the ops Lakehouse. A shortcut there points to the finance Lakehouse, where Ana has Read access only. Ana runs a notebook that writes to the shortcut. What happens?

Pick one answer.

[75]

The shortcut doesn't own the data. It just knows where it lives. Picture: Sticky-note sketch style: a yellow sticky note on a cork board, drawn in black marker.

Mirroring: a live copy of a database

Exam depth: know it cold.

Mirroring keeps an outside database available in Fabric. The usual kind, database mirroring, continuously copies it into OneLake as Delta tables. You pick the whole database or chosen tables, and Fabric keeps them in sync. You build no ETL pipeline. (ETL means extract, transform, load: the usual copy-and-reshape jobs.)

It runs in near real time. A replicator engine merges source changes into Delta tables, as often as every 15 seconds.

You get a mirrored database item plus a SQL analytics endpoint to query it. The mirrored tables are read-only. You read them with SQL, Spark or Power BI, but you don't edit them in Fabric.

Database mirroring sources include Azure SQL Database, Azure SQL Managed Instance, SQL Server, Azure Cosmos DB, Azure Database for PostgreSQL, Snowflake, Oracle, Google BigQuery and SAP.

[42][69]

Rendering diagram…
The source keeps running its app. Changes flow into read-only Delta tables that every Fabric engine can query.

[42]

Exam depth: recognize it.

Mirroring comes in three types.

  • Database mirroring copies the data itself. Most sources work this way.
  • Metadata mirroring copies only the catalog: names of schemas and tables. The data stays put and is read through shortcuts. Azure Databricks works this way.
  • Open mirroring is for sources Fabric has no connector for. Your own app, or a partner tool, writes change files into a landing zone, a folder in OneLake. Fabric merges the inserts, updates and deletes into Delta tables.

[42][77]

Database mirroring brings a copy home. Metadata mirroring just brings the map. Picture: Flat vector infographic, two side-by-side panels with bold simple shapes.

What mirroring costs

Exam depth: know it cold.

A capacity unit (CU) measures the size of your Fabric capacity. An F64 has 64 CUs. These rules apply to database and open mirroring.

  • Replication compute is free. Copying changes into OneLake doesn't use your capacity.
  • Storage is free up to a limit. You get 1 TB of mirroring storage per CU, so an F64 gets 64 TB.
  • Querying is not free. SQL, Spark and Power BI reads use capacity at normal rates.
  • The capacity must be running. If it's paused, nothing replicates and you pay for OneLake storage.

[42]

You are a data engineer at Northwind Rides on an F64 capacity. Finance mirrors a 2 TB payments database. To save money, an admin pauses the capacity every weekend. What happens to mirroring at the weekend?

Pick one answer.

Shortcut, mirroring or copy?

Exam depth: know it cold.

ShortcutMirroringCopy (pipeline or Copy job)
Data moves?No. It stays at the source.Database mirroring: yes, into OneLake. Metadata mirroring: no.Yes, into OneLake.
Best sourceFiles or Delta tables in storage.An operational database.Almost any source.
FreshnessAlways current.Near real time.As of the last run.
Transform on the way?No.No.Yes, some.
Your controlNone needed.Fixed behavior.Your own schedule and settings.
CostNo copy to store.Free replication.Not free.

Decision rule: data already in a lake or Fabric item, use a shortcut. A database you need near real time with no ETL, use mirroring. Need a schedule, transforms or a writable target, copy it.

[69][72][74]

Try it in Fabric

A free Fabric trial is enough. You'll make an internal shortcut to a table in another Lakehouse.

  1. Open rides_lakehouse from lesson 4. If you skipped that, select New item, then Lakehouse, name it rides_lakehouse and select Create.
  2. Download the sample file at fabrictutorialdata.blob.core.windows.net/sampledata/Coffee/Dim_Products.csv.
  3. In the Lakehouse, select Get data > Upload files, pick the file and select Upload.
  4. Open Files. On the file's ... menu, select Load to Tables > New table. Name it dim_products and select Load.
  5. Create a second Lakehouse named ops_lakehouse.
  6. In it, open the ... menu on Tables and select New shortcut.
  7. Under Internal sources, select Microsoft OneLake. Pick rides_lakehouse and select Next.
  8. Expand Tables, select dim_products, select Next, then Create.

The table appears in ops_lakehouse with a small link icon. You can query it, yet no data was copied.

[76][78]

Exam-style practice

You are a data engineer at Northwind Rides. Finance needs payment data from an Azure SQL Database in Fabric within seconds of each change. Reports only read it. The team has no budget for extra compute and doesn't want to build ETL. What should you use?

Pick one answer.

[42][69]

You are a data engineer at Northwind Rides. The ops team's Lakehouse needs the customer Delta table that lives in the finance workspace's Lakehouse. Ops must query it with the SQL analytics endpoint. Data must not be duplicated. What should you create?

Pick one answer.

[74]

FlashcardsIndex cardsFlashcards ⚡

Card 1 of 15

[42][74][75]

Worth keeping

  1. A shortcut points to data without copying it; internal stays in OneLake, external reaches other storage.
  2. Shortcuts in Tables to Delta become SQL-queryable tables; Files shortcuts take any format.
  3. Shortcut access is the stricter of the two locations' permissions.
  4. Mirroring keeps a read-only, near real-time Delta copy of a database, with free replication.
  5. Lake data: shortcut. Live database: mirroring. Schedule or transforms: copy.

On the job

Here's how Northwind Rides might wire this up.

The partner's S3 bucket gets an external shortcut in the Files folder of the raw Lakehouse. Caching is on, so the morning notebook rereads files from OneLake, not from AWS.

The SQL Server payments database is mirrored. Finance queries the mirrored database's SQL analytics endpoint during the day, and the checkout app never slows down.

The ops team works in its own workspace. Instead of copying the clean trip tables, it uses internal shortcuts in its Tables folder. When the engineering team fixes a bug in a table, ops sees the fix at once.

[42][74]

Shortcuts and mirroring cover data that already lives somewhere tidy. But the partner also emails CSV files that must land in a table every night, on a schedule. Next lesson you build that copy yourself.

Leaderboard

Loading…

50 XP for each lesson you finish, 10 for each right answer. Names show only for learners who turn on Show me on leaderboards.

Sources for this lesson (9)

Each fact in the lesson is marked with the number of the page it comes from.

  1. [4]Microsoft Learn: Study Guide for Exam DP-700
  2. [42]Microsoft Learn: What is Mirroring in Fabric?
  3. [69]Microsoft Learn: Microsoft Fabric decision guide: Choose a data movement strategy
  4. [72]Microsoft Learn: Unify data with OneLake shortcuts and mirroring
  5. [74]Microsoft Learn: OneLake shortcuts
  6. [75]Microsoft Learn: OneLake shortcut security
  7. [76]Microsoft Learn: Create a same-tenant OneLake shortcut
  8. [77]Microsoft Learn: Open mirroring in Microsoft Fabric
  9. [78]Microsoft Learn: Quickstart: Get data into OneLake