All 33 lessons
Start here: cloud and data basics
- 1. Start here: the exam, the plan and what you already know
- 2. Cloud in plain words: SaaS, PaaS, IaaS and where Fabric fits
- 3. Data basics: files, tables, formats and the lakehouse idea
- 4. A tour of Microsoft Fabric: OneLake, workspaces and items
- 5. The three languages: SQL, PySpark and KQL side by side
- 6. Getting data in: the map of Fabric tools
Store, ingest and transform batch data (exam area 2, 30-35%)
- 7. Choosing a data store and a transformation tool
- 8. Shortcuts and mirroring: use data without copying it
- 9. Ingest data with pipelines and Copy job
- 10. Transform with PySpark and SQL: join, denormalize, aggregate
- 11. Messy data: duplicates, missing values and late arrivals
- 12. Full and incremental loads, and loading a star schema
Orchestrate and stream (exam areas 1 and 2)
Set up and secure a Fabric solution (exam area 1, 30-35%)
- 18. Workspace settings: Spark, domains, OneLake and data workflows
- 19. Version control with Git and database projects
- 20. Deployment pipelines: development, test and production
- 21. Who can see what: workspace roles and item permissions
- 22. Fine-grained security: rows, columns, objects, files and masking
- 23. Governance: sensitivity labels and endorsement
Monitor, fix and optimize (exam area 3, 30-35%)
- 24. Monitoring hub, alerts and Activator
- 25. Fixing errors in pipelines, dataflows and notebooks
- 26. Fixing errors in Eventhouse, Eventstream and T-SQL
- 27. Optimize lakehouse tables: V-Order, OPTIMIZE, VACUUM and partitions
- 28. Optimize Spark, pipelines and warehouses
- 29. Optimize eventstreams, eventhouses and queries
Exam practice and final review
20 min
Workspace settings: Spark, domains, OneLake and data workflows
Configure the workspace settings the exam asks about and know what each one changes.
By the end of this lesson you can
- Choose between a starter pool and a custom Spark pool
- Use environments and high concurrency to control libraries, start time and cost
- Explain who creates domains and who can assign a workspace to one
- Pick the right OneLake and Apache Airflow job setting for a scenario
From earlier lessons · 1 of 3
Which KQL line counts events in 5-minute buckets?
Pick one answer.
From earlier lessons · 2 of 3
Every minute, a tile shows trips over the previous 10 minutes. Which window is this?
Pick one answer.
From earlier lessons · 3 of 3
What does a OneLake shortcut to an Amazon S3 bucket do?
Pick one answer.
Northwind Rides' data team has four complaints this week. Notebooks take three minutes to start. Every notebook needs the same geospatial library installed by hand. Finance wants its own area in the data catalog. And the cloud bill shows a jump in charges for reading the partner's S3 bucket. All four are fixed in one place: workspace settings.
Who can change workspace settings
Exam depth: know it cold.
Workspace settings hold the configuration for one workspace. To open them, select More options next to the workspace name, then Workspace settings.
Only a workspace Admin can change them. Members and Contributors can't change the settings in this lesson.
The settings this lesson covers live in four places:
- Data Engineering/Science > Spark settings: pools, environment, jobs and high concurrency.
- OneLake: shortcut caching and diagnostics.
- Data Factory > Apache Airflow Runtime Settings: the default Airflow pool.
- Domain assignment, covered below.
One setting needs a second person. A custom Spark pool also needs a capacity admin to allow Customized workspace pools.
Starter pool or custom pool
Exam depth: know it cold.
A Spark pool is the set of machines (nodes) that runs your notebooks and Spark jobs.
| Starter pool | Custom pool | |
|---|---|---|
| Created | Automatically, with every workspace. | By a workspace admin, with New pool. |
| Node size | Medium, fixed. | Small, Medium, Large, X-Large or XX-Large. |
| Session start | About 5-10 seconds, using machines kept warm. | About 3 minutes, unless kept warm as a custom live pool. |
| You can tune | Max nodes, autoscale, dynamic executors. | Node size, autoscale min and max, dynamic executors. |
Autoscale adds and removes nodes as load changes. Dynamic allocation does the same for executors, the Spark processes that do the work.
Node sizes run from Small (4 vCores, or virtual processor cores, and 32 GB) to XX-Large (64 vCores, 512 GB). X-Large and XX-Large need a paid capacity, not a trial.
Decision rule: fast start and default sizing means the starter pool; specific node sizes or scaling means a custom pool.
You are a data engineer at Northwind Rides. A nightly job joins a year of trips and runs out of memory on Medium nodes. The workspace runs on a paid F64 capacity. You need larger nodes for this workload. What should you do?
Pick one answer.
Environments: runtime, compute and libraries in one item
Exam depth: know it cold.
An environment is a Fabric item that bundles Spark settings for notebooks and Spark job definitions. It holds three things:
- Spark compute: the Spark runtime (a version of Spark with built-in libraries), the pool, and driver and executor cores and memory.
- Libraries: public packages, such as from PyPI, the public Python package index, or custom files you upload.
- Resources: small shared files.
You attach an environment to a notebook from its Environment menu. A workspace admin can also set a default environment on the Environment tab of Spark settings. Every notebook that doesn't pick its own then gets those libraries.
The Customize compute configuration for items switch decides if environments may change cores and memory. When it's off, every environment uses the default pool's compute.
High concurrency and job settings
Exam depth: know it cold.
High concurrency lets several notebooks share one running Spark session. Later notebooks skip the start-up wait, and only the notebook that started the session is billed. Sharing needs the same user, the same default lakehouse and the same Spark compute settings. One session holds up to 5 notebooks by default, or up to 50 with spark.highConcurrency.max.
It has two switches under High concurrency: For notebooks and For pipeline running multiple notebooks.
The Jobs tab controls job admission, the rule for starting Spark jobs on a busy capacity. By default, optimistic job admission starts a job with its minimum cores. Reserve maximum cores for active Spark jobs turns that off. The tab also sets the Spark session timeout, 20 minutes by default.
You are a data engineer at Northwind Rides. A pipeline runs five notebooks that share a default lakehouse and Spark settings. Each notebook waits for its own Spark session, and each is billed. You need to cut start time and cost with no code changes. What should you do?
Pick one answer.
Domains and subdomains
Exam depth: know it cold.
A domain groups workspaces by business area, such as Finance or Operations. Items in those workspaces get a domain tag, so people can filter the OneLake catalog by domain. Some tenant settings can also be handed down to a domain. A subdomain splits a domain further, such as Operations > Fleet.
| Role | Can do |
|---|---|
| Fabric admin | Create, rename and delete domains, and name domain admins. |
| Domain admin | Edit the description, add contributors and assign workspaces. Can't delete or rename the domain. |
| Domain contributor | A workspace admin allowed to assign their own workspace, from its workspace settings. |
Subdomains are created by a Fabric admin or domain admin, and use the parent's domain admins. A domain doesn't grant access to data; workspace roles and item permissions do.
You are a data engineer at Northwind Rides. A Fabric admin has created a Finance domain and listed you as a domain contributor. You are a Member, not an Admin, of the Payments workspace. You need Payments assigned to Finance. What must happen first?
Pick one answer.
OneLake workspace settings
Exam depth: know it cold.
The OneLake tab has two settings a workspace admin can change.
- Enable cache for shortcuts: OneLake keeps a copy of files read through an external shortcut. Later reads come from the cache, which cuts egress cost, the fee a cloud charges for data leaving it. It works for Google Cloud Storage, S3, S3 compatible and on-premises gateway shortcuts. Set a Retention Period of 1-28 days, which resets each time a file is read. Files over 1 GB aren't cached. Reset cache empties it.
- Add diagnostic events to a lakehouse: logs who accessed what data into a lakehouse on the same capacity.
Trap: the switches that allow OneLake file explorer or apps outside Fabric are tenant settings. A workspace admin can't change them.
Apache Airflow job settings
Exam depth: recognize it.
An Apache Airflow job runs Airflow workflows written in Python, called DAGs. Older pages call it Data workflows. Its pool is set under Data Factory > Apache Airflow Runtime Settings, in Default Data Workflow Setting.
| Starter pool | Custom pool | |
|---|---|---|
| Uptime | Shuts down after 20 minutes idle. | Always on until you pause it. |
| Best for | Development and testing. | Production schedules. |
| Options | None. | Node size, autoscale, extra nodes. |
Decision rule: a DAG that must run on a schedule around the clock needs a custom pool.
Try it in Fabric
You need the Admin role on a workspace. A trial capacity is enough.
- Open the workspace and select Workspace settings.
- Expand Data Engineering/Science and select Spark settings.
- On the Pool tab, open the Default pool for workspace list. Select StarterPool to see its node limits.
- Open the list again and select New pool.
- Enter a name, keep Memory optimized, and pick Small as the node size.
- Keep autoscale and dynamic allocation on, then select Create.
- Open the Jobs tab, find Spark session timeout and note the 20-minute default.
Exam-style practice
You are a data engineer at Northwind Rides. Notebooks read the partner's maintenance files through an Amazon S3 shortcut many times a day. Egress charges are rising. The files must stay in S3. You need to cut the charges with the least effort. What should you do?
Pick one answer.
You are a data engineer at Northwind Rides. Every notebook in the workspace needs the same geospatial library. New notebooks keep missing it. You are a workspace admin. You need the library available by default to all notebooks. What should you do?
Pick one answer.
You are a data engineer at Northwind Rides. An Apache Airflow job must run its DAGs on a schedule every hour, day and night. Runs are missed after quiet periods on the default pool. You need reliable scheduled runs. What should you configure?
Pick one answer.
Worth keeping
- Only workspace Admins change workspace settings.
- Starter pool for fast start; custom pool when you need node size or scaling control.
- Libraries and Spark properties live in an environment, set as the workspace default.
- High concurrency shares one session across notebooks and bills only the first.
- Domains organize and delegate but grant no access; shortcut caching cuts cross-cloud reads.
On Monday someone edited the shared environment and three notebooks broke. Nobody knows what changed, and there's no way back. Next lesson connects the workspace to Git, so every change has a history and an undo.
Leaderboard
Loading…
50 XP for each lesson you finish, 10 for each right answer. Names show only for learners who turn on Show me on leaderboards.
Sources for this lesson (19)
Each fact in the lesson is marked with the number of the page it comes from.
- [4]Microsoft Learn: Study Guide for Exam DP-700
- [39]Microsoft Learn: Workspaces in Microsoft Fabric and Power BI
- [50]Microsoft Learn: Fabric domains
- [74]Microsoft Learn: OneLake shortcuts
- [152]Microsoft Learn: Data Engineering workspace administration settings in Microsoft Fabric
- [153]Microsoft Learn: Configure starter pools in Microsoft Fabric
- [154]Microsoft Learn: Create custom Spark pools in Microsoft Fabric
- [155]Microsoft Learn: Overview of Apache Spark compute in Microsoft Fabric
- [156]Microsoft Learn: Create, configure, and use an environment in Fabric
- [157]Microsoft Learn: Spark compute configuration settings in Fabric environments
- [158]Microsoft Learn: Migrate workspace libraries and Spark properties to a default environment
- [159]Microsoft Learn: Manage Apache Spark libraries in Microsoft Fabric
- [160]Microsoft Learn: High concurrency mode in Apache Spark for Fabric
- [161]Microsoft Learn: Configure high concurrency mode for Fabric notebooks in pipelines
- [162]Microsoft Learn: Job admission in Apache Spark for Microsoft Fabric
- [163]Microsoft Learn: OneLake diagnostics
- [164]Microsoft Learn: OneLake tenant settings
- [165]Microsoft Learn: Apache Airflow Job workspace settings
- [166]Microsoft Learn: Apache Airflow compute in Fabric