$ loading_
Build Fabric Spark workflows, author notebook code, and manage lakehouse resources.
Copy the install command and let the AI configure it · recommended for beginners
Please install the "spark-authoring-cli" skill from askskill: 1. Download https://raw.githubusercontent.com/microsoft/skills-for-fabric/main/skills/spark-authoring-cli/SKILL.md 2. Save it as ~/.claude/skills/spark-authoring-cli/SKILL.md 3. Reload skills and tell me it's ready
Write PySpark code for a Microsoft Fabric Notebook: read the sales table from a Lakehouse, aggregate monthly sales by region, filter out null regions, and write the result to a Delta table named sales_monthly_summary. Include a brief explanation for each step.
Runnable PySpark code for a Fabric Notebook, plus step-by-step explanations of reading, cleaning, aggregating, and writing the data.
I want to design a data engineering workflow in Microsoft Fabric: ingest raw order data into a lakehouse, clean and deduplicate it, join dimension tables, and produce gold-layer tables for analytics. Provide a layered architecture, notebook decomposition, orchestration flow, and Delta Lake best practices.
A Fabric-ready lakehouse architecture, notebook and orchestration plan, and key implementation guidance for the pipeline.
Help me plan the initial environment for a Microsoft Fabric project: create workspaces, configure a Lakehouse, define notebook development standards, and explain how to manage deployments with infrastructure as code. Output the recommended resource structure, naming conventions, and deployment steps.
A Fabric environment setup and deployment plan covering resource structure, naming rules, development standards, and infrastructure management.
Update Check — ONCE PER SESSION (mandatory) The first time this skill is used in a session, run the check-updates skill before proceeding.
- GitHub Copilot CLI / VS Code: invoke the
check-updatesskill.- Claude Code / Cowork / Cursor / Windsurf / Codex: compare local vs remote package.json version.
- Skip if the check was already performed earlier in this session.
CRITICAL NOTES
- To find the workspace details (including its ID) from workspace name: list all workspaces and, then, use JMESPath filtering
- To find the item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace and, then, use JMESPath filtering
This skill covers two complementary areas: (1) managing Fabric Spark artifacts via REST APIs (workspaces, lakehouses, notebooks, jobs, pipelines) and (2) writing code inside Fabric Notebook cells (PySpark, Scala, SparkR, SQL with correct lakehouse access, notebookutils, and Spark configuration). For notebook code authoring fundamentals and shared modules, MUST see SPARK-NOTEBOOK-AUTHORING-CORE.md.
| Task | Reference | Notes |
|---|---|---|
| RULES — Read these first, follow them always | SKILL.md § RULES | MUST read — 4 rules for this skill |
| Finding Workspaces and Items in Fabric | COMMON-CLI.md § Finding Workspaces and Items in Fabric | Mandatory — READ link first [needed for finding workspace id by its name or item id by its name, item type, and workspace id] |
| Fabric Topology & Key Concepts | COMMON-CORE.md § Fabric Topology & Key Concepts | |
| Environment URLs | COMMON-CORE.md § Environment URLs | |
| Authentication & Token Acquisition | COMMON-CORE.md § Authentication & Token Acquisition | Wrong audience = 401; read before any auth issue |
| Core Control-Plane REST APIs | COMMON-CORE.md § Core Control-Plane REST APIs | |
| Pagination | COMMON-CORE.md § Pagination | |
| Long-Running Operations (LRO) | COMMON-CORE.md § Long-Running Operations (LRO) | |
| Rate Limiting & Throttling | COMMON-CORE.md § Rate Limiting & Throttling | |
| OneLake Data Access | COMMON-CORE.md § OneLake Data Access | Requires storage.azure.com token, not Fabric token |
| Definition Envelope | ITEM-DEFINITIONS-CORE.md § Definition Envelope | Definition payload structure |
| Per-Item-Type Definitions | ITEM-DEFINITIONS-CORE.md § Per-Item-Type Definitions | Support matrix, decoded content, part paths — REST specs, CLI recipes |
| Job Execution | COMMON-CORE.md § Job Execution | |
| Capacity Management | COMMON-CORE.md § Capacity Management | |
| Gotchas & Troubleshooting | COMMON-CORE.md § Gotchas & Troubleshooting | |
| Best Practices | COMMON-CORE.md § Best Practices | |
| Tool Selection Rationale | COMMON-CLI.md § Tool Selection Rationale |
…
Run DAX queries and inspect Fabric Power BI semantic model metadata.
Scan, assess, and upgrade Power BI Gen1 dataflows into Gen2.1 copies.
Build end-to-end Bronze, Silver, and Gold lakehouse pipelines in Microsoft Fabric.
Create, update, and publish Microsoft Fabric Eventstream topologies via REST APIs.
Migrate HDInsight Spark, Hive, and Oozie workloads to Microsoft Fabric.
Check skill marketplace updates and view version changes and changelogs.
Interactively analyze lakehouse data with PySpark, Livy sessions, and Spark SQL.
Run read-only T-SQL queries on Fabric warehouse and lakehouse data.
Diagnose Spark failures, session issues, and performance bottlenecks in Microsoft Fabric.
Integrate document workflows with Spark AI, sessions, knowledge, and sheet operations.
Run authoring T-SQL for Fabric warehouses and SQL endpoints from CLI.
Migrate Azure Synapse Spark workloads to Microsoft Fabric with code replacements.