Fabric

In today’s data-driven landscape, organizations are constantly seeking ways to streamline their data integration processes, enhance productivity, and democratize access to powerful data engineering capabilities with Copilot for Data Factory. At Microsoft, we’re committed to empowering data engineers and analysts with intelligent tools that reduce complexity and accelerate development. We’re excited to share the latest … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/ai-powered-development-with-data-factory-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “AI-powered development with Data Factory Microsoft Fabric”</span></a>

Today, we are announcing new types of Functions in Fabric Data Warehouse and Lakehouse SQL endpoint. Continue reading to find out more and if interested refer to sign up form for Functions preview in Fabric Data Warehouse. About functions Functions in SQL encapsulates specific logic that can be executed by invoking the function within queries, … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/functions-in-data-warehouse/" class="more-link">Continue reading<span class="screen-reader-text"> “Another dimension of Functions in Data Warehouse”</span></a>

We’ve made several significant updates to our Fabric Data Factory artifacts stories, including Continuous Integration/Continuous Deployment (CI/CD) and APIs support! These updates are designed to automate the integration, testing, and deployment of code changes, ensuring efficient and reliable development. In Fabric Data Factory, we currently support two key features in collaboration with the Application Lifecycle … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/data-operations-in-fabric-data-factory/" class="more-link">Continue reading<span class="screen-reader-text"> “DataOps in Fabric Data Factory”</span></a>

We are excited to announce the preview of Fabric User Data Functions! This feature is made to empower developers to create functions that contain their business logic and connect to Fabric data sources, and/or invoke them from other Fabric items such as Data pipelines, Notebooks and Power BI reports. Fabric User Data Functions leverage the … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/announcing-fabric-user-data-functions-in-public-preview/" class="more-link">Continue reading<span class="screen-reader-text"> “Announcing Fabric User Data Functions (Preview)”</span></a>

Co-Author – Gyani Sinha, Abhishek Narain Overview A well-architected lakehouse enables organizations to efficiently manage and process data for analytics, machine learning, and reporting. To achieve governance, scalability, operational excellence, and optimal performance, adopting a structured, metadata-driven approach is crucial for lakehouse implementation. Building on our previous blog, Demystifying Data Ingestion in Fabric, this post … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/playbook-for-metadata-driven-lakehouse-implementation-in-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Playbook for metadata driven Lakehouse implementation in Microsoft Fabric”</span></a>

Here is the March 2025 release of the on-premises data gateway (version 3000.262.5)

We are excited to announce support for SHOWPLAN_XML in Microsoft Fabric Data Warehouse in preview. This capability allows users to generate and view the estimated query execution plan in XML format, a tool for analyzing and optimizing SQL queries. Whether you’re troubleshooting performance bottlenecks or refining query strategies during development, SHOWPLAN_XML offers a granular, detailed … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/query-plans-in-fabric-data-warehouse/" class="more-link">Continue reading<span class="screen-reader-text"> “SHOWPLAN_XML in Fabric Data Warehouse (Preview)”</span></a>

In today’s data-driven landscape, optimizing query performance is paramount for organizations relying on data warehouses. Microsoft Fabric’s Query Insights emerges as a powerful tool, enabling data professionals to delve deep into query behaviors and enhance system efficiency. Understanding Query Insights Query Insights in Microsoft Fabric serves as a centralized repository, storing 30 days of historical … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/unlock-the-power-of-query-insights-and-become-a-fabric-data-warehouse-performance-detective/" class="more-link">Continue reading<span class="screen-reader-text"> “Unlock the Power of Query insights and become a Fabric Data Warehouse performance detective”</span></a>

What are hints? Hints are optional keywords that you can add to your SQL statements to provide additional information or instructions to the query optimizer. Hints can help you improve the performance, scalability, or consistency of your queries by overriding the default behavior of the query optimizer. For example, you can use hints to specify … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/20036/" class="more-link">Continue reading<span class="screen-reader-text"> “Hints in Fabric Data Warehouse”</span></a>

Microsoft Fabric shortcuts enable organizations to unify their data across various domains and clouds by creating a single virtual data lake. These shortcuts act as symbolic links to data in different storage locations, simplifying access and reducing the need for multiple copies. OneLake serves as the central hub for all analytics data. By using OneLake … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/whats-new-with-onelake-shortcuts/" class="more-link">Continue reading<span class="screen-reader-text"> “What’s new with OneLake shortcuts”</span></a>

We are excited to announce that we will be removing the SKU requirement to use Copilot and AI capabilities in Microsoft Fabric. This means that by the end of April, customers on F2 and above will have access to Copilot, Fabric data agents, and more. Whether you’re an analyst, a data scientist, or an executive, … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/copilot-and-ai-capabilities-now-accessible-to-all-paid-skus-in-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Copilot and AI Capabilities will be accessible to all paid SKUs in Microsoft Fabric “</span></a>

The Microsoft Fabric Community Conference returns to Las Vegas this week—bigger and better than ever. Learn more.

Database mirroring is a powerful feature in Microsoft Fabric, enabling seamless data replication and high availability for critical workloads (learn more about mirroring). However, connecting to mirrored databases behind a firewall requires the right integration approach. Database Mirroring now supports firewall connectivity for Azure SQL Database, with Snowflake and Azure SQL Managed Instance coming soon, ensuring … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/supporting-database-mirroring-sources-behind-a-firewall/" class="more-link">Continue reading<span class="screen-reader-text"> “Supporting Database Mirroring sources behind a firewall”</span></a>

Open Mirroring: Mirroring is one of the easiest ways to get data into Fabric, it creates a copy of your data in OneLake and keeps it up to date; no ETL required. Open Mirroring empowers everyone to create their own Mirroring Source using the publicly available API that allows you to replicate data from anywhere. … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/open-mirroring-ui-enhancements-and-csv-support-to-help-you-get-started-today/" class="more-link">Continue reading<span class="screen-reader-text"> “Open Mirroring UI enhancements and CSV support to help you get started today”</span></a>

Spring 2025 Round up: Performance, Developer Experience, and Data Management! Co-author:  Idris Motiwala This week, at the 2025 Fabric Conference in Las Vegas, we are unveiling a series of features for the SQL database in Fabric, including: performance enhancements, streamlined developer workflows, and improved data pipeline management. Here are the high-level features you can look … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/whats-new-for-sql-database-in-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “What’s new for SQL database in Fabric?”</span></a>

Unlocking the full potential of Microsoft Fabric with Terraform Provider Terraform Provider for Microsoft Fabric is now generally available (GA)! The first version of the Terraform Provider for Fabric was released six months ago, enabling engineers to automate key aspects of their Fabric Data Platform. Since then, adoption has grown significantly, now even more customers … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/terraform-provider-for-microsoft-fabric-now-generally-available/" class="more-link">Continue reading<span class="screen-reader-text"> “Terraform Provider for Microsoft Fabric (Generally Available)”</span></a>

Copy Job is now generally available, bringing you a simpler, faster, and more intuitive way to move data! Whether you’re handling batch transfers or need the efficiency of incremental data movement, Copy Job gives you the flexibility and reliability to get the job done.  Since it’s preview last September, we’ve received incredible feedback from you. … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/simplify-your-data-ingestion-with-copy-job-general-availability-announcement/" class="more-link">Continue reading<span class="screen-reader-text"> “Simplify Your Data Ingestion with Copy Job (Generally Available)”</span></a>

Managing data warehouse changes and automating deployments is now simpler than ever with the integration of DacFx with Git and Deployment Pipelines for Fabric Warehouse. This integration enables seamless export and import of your data warehouses, efficient schema change management, and deployment through Git-connected workflows. Whether you’re collaborating with a team using tools like VS … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/simplify-your-warehouse-alm-with-dacfx-integration-in-git-and-deployment-pipelines-for-fabric-warehouse/" class="more-link">Continue reading<span class="screen-reader-text"> “Simplify your Warehouse ALM with DacFx integration in Git and Deployment pipelines for Fabric Warehouse”</span></a>

We are excited to announce that the Get Data experience, along with the OneLake catalog, is now integrated into Excel for Windows (Preview). Like OneDrive, OneLake is a single, unified, logical data lake for your whole organization analytics data. This makes it crucial to have a streamlined method for loading OneLake data into Excel, enabling … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/easily-load-fabric-onelake-data-into-excel-onelake-catalog-and-modern-get-data-are-integrated-into-excel-for-windows-preview/" class="more-link">Continue reading<span class="screen-reader-text"> “Easily load Fabric OneLake data into Excel — OneLake catalog and Get Data are integrated into Excel for Windows (Preview)”</span></a>

Real-time data is crucial for enterprises to stay competitive, enabling instant decision-making, enhanced customer experiences, and operational efficiency. It helps detect fraud, optimize supply chains, and personalize interactions. By leveraging continuous data streams, businesses can unlock new opportunities, improve resilience, and drive smarter automation in a data-driven world. What are Fabric Event Streams and Solace … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/new-solace-pubsub-connector-seamlessly-connect-fabric-eventstream-with-solace-pubsub-preview/" class="more-link">Continue reading<span class="screen-reader-text"> “New Solace PubSub+ Connector: seamlessly connect Fabric Eventstream with Solace PubSub+ (Preview)”</span></a>

Microsoft Fabric is a unified, secure, and user-friendly data platform equipped with features necessary for developing enterprise-grade applications with minimal or no coding required. Last year, the platform was enhanced by introducing SQL Database in Fabric, facilitating AI application development within Microsoft Fabric. In a previous blog post, we discussed how to build a chatbot … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/ai-ready-apps-build-rag-data-pipeline-from-azure-blob-storage-to-sql-database-in-microsoft-fabric-within-minutes/" class="more-link">Continue reading<span class="screen-reader-text"> “AI Ready Apps: build RAG Data pipeline from Azure Blob Storage to SQL Database in Microsoft Fabric within minutes”</span></a>

Mirroring is a powerful feature in Microsoft Fabric, enabling you to seamlessly reflect your existing data estate continuously from any database or data warehouse into OneLake in Fabric. Once Mirroring starts the replication process, the mirrored data is automatically kept up to date at near real-time in Fabric OneLake. With your data estates landed into … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/whats-new-with-mirroring-in-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Mirroring in Fabric – What’s new”</span></a>

Prerequisites Before proceeding, ensure you have the necessary tools installed and configured. For more details, refer to the official installation guide: Install Azure CLI on Windows. Install Azur…

IntroductionOverviewRequirementsKey FeaturesWhy Use This Notebook?Getting StartedConclusion Introduction Another role of the Azure Data Insights & Analytics team is building and maintaining the…

It’s been almost a year since we announced the external data sharing in preview at Fabric Conference 2024, and later that year it was made generally available at Ignite 2024. We’ve listened to customer feedback and have continued to improve the functionality of external data sharing. Many new feature enhancements have been delivered since the … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/external-data-sharing-enhancements-out-now/" class="more-link">Continue reading<span class="screen-reader-text"> “External data sharing enhancements out now”</span></a>

With AI functions, you can harness the power of Fabric’s native large-language model endpoint for seamless summarization, classification, text generation, and much more—all with a single line of code.

This blog post shows how to use a Python Notebook in Microsoft Fabric, which consumes significantly less capacity units, as well as getting all the Fabric Items.

There are many ways to write data into Lakehouse, even using Notebooks.

Disclaimer: This article serves as a foundational guide to understanding the basics of architecting Microsoft Fabric. While it provides insights into key considerations, it is not an exhaustive blueprint. The […]