Fabric

As it is SQLBits 2024 this week, and me being a helper I’ve decided to release ‘Tapestry’ a metadata driven set of notebooks to process your data. It is not a complete process, at…

As part of Microsoft Fabric, a new storage mode to connect from Power BI to data in OneLake has been introduced. Direct Lake it makes to possible to use your data from OneLake in Power BI without t…

Working with Direct Lake requires mastering many new concepts! This article covers all the essential things you should know

Ready to take your Business Intelligence and Data Engineering skills to the next level with Azure OpenAI and Microsoft Fabric? Learn how to implement hashtag#RAG (Retrieval-Augmented Generation) Ar…

We are excited to announce we’ve made it easier than ever for Dynamics 365 and Power Apps customers to extend their insights into Fabric. In November 2023 we announced the ability to Link to Fabric from the Power Platform Maker Portal. This allows makers to easily analyze their data in Fabric through a single action … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/analyze-dataverse-tables-from-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Analyze Dataverse tables from Microsoft Fabric”</span></a>

Within Microsoft Fabric, Delta Tables serve as a common file/table format. These tables find application both in the Data Warehouse and as managed tables within the Lakehouse. Their versatility extends to several features and functionalities, making them indispensable in various use cases. One such feature is the Delta Change Data Feed. While not new to Microsoft Fabric, this … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/bridging-fabric-lakehouses-delta-change-data-feed-for-seamless-etl/" class="more-link">Continue reading<span class="screen-reader-text"> “Bridging Fabric Lakehouses: Delta Change Data Feed for Seamless ETL”</span></a>

Fabric is here but what does that mean if you are using Power BI? What do you need to know and what, if anything will you need to change if you are a Power BI report designer, developer or BI solut…

I was trying some stuff out in a notebook on top of a Microsoft Fabric Lakehouse. I was wondering what some of the default values are of the configuration variables, and if there's an easy way to retrieve them all. Luckily there is. In the code, I'm using Scala because it has a nice GetAll() functio

You might know the feeling: you're writing code in a Notebook in Microsoft Fabric and suddenly you have to leave your workstation for a while. Someone ran the doorbell (you're working from home and you get some parcels delivered), or you took a coffee break with some colleagues. When you return to y

This article describes the usages of Microsoft Copilot in Fabric Data Factory Dataflow Gen2 or Power Query in Power BI Service.

This blog post shows you how to successfully run a data pipeline using a notebook where the notebook is using the Sempy (Semantic-Link) python package.

Learn how to generate a business-friendly PowerBI data dictionary using OpenAI, SemanticLink, and MSFabric! In this video, we explore how to incorporate Azure OpenAI into the world of Business Inte…

In Power BI development in Microsoft Fabric, understanding and utilising source control mechanisms is crucial for efficient collaboration and version management. This blog post delves into the essential aspects of source control for Power BI. This blog also includes the recording of my session at Saudi Arabia’s Excel User Group on the 26th of August … Continue reading Microsoft Fabric: Source Control Options for Power BI Developers

We’re excited to announce the winners of HackTogether: The Microsoft Fabric Global AI Hack! What is #HackTogether? In this HackTogether, we had the opportunity to build innovative AI solutions with Microsoft Fabric. The event challenged over 640 registrants with prize awards for top submissions (including one grand prize that includes passes to attend the Microsoft … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/announcing-the-winners-of-hacktogether-the-microsoft-fabric-global-ai-hack/" class="more-link">Continue reading<span class="screen-reader-text"> “Announcing the winners of “HackTogether: The Microsoft Fabric Global AI Hack””</span></a>

Last month, we announced that Copilot in Fabric begins billing on March 1st, 2024, as part of your existing Power BI Premium or Fabric Capacity. Since then, we have received many questions about how to estimate the cost of using Fabric Copilot.   In this post, we will show how Fabric Copilot usage is calculated. We’ll walk … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/fabric-copilot-pricing-an-end-to-end-example-2/" class="more-link">Continue reading<span class="screen-reader-text"> “Fabric Copilot Pricing: An End-to-End example “</span></a>

With the new ‘browse Azure’ functionality in Get Data, you can easily browse all your Azure resources and automatically connect to them, without going through manually setting up a connection, saving you a lot of time. Using the regular path in Get Data to create a new connection, you always need to fill in your … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/browse-azure-resources-with-get-data/" class="more-link">Continue reading<span class="screen-reader-text"> “Browse Azure resources with Get Data”</span></a>

When you have a Lakehouse or Warehouse and you want to load data into it, you can use Dataflow Gen2 as an easy, low-code way for landing your data with the right shape. You can always create a stand-alone Dataflow Gen2 and use the data destinations to load your data in any Fabric Lakehouse or … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/updates-to-default-data-destination-behavior-dataflow-gen-2/" class="more-link">Continue reading<span class="screen-reader-text"> “Updates to default data destination behavior in Dataflow Gen2”</span></a>

Fabric ISV Partner Ecosystem enables ISVs to use a streamlined solution that’s easy to connect, onboard, and operate.

If you have used Spark in Azure Synapse, prepare to be pleasantly surprised with the compute experience in Microsoft Fabric as Spark compute starts a lot faster because the underlying technology ha…

Introduction OneLake can be used as a single data lake for your entire organization, it provides ease of use and helps eliminate data silos. It can also simplify security while ensuring that sensitive data is kept secure. OneLake and Fabric provide several out of the box capabilities to keep data access restricted to only those … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/building-common-data-architectures-with-onelake-in-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Building Common Data Architectures with OneLake in Microsoft Fabric”</span></a>

A new feature that enables secure and seamless access to ADLS Gen2 storage accounts from OneLake shortcuts in Fabric  We are excited to announce Trusted workspace access, a new feature in Fabric that allows you to securely access firewall-enabled Storage accounts. With Trusted workspace access, you can create OneLake shortcuts to Storage accounts, and then use … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/introducing-trusted-workspace-access-for-onelake-shortcuts/" class="more-link">Continue reading<span class="screen-reader-text"> “Introducing Trusted Workspace Access for OneLake Shortcuts “</span></a>

Introduction OneLake can be used as a single data lake for your entire organization, it provides ease of use and helps eliminate data silos. It can also simplify security while ensuring that sensitive data is kept secure. OneLake and Fabric provide several out of the box capabilities to keep data access restricted to only those … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/building-common-data-architectures-with-onelake-in-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Building Common Data Architectures with OneLake in Microsoft Fabric”</span></a>

Writers: John Hoang and Brad SchachtTechnical Reviewers: Steve Howard and Priya Sathy Introduction The following is an article in a series that focuses on the migration from Azure Synapse Analytics to Microsoft Fabric. The first article, ​​Azure Synapse dedicated SQL pools to Fabric migration, discussed options to migrate DDL, T-SQL, and data from Synapse Dedicated … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/mapping-azure-synapse-dedicated-sql-pools-to-fabric-data-warehouse-compute/" class="more-link">Continue reading<span class="screen-reader-text"> “Mapping ​​Azure Synapse dedicated SQL pools to Fabric data warehouse compute”</span></a>

In the era of AI, data has become the cornerstone of analytics platforms. With the ever-increasing volume of data being collected across various applications, data lakes, databases, and data warehouses within an enterprise data estate, the need for secure access to enterprise data sources has become critical. This is particularly important given the growth of … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/introducing-managed-private-endpoints-for-microsoft-fabric-in-public-preview/" class="more-link">Continue reading<span class="screen-reader-text"> “Introducing Managed Private Endpoints for Microsoft Fabric in Public Preview”</span></a>

I have being playing with Electricity Market Data recently and now I have a #Fabric solution that I think is easy enough to use but more importantly cost effective that it works just fine using F2 …

We are very excited to announce a lot of new improvements to data destinations in dataflows gen 2. Here is an overview of the new improvements and how to get started. After you have cleaned and prepared your data with dataflows gen 2, you want to land your data into a destination. This is possible … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/dataflows-gen-2-data-destinations-and-managed-settings/" class="more-link">Continue reading<span class="screen-reader-text"> “Dataflows gen 2 data destinations and managed settings”</span></a>

As an organisation we have a set of central semantic models that everything runs off. These are checked into GIT and we operate a branching model. Now that TMDL is more fully supported I’ve l…

In this post, we will see how to perform pagination when calling Fabric Rest API from a notebook. Note that at the time of writing this post the Fabric REST API is still in preview. What is pagination Pagination is a process used to divide a large dataset into smaller chunks and each smaller chunk contains a pointer to the next smaller chunk until there’s no more chunk. As Fabric REST API limits the number of records it returns it also...p class="read-more"a class="btn btn-default" href="https://datakuity.com/2024/02/12/pagination-in-fabric-rest-api/" Read Morespan class="screen-reader-text" Read More/span/a/p

In this post, we will explore how to generate large sample data in Fabric. Why do we need to Generate Large Sample Data in Fabric? I can think of many many reasons to generate large sample data in Fabric but one of the reasons I see as crucial is for testing performance or to help us decide which tier we should buy for now or in the future. Today, Fabric offers built-in sample datasets, but they may not suffice for...p class="read-more"a class="btn btn-default" href="https://datakuity.com/2024/02/05/generate-large-sample-data-in-fabric/" Read Morespan class="screen-reader-text" Read More/span/a/p

Learn how to run multiple notebooks in a specific order or in parallel, depending on the dependencies and logic of your data pipeline in Fabric