Fabric

Working with tables in the Microsoft Fabric lakehouse may look like a straightforward task - however, there are many nuances to be aware of before you decide to go one way or another

On July 5th, we announced the ability to clone data warehouse tables within Microsoft Fabric as of current point in time. The ability to clone tables is a powerful technique that not only empowers businesses to streamline reporting and analytics but also helps expedite development and testing processes.  While data warehouses constantly evolve, it is often … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/time-travelling-through-data-the-magic-of-table-clones/" class="more-link">Continue reading<span class="screen-reader-text"> “Time-Travelling through data: The Magic of Table clones”</span></a>

Today, we are excited to share a list of user experience features that we’ve shipped within Fabric Warehouse during the month of Nov 2023, to help drive productivity and simplify the experience. The following are the list of features: The rest of the blog describes each of these features in greater detail. Clone table experience … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/fabric-warehouse-user-experience-updates/" class="more-link">Continue reading<span class="screen-reader-text"> “Fabric Warehouse user experience updates”</span></a>

Microsoft OneLake provides a single unified storage location for all your data analytics needs. Whether your data is stored directly in OneLake or through other storage accounts, all your data is accessible through OneLake. Microsoft OneLake makes this possible through a virtualization layer called Shortcuts. Shortcuts in OneLake allow you to reference different storage locations … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/create-multiple-shortcuts-faster-and-easier/" class="more-link">Continue reading<span class="screen-reader-text"> “Create multiple shortcuts faster and easier”</span></a>

A comprehensive guide to using Data pipelines in Microsoft Fabric Want to retrieve numerous tables from databases across multiple data sources in a fairly simple, reliable, and scalable manner? Data Factory (incl. Data Pipelines) role in Microsoft Fabric Then, read along for this deep-dive into Data

We are excited to announce that the Data Warehouse now publishes all Inserts, Updates and Deletes for each table to their Delta Lake Log in OneLake! Our vision is to break down data silos and make it really easy to share data from your Data Warehouses with other teams who use different services without having … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/announcing-fabric-warehouse-publishing-full-dml-to-delta-lake-logs/" class="more-link">Continue reading<span class="screen-reader-text"> “Announcing: Fabric Warehouse publishing full DML to Delta Lake Logs”</span></a>

Microsoft Fabric October 2023 update We have a lot of features this month including updates to the Item type icons, Keyword-Based Filtering of Tenant Settings, On-object Interaction updates, Eventstream Kafka Endpoints and many more. Continue reading for more details on our new and updated features! Core Item type icons Admin Keyword-Based Filtering of Tenant Settings … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/microsoft-fabric-october-2023-update-2/" class="more-link">Continue reading<span class="screen-reader-text"> “Microsoft Fabric October 2023 update”</span></a>

Data Factory in Microsoft Fabric is an AMAZING tool that allows us to combine the flexibility of Data pipelines and ease of a Dataflow Gen2 to create some nifty solutions with a tiny smidge of code. One of the most common use cases is the ability to load new data into a destination for a […]

No matter what, when the Power BI on-premises gateways are not working as expected, data will not refresh, and direct query queries will not succeed. It's almost simple to create a monitoring solution using Microsoft Fabric

Reflex is many things next to one of the workloads of Microsoft Fabric. Before I delve into these things in more detail in later articles (yes, maybe this is the birth of another series of articles), I want to say this: Reflex is cool. It was never that simple to watch your data in your Power BI datasets (and this is only one of the capabilities of Reflex). Because I need images whenever I try to understand things, I start with a simple image of Reflex: I consider Reflex a watchdog! Reflex is watching something and alarms me or someone else when something happens - a defined condition is met. It will be likely that the first thing you ask Reflex to watch is a measure in one of your Power BI datasets. The dataset I use in this article is the dataset that holds the status of my on-premises data gateways. I store the status of each on-premises data gateway in a delta table-you can read about this here: (https://www.minceddata.info/2023/10/16/power-bi-gateway-monitoring-and-more-using-microsoft-fabric/) I defined a measure that returns 1 if the status of the gateway is “NotReachable.” This status indicates that something has happened, and the Power BI Service cannot use the gateway to support import and Direct Query solutions. This measure is simple: a new Measure = var maxActivityDateTime = CALCULATE( MAX( 'view1'[activityDateTime] ) ) return CALCULATE( COUNT( 'view1'[GatewayStatus] ) , 'view1'[GatewayStatus] = "NotReachable" , 'view1'[activityDateTime] = maxActivityDateTime ) The table ‘view1’ holds the status information about all the on-premises data gateways. The measure returns a value that is greater than 0 when the status of one the gateways becomes “NotReachable.” This measure returns the value only for the latest available status. The timestamp is created inside the notebook that is retrieving the status information and stored to the delta table.

One of my top three favorite features in Microsoft Fabric

Enhance productivity in Fabric Notebook using mssparkutils' fastcp, a Python wrapper for azcopy, providing 9x faster file copying

🚀 Using notebooks in #MicrosoftFabric: Whenever technology advances for citizen #PowerBI developers, it’s impossible for me not to pay attention! I’m thrilled to share how recent improv…

We are excited to announce the availability of Column-Level and Row-Level Security in Fabric Warehouse & SQL Endpoint in Public preview in all regions! In today’s data-driven world, organizations are constantly collecting vast amounts of sensitive information that fuels their operations, decision-making processes, and competitive edge. While data accessibility is essential for business success, ensuring … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/announcing-column-level-row-level-security-for-fabric-warehouse-sql-endpoint/" class="more-link">Continue reading<span class="screen-reader-text"> “Announcing: Column-Level & Row-Level Security for Fabric Warehouse & SQL Endpoint”</span></a>

Meet your new favourite action hero, Data Activator. It’s the newest experience to be added to Microsoft’s unified Software-as-a-Service (SaaS) platform Fabric, having been made available in the public preview at the beginning of October. But what is it? What does it do? How can you use it?

Introducing MeasureMaze: a Python library for enhanced Power BI measure dependency visualization, network analysis, and workflow optimization

Learn about Azure Pipelines and how to use them with Desktop projects.

Using Microsoft Fabric’s Lakehouse we can manage different data sources. Today Microsoft Copilot is very popular, and we hope that Microsoft Fabric can become an indispensable part of enterprise data management and make it easier for enterprise data to connect with LLM. This blog will combines data engineering and data science perspectives to construct Copilot … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/chat-your-data-in-microsoft-fabric-with-semantic-kernel/" class="more-link">Continue reading<span class="screen-reader-text"> “Chat your data in Microsoft Fabric with Semantic Kernel”</span></a>

In this post, I’ll explain the how and why of: How to connect Tableau to Power BI semantic models. How to connect Tableau to Fabric lakehouses (and other items that have a SQL endpoint).

Table of Contents Introduction to Data Lineage With more emphasis on data management and governance than ever before, understanding the journey of data from its source to its destination is […]

A while ago I had a little blog post series about cool stuff in Snowflake. I'm starting up a similar series, but this time for Microsoft Fabric. I'm not going to cover the basic of Fabric, hundreds of bloggers have already done that. I'm going to cover little bits & pieces that I find interesting,

There are 2 kinds of companies currently active in the Microsoft data space: those who are migrating to Microsoft Fabric, and those who will soon be planning their migration to Microsoft Fabric. 😅 One question that often comes back is Should I focus on the Lakehouse or the Data Warehouse? Let’s answer that in this post. I can already tell you this: you’re asking the wrong question 😉

With the latest OneLake file explorer v1.0.10.0 (download here), you can now seamlessly transition from browsing your OneLake data in Windows File Explorer to accessing it in the online Fabric portal.  Perhaps you are using OneLake file explorer to upload data that you want to analyze in a Fabric Notebook.  After uploading the data, you can … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/onelake-file-explorer-easy-access-to-open-workspaces-and-items-online/" class="more-link">Continue reading<span class="screen-reader-text"> “OneLake file explorer: easy access to open workspaces and items online”</span></a>

Microsoft Fabric offers a set of different tools to explore and prepare the data for analysis and from that perspective, notebooks have become one of the quickest ways to get started with data exploration. This post draws its inspiration from the world of experimentation, exploration, and seamless integration into Microsoft Fabric- Data Science in Microsoft … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/fabric-change-the-game-exploring-the-data/" class="more-link">Continue reading<span class="screen-reader-text"> “Fabric Change the Game: Exploring the data”</span></a>

Refreshing a Direct Lake Power BI dataset in Fabric points it at the latest version of the data in your Lakehouse

New data flavors require new ways for storing it! Learn everything you need to know about the Parquet file format

One of the many things I consider epic regarding Microsoft Fabric is the fact that the compute engines that fuel the magic of Fabric have been enabled to read natively from a new storage format. This new storage format is the delta table format (in short, CRUD-enabled parquet files).

If you feel like the pace and volume of updates surrounding Power BI have increased, you’re not alone. In this article, I discuss why many people feel like “it’s just too much” lately, why that’s a problem, and what we might do about it.