Guidance to Maximizing Productivity and Efficiency for your Data Engineering Workloads Data engineering teams often grapple with the complexities of planning and configuring compute resources for their data platforms. This is especially true when working with large-scale, complex datasets and demanding downstream SLAs. A one-size-fits-all approach is rarely effective, as different data layers and datasets … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/optimizing-spark-compute-for-medallion-architectures-in-microsoft-fabric/" class="more-link">Continue reading<span class="screen-reader-text"> “Optimizing Spark Compute for Medallion Architectures in Microsoft Fabric”</span></a>

Learn how to connect to OneLake via Azure Databricks. After completing this tutorial, you can read and write to a lakehouse via Azure Databricks.

Welcome to the September 2023 update. We have lots of features this month including updates to the monitoring hub, Fabric Metrics app, VS code integration for Data Engineering, Real-time data sharing and many more. Continue reading for more details on our new features! Contents Core Monitoring hub – column options OneLake OneLake file explorer (v.1.0.10) … <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/microsoft-fabric-september-2023-update/" class="more-link">Continue reading<span class="screen-reader-text"> “Microsoft Fabric September 2023 update”</span></a>

As part of Microsoft Fabric, a new storage mode to connect from Power BI to data in OneLake has been introduced. Direct Lake it makes to possible to use your data from OneLake in Power BI without t…

In this blog, we’ll focus on the different ways of querying data in Synapse Real-Time Analytics. But before we begin, make sure to follow the steps in the Synapse Real-Time Analytics: Discovering the best ways to get data into a KQL database to ingest data into your KQL database.

Today, we have some exciting news to share with you – the introduction of a new Power BI admin API that allows you to conveniently access all tenant settings in a single call.

TL;DR : using Fabric Python Notebook to Sort and Save  Parquet files  up to 100 GB shows that DuckDB is very competitive compared to Spark even when using Only half the resources available in a com…

In this blog article, we will explore four end-to-end scenarios that are typical paths our customers take to extract value and insights from their data using Microsoft Fabric. In these scenarios, we will show you how Fabric seamlessly addresses common architectural scenarios with a single service that encompasses data ingestion, transformation, storage, and exposure through reports or SQL endpoints.

This week at Microsoft Build, we announced the future. With an introduction like that, I should probably remind everyone that this is my personal blog, my personal perspective, and my personal opin…