Smart Data Pipeline Design: Check for Delta Table Changes with Minimal Overhead
Scenario I have a notebook that processes hot data every 5 minutes. Meanwhile, another pipeline processes historical data, and I want to create a summary table that uses the hot data incrementally …
Announcing GitHub integration for source control (Preview) | Microsoft Fabric Blog | Microsoft Fabric
GitHub and GitHub Enterprise are now available for source control integration. Connect your workspace and you can start syncing your fabric content into your repository.
Leverage Microsoft Fabric Delta Lake tables for reporting over billions of rows
Admit it - flat data with table or matrix visualizations is not exciting. But it IS exciting when your report returns results from billions of rows in a matter..
Leverage Microsoft Fabric Delta Lake tables for reporting over billions of rows
Admit it - flat data with table or matrix visualizations is not exciting. But it IS exciting when your report returns results from billions of rows in a matter..
Use Python to get the latest Power BI dataflow contents from Azure Data Lake Storage Gen 2
If you are making use of the feature to store your Power BI dataflow results in your own Azure Data Lake Gen 2, then I'd like to share with you a Python script to get the latest file and load it into a pandas DataFrame.This came from a recent Twitter conversation Ruth Pozuelo, who has been doing some very cool updates on the matplotlib Python module. She asked:Is it possible to access a dataset curated with Power Query or/and DAX outside Microsoft walls? Like a dataflow or datamart?Here's the ac
One of the amazing things about Microsoft Fabric is the number of options you have for moving data. For example, you can use Dataflow Gen2, Pipelines, Notebooks, or any combination of the three. However, with all the options available, it can also ma...
Copy Activity, Dataflows Gen2, and Notebooks vs. SharePoint Lists – Data Meerkat
Excel is not a database... so Sharepoint is not a database. But that doesn't mean that people don't use it that way often, and even if they don't, we need to get the data out of them to use it.
Recover Your XMLA-Modified Power BI Dataset with These Git-Integration Steps
Have you ever found yourself stuck with a modified Power BI dataset, thanks to those well-intentioned but troublesome changes you made through the XMLA endpoint? Does that sound familiar to you? Wh…
Microsoft OneLake adds shortcut support to Power Platform and Dynamics 365 | Microsoft Fabric Blog | Microsoft Fabric
Microsoft OneLake is the OneDrive for data providing a single, unified data lake as a service for your entire organization. While OneLake provides a location to store data, shortcuts can virtualize data that you have stored elsewhere into OneLake even if that data resides in another cloud. With shortcuts, data will appear in OneLake as …
<p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/microsoft-onelake-adds-shortcut-support-to-power-platform-and-dynamics-365/" class="more-link">Continue reading<span class="screen-reader-text"> &#8220;Microsoft OneLake adds shortcut support to Power Platform and Dynamics 365&#8221;</span></a>
Unveiling Microsoft Fabric’s Impact on Power BI Developers and Analysts - BI Insight
Microsoft Fabric is a new platform designed to bring together the data and analytics features of Microsoft products like Power BI and Azure Synapse Analytics into a single SaaS product. Its goal is to provide a smooth and consistent experience for both data professionals and business users, covering everything from data entry to gaining insights. … Continue reading Unveiling Microsoft Fabric’s Impact on Power BI Developers and Analysts
Exploring Machine Learning in Microsoft Fabric: Should Data Scientists care? — Advancing Analytics
Fabric wouldn’t be an end-to-end data analytics platform without data science, so in this blog we will explore that data science and machine learning capabilities of Microsoft Fabric and assess where the platform fits in the completive data science landscape.