azure

Revolutionize data transformation with Azure OpenAI and SynapseML on Spark. Unleash innovation at scale with Microsoft Fabric.

Contribute to ImkeF/Power-Platform-Tools development by creating an account on GitHub.

This is the third post in a 3-part blog series on Power BI with Azure Databricks SQL authored by Andrey Mirskiy and Diego Fanesi. Read Part 1: Power Up your BI with Microsoft Power BI and Azure Databricks Lakehouse: part 1 - Essentials and Part 2: Power Up your BI with Microsoft Power BI and Lakehou...

Databricks SQL is a powerful tool for querying and analysing data in Databricks Lakehouse. It empowers data analysts and engineers that are familiar with SQL, to extract insights without the need for complex code, thereby streamlining and speeding up the data analysis process.

Recently, I had the opportunity to explore the Databricks SQL extension for VSCode, and I was thoroughly impressed. With its user-friendly interface, robust features, and seamless integration with Databricks, this extension is the ideal solution for querying your Databricks Lakehouse outside of the

New data flavors require new ways for storing it! Learn everything you need to know about the Parquet file format

data business intelligence bi machine learning mi professionals contractors azure Power bi analysis ETL ELT modeling automation training leadership

In today’s data-driven world, organizations need to harness the power of data analytics to make informed decisions, drive growth, and stay competitive. Microsoft offers two powerful tools for…

Author: @SuryaJ  is a Program Manager in the Azure Synapse Customer Success Engineering (CSE) team.   Introduction Kusto Query Language (KQL) is a powerful query language to analyse large volumes of structured, semi structured and unstructured (Free Text) data. It has inbuilt operators and functions...

One of the most complained things about Microsoft Purview Data Governance is the missing of a development/trial option. The pricing of Microsoft Purview is based on different usage types – in…

This tutorial shows you how to use PowerShell to import data from a CSV file, then use a foreach loop to take action on each item.

So, for 2023 I’ve decided that I want to learn Azure Synapse. I want to be able to make training content on it by the end of the year. I’d like to be able to consult on it in two years. And right now, I am absolutely banging my head against the learning curve. Let’s … Continue reading Why I’m struggling with learning Azure Synapse →

Proper use of table distributions in Synapse Dedicated SQL Pools is easily the #1 shortcoming in Synapse implementations.I regularly see large queries that t...

This article will walk you through the different ways of how to monitor serverless SQL requests. By reviewing this article, you will understand what to see, compare and how to troubleshoot the query execution behavior. At the end of this article, I will also share how to create a solution to retain ...

A lot happened in the Microsoft Data Governance area, especially in the area of Microsoft Purview Data Governance. Let’s go back in history and wrap up the announcements that have been made i…

In early 2022, Microsoft released a new activity in Azure Data Factory (ADF) called the Script activity. The Script activity allows you to execute one or more SQL statements and receive zero, one, …

CSV? Parquet? Delta? Which file format should you use to get the best out of Synapse Serverless SQL pool? Let's demistify pros and cons of each file type!

Author:  is a Principal Program Manager in the Azure Synapse Customer Success Engineering (CSE) team.   Introduction Following up on the previous blog Demystifying Azure Synapse Data Explorer, this blog continues the series of demystifying Data Explorer with a focus on data ingestion.   Azure Synaps...

Query to Power BI/Excel from KE/KWE Both Kusto explorer and Kusto web explorer, include an option to use a query as a basis to a Power BI report.Until recently the feature copied text to the Clipboard and this text could be pasted into a blank query.Already in Kusto Explorer (KE) and soon in Kusto We

We are excited to announce the Azure Data Factory (ADF) Learning Center! The Learning Center is a new central location where you can find useful learning resources like the latest features updates, getting started tutorials, best practice videos, training modules, product links, and more. This featu...

Welcome to Azure Data Factory’s October monthly update! Here we’ll share the latest updates on what’s new in Azure Data Factory. You can also find all our updates on our What's New in ADF page.    We’ll also be hosting our monthly livestream next week on November 10th at 10:30am PST/ 1:30pm EST! Joi...

Today, we’re excited to announce that Community Templates are now available, giving our community members an opportunity to contribute to our existing template gallery.    Templates are predefined Azure Data Factory pipelines that allow you to get started quickly with Data Factory. Templates are esp...

We are constantly inspired by all of you and how you use Azure Data Factory for all your data integration needs. Thank you for continuing to share your feedback with us. We love hearing from you and continue to use your input to improve Azure Data Factory.    Many exciting announcements are landing ...

I've blogged twice (here and here) about authentication using the msal Python module. I'm going to cap off this topic with a third and final entry by moving onto the azure-identity module. When I first looked at Azure authentication for the Power BI REST API, I honestly kind of fell into using the msal library first. I found it easy to use and went on to blog about it. Recently, I needed to use the azure-identity module took the time to try it out for getting access tokens to call the Power BI A

Databricks, Lakes & Parquet are a match made in heaven, but explode with extra power when using Delta Lake. This session will dive into the details of how Da...

Author(s): Arshad Ali and Abid Nazir Guroo are Program Managers in Azure Synapse Customer Success Engineering (CSE) team.   Introduction Data Lakehouse architecture has become the de facto standard for designing and building data platforms for analytics as it bridges the gap and breaks the silos cre...