azure

Welcome to Azure Data Factory’s September monthly update! Here, we’ll share the latest updates on what’s new in Azure Data Factory. You can also find all our updates on our What's New in ADF page.    We’ll also be hosting our monthly livestream next week on October 11th at 11:30am PST/ 2:30pm EST! J...

In my last post I went over using a Service Principal account to access a Synapse SQL Pool with Power BI. I even showed how you could go across different tenants in my example. In this post instead…

Welcome to Azure Data Factory’s August monthly update! Here, we’ll share the latest updates on what’s new in Azure Data Factory. You can also find all our updates in our What's New in ADF page.    We’ll also be hosting our monthly livestream THIS week on September 15th at 11am PST / 2pm EST! Join us...

Check out phData's "Getting Started with Snowflake" guide to learn about the best practices for launching your Snowflake platform.

Unpack one of Snowflake’s most powerful data governance tools, object tagging, in this helpful blog that dives into the advantages of using object tagging.

In this post, we look at how to use lookups, what the difference is between First Row Only and All Rows, and how to control foreach loops.

There has been confusion for a while when it comes to Microsoft Docs and the two distinct sets of documentation for dedicated SQL pools. When you do an internet search for a Synapse related doc and land on Microsoft Docs site, the left-hand navigation has a toggle switch between two sets of docume...

The problem: how to make SQL dynamic?

This was my longtime aim to create this post, and finally, I will write about it here on how to call Azure ML Rest API inside Powe Query even if you don’t have Power BI Premium.Of course, some limitations on the number of API calls need to consider while using your Rest API.Thanks to Chris Read more about Azure Machine Learning Call API from Power Query[…]

Learn how to read and write data to Google BigQuery using Databricks.

In this tutorial I will show you - step by step - how to flatten the Google Analytics 4 export schema with the purpose of using the data in a relational database outside of BigQuery.

This is a repository for Microsoft Power Automate, Power Apps, and Azure Logic Apps connectors - PowerPlatformConnectors/independent-publisher-connectors/Sessionize at dev · microsoft/PowerPlatform...

We are excited to share that Gartner has positioned Microsoft as a Leader once again in the 2022 Gartner Magic Quadrant for Data Integration Tools. We believe this recognition shows our continued growth and ongoing commitment to delivering comprehensive and cost-effective data integration solu...

In 2015-2016, a team of folks at RJMetrics had the opportunity to observe, and participate in, a significant evolution of the analytics ecosystem. The seeds of dbt were conceived in this environment, and the viewpoint below was written to reflect what we had learned and how we believed the world should be different. dbt is our attempt to address the workflow challenges we observed, and as such, this viewpoint is the most foundational statement of the dbt project's goals.

A new user experience will soon be provided in the landing page of adf.azure.com or Switch Data Factory tab of Data Factory Studio portal to enable users to create Data Factory with only one click! This will allow users to create a Data Factory that can be available within several seconds. This new ...

Today, we’re excited to announce the preview of Microsoft Dev Box is now available to the public. Microsoft Dev Box is a managed service that enables developers to create on-demand, high-performance, secure, ready-to-code, project-specific workstations in the cloud.

The Microsoft Intelligent Data Platform, empowers organizations to invest more time creating value rather than integrating and managing their data estate. It integrates best-in-class solutions across Microsoft’s technology stack—breaking down data siloes and enabling organizations to extract r...

Azure Synapse Analytics July Update 2022  Welcome to the July 2022 update for Azure Synapse Analytics! This month, you will find information about Apache Spark 3.2 general availability, a new Cast transformation added to Synapse data flows, performance/cost improvements to Synapse Link for SQL, and ...

Phew! This one is going to be fun as the title should be "How to create a pipeline to incrementally copy over all datasets and subsequent tables from Google BigQuery to Azure Data Lake by using nested ForEach, If Condition activities and watermarks in Azure Data Factory" - but that title seemed a we

This blog post explains how to call an API that uses cookie authentication from a Logic App. Hint; there's a little secret to it!

Azure Data Explorer free cluster Start your Azure Data Explorer free cluster today. No credit card, payment information, or Azure subscription is required to create a free cluster! All that you need is a Microsoft account or an Azure Active Directory user identity.   The free cluster offers you a 10...

Azure Data Explorer is a log analytics cloud platform optimized for ad-hoc big data queries.

Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We've recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN().   collectUniq...

With Azure Synapse Database Templates generally available, our customers are constantly wanting to see and learn more about how to use these templates. Through these blogs we want to share tips and tricks our customers can use to help them utilize these templates in an efficient way. We’ve recently ...

Welcome to Azure Data Factory’s first monthly update blog! Here we’ll share the latest updates on what’s new in Azure Data Factory. You can also find all of our updates at What's new in Azure Data Factory - Azure Data Factory | Microsoft Docs.   We’ll also be hosting our monthly livestream on Wednes...

UPDATE! We've launched the new SAP connector in ADF today, June 30, 2022, and updated the blog post below accordingly.   For decades, companies have relied on Microsoft and SAP software to run their most mission-critical operations. Today, we’re excited to launch the public preview of SAP Change Dat...

A few years ago we created a code sample for enterprise developers called Customer Orders Database, designed to demonstrate how developers can create