Databricks, Lakes & Parquet are a match made in heaven, but explode with extra power when using Delta Lake. This session will dive into the details of how Da...
Building the Lakehouse - Implementing a Data Lake Strategy with Azure Synapse
Author(s): Arshad Ali and Abid Nazir Guroo are Program Managers in Azure Synapse Customer Success Engineering (CSE) team. Introduction Data Lakehouse architecture has become the de facto standard for designing and building data platforms for analytics as it bridges the gap and breaks the silos cre...
Welcome to Azure Data Factory’s September monthly update! Here, we’ll share the latest updates on what’s new in Azure Data Factory. You can also find all our updates on our What's New in ADF page. We’ll also be hosting our monthly livestream next week on October 11th at 11:30am PST/ 2:30pm EST! J...
Power BI using Service Principal with Synapse Data Explorer (Kusto) Pool
In my last post I went over using a Service Principal account to access a Synapse SQL Pool with Power BI. I even showed how you could go across different tenants in my example. In this post instead…
Welcome to Azure Data Factory’s August monthly update! Here, we’ll share the latest updates on what’s new in Azure Data Factory. You can also find all our updates in our What's New in ADF page. We’ll also be hosting our monthly livestream THIS week on September 15th at 11am PST / 2pm EST! Join us...
Snowflake Data Governance: What is Object Tagging?
Unpack one of Snowflake’s most powerful data governance tools, object tagging, in this helpful blog that dives into the advantages of using object tagging.
What's the difference between Azure Synapse (formerly SQL DW) and Azure Synapse Analytics Workspace
There has been confusion for a while when it comes to Microsoft Docs and the two distinct sets of documentation for dedicated SQL pools. When you do an internet search for a Synapse related doc and land on Microsoft Docs site, the left-hand navigation has a toggle switch between two sets of docume...
This was my longtime aim to create this post, and finally, I will write about it here on how to call Azure ML Rest API inside Powe Query even if you don’t have Power BI Premium.Of course, some limitations on the number of API calls need to consider while using your Rest API.Thanks to Chris Read more about Azure Machine Learning Call API from Power Query[…]
Tutorial: How to flatten the GA4 BigQuery export schema for usage in relational databases
In this tutorial I will show you - step by step - how to flatten the Google Analytics 4 export schema with the purpose of using the data in a relational database outside of BigQuery.
PowerPlatformConnectors/independent-publisher-connectors/Sessionize at dev · microsoft/PowerPlatformConnectors · GitHub
This is a repository for Microsoft Power Automate, Power Apps, and Azure Logic Apps connectors - PowerPlatformConnectors/independent-publisher-connectors/Sessionize at dev · microsoft/PowerPlatform...
Microsoft named a Leader in 2022 Gartner® Magic Quadrant™ for Data Integration Tools
We are excited to share that Gartner has positioned Microsoft as a Leader once again in the 2022 Gartner Magic Quadrant for Data Integration Tools. We believe this recognition shows our continued growth and ongoing commitment to delivering comprehensive and cost-effective data integration solu...
In 2015-2016, a team of folks at RJMetrics had the opportunity to observe, and participate in, a significant evolution of the analytics ecosystem. The seeds of dbt were conceived in this environment, and the viewpoint below was written to reflect what we had learned and how we believed the world should be different. dbt is our attempt to address the workflow challenges we observed, and as such, this viewpoint is the most foundational statement of the dbt project's goals.
Coming Soon: New Experience for Creating Data Factory within Seconds
A new user experience will soon be provided in the landing page of adf.azure.com or Switch Data Factory tab of Data Factory Studio portal to enable users to create Data Factory with only one click! This will allow users to create a Data Factory that can be available within several seconds. This new ...
Today, we’re excited to announce the preview of Microsoft Dev Box is now available to the public. Microsoft Dev Box is a managed service that enables developers to create on-demand, high-performance, secure, ready-to-code, project-specific workstations in the cloud.
Gain Deeper Insights with Microsoft Intelligent Data Platform
The Microsoft Intelligent Data Platform, empowers organizations to invest more time creating value rather than integrating and managing their data estate. It integrates best-in-class solutions across Microsoft’s technology stack—breaking down data siloes and enabling organizations to extract r...
Azure Synapse Analytics July Update 2022 Welcome to the July 2022 update for Azure Synapse Analytics! This month, you will find information about Apache Spark 3.2 general availability, a new Cast transformation added to Synapse data flows, performance/cost improvements to Synapse Link for SQL, and ...
Incrementally copy multiple tables using ForEach in Azure Data Factory
Phew! This one is going to be fun as the title should be "How to create a pipeline to incrementally copy over all datasets and subsequent tables from Google BigQuery to Azure Data Lake by using nested ForEach, If Condition activities and watermarks in Azure Data Factory" - but that title seemed a we
Azure Data Explorer (ADX) free cluster with Upgrade option
Azure Data Explorer free cluster Start your Azure Data Explorer free cluster today. No credit card, payment information, or Azure subscription is required to create a free cluster! All that you need is a Microsoft account or an Azure Active Directory user identity. The free cluster offers you a 10...
Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We've recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN(). collectUniq...
Ways you can browse industry templates and add tables to create your own lake database
With Azure Synapse Database Templates generally available, our customers are constantly wanting to see and learn more about how to use these templates. Through these blogs we want to share tips and tricks our customers can use to help them utilize these templates in an efficient way. We’ve recently ...