This post addresses common scenarios I have encountered where clients require data to be masked in certain ways in reporting. Most often this is to prevent exposing a competitors’ data when s…

Inspired by Darrens Gosbell’s excellent blog post – Automatically generating measure descriptions for Power BI and Analysis Services with ChatGPT and Tabular Editor – Random Procrastina…

This blog post explains how to only load data if there are actual rows in the table. This allows you to save on potential query costs when using Power Query in #PowerBI

Data preparation is crucial in data analysis and machine learning projects. This article will explore basic concepts and extensive details on the various aspects of data preparation.

Power Query everything! Learn how to leverage List.Zip function to solve one of the most common data transformation challenges!

In a recent post where I described how to implement multiple linear regression in Power BI, I had to perform one hot encoding to make my categorical variable usable by the model. So I decided to make another short post to explain what is hot encoding and how to implement it in Power BI using Power Query. Why do need to perform Hot Encoding? In machine learning or statistical algorithms, many models require to have only numerical input variables. So...p class="read-more"a class="btn btn-default" href="https://datakuity.com/2023/03/15/one-hot-encoding-in-power-bi/" Read Morespan class="screen-reader-text" Read More/span/a/p

An introduction to M data structures and how understanding these structures helps to apply more complex transformations to your data.

Get the best performance for text searches in Power BI reports

This content applies to: Power Query online Power Query DesktopThis article was authored by Ben Gribaudo, a community author. Please reach out to your Microsoft contact if you are interested in …

Lazy evaluation, streaming and immutability are key Power Query concepts which must be understood to truly grasp how Power Query “thinks.” Want to test your understanding in these foundational areas—and try to grow it—by tackling an assignment?!Your TaskCode up a single row table containing the follo

Remove accents and other diacritics from text in Power Query by converting the text to a binary using the Greek code page and converting back

There’s only one rule. Don’t break the fold! Before we start enforcing all these rules, we should start with something like a solid foundation of what does and doesn’t fold in Power Query and their SQL equivalents. Now, if you found this page and we’re like “what in the world is query folding?” read this […]

Discover the power of Power Query and transform your data with ease. Learn tips and tricks in this free beginner's guide.

In this blog post I will share with you how to effectively leverage the performance boosting functionalities available in dataflows when preparing large volumes of data. I have found there are two key components that are critical for developing efficient dataflows: Enhanced Compute Engine – loads data into a temporary SQL cache and enables Power Query to leverage query folding. Incremental refresh – partitions your data into smaller chunks to refresh only what you need. Focusing on these two com

Allow end users to pass any value they want to a dynamic M parameter in a Power BI DirectQuery dataset

I had to do this for a client the other day, and I realized I hadn’t blogged about it. Let’s say you need to include data in a Power BI model, but the only source of the data is a matri…

Something cool has just been announced for Azure SQL DB: the ability to call a limited number of REST APIs direct from TSQL. The announcement is here: There are code samples here: And guess what, t…

Power BI can handle large data volumes, but just how much data can you load into Power BI? Can Power BI handle big data? How big is “big” anyway? These are questions you may have when y…

One of the most popular topics I’ve ever written about here is the dataset refresh errors you get with dynamic data sources and the Web.Contents function in Power BI (see here and here for ex…

Configure the API authentication to retrieve the token and return required data in Power Query

This content applies to: Power Query online Power Query desktop You may have noticed a new M function was added to Power Query recently: Web.Headers. This function allows you to make HEAD requests to web services – the existing Web.Contents function, which it resembles closely, only allows you to make GET and POST requests. You […]

Guidance on how to create Power BI data models for Dataverse, PowerApps, and Dynamics 365.

Did you know there are a lot of keyboard shortcuts for the advanced editor in Power Query that can save you time?

The October release of PowerBI Desktop introduced a very interesting feature, Top N filtered is pushed down for Direct Query Sources, I thought I may give it a try and blog about it, for some reaso…