power query

This post addresses common scenarios I have encountered where clients require data to be masked in certain ways in reporting. Most often this is to prevent exposing a competitors’ data when s…

Power BI sometimes tries to refresh a dataset again if the first attempt fails

Inspired by Darrens Gosbell’s excellent blog post – Automatically generating measure descriptions for Power BI and Analysis Services with ChatGPT and Tabular Editor – Random Procrastina…

This blog post explains how to only load data if there are actual rows in the table. This allows you to save on potential query costs when using Power Query in #PowerBI

Data preparation is crucial in data analysis and machine learning projects. This article will explore basic concepts and extensive details on the various aspects of data preparation.

An introduction to M data structures and how understanding these structures helps to apply more complex transformations to your data.

An alternative way to import SharePoint list data into Power BI.

Power Query everything! Learn how to leverage List.Zip function to solve one of the most common data transformation challenges!

In a recent post where I described how to implement multiple linear regression in Power BI, I had to perform one hot encoding to make my categorical variable usable by the model. So I decided to make another short post to explain what is hot encoding and how to implement it in Power BI using Power Query. Why do need to perform Hot Encoding? In machine learning or statistical algorithms, many models require to have only numerical input variables. So...p class="read-more"a class="btn btn-default" href="https://datakuity.com/2023/03/15/one-hot-encoding-in-power-bi/" Read Morespan class="screen-reader-text" Read More/span/a/p

Get the best performance for text searches in Power BI reports

In this blog post I will share with you how to effectively leverage the performance boosting functionalities available in dataflows when preparing large volumes of data. I have found there are two key components that are critical for developing efficient dataflows: Enhanced Compute Engine – loads data into a temporary SQL cache and enables Power Query to leverage query folding. Incremental refresh – partitions your data into smaller chunks to refresh only what you need. Focusing on these two com

This content applies to: Power Query online Power Query DesktopThis article was authored by Ben Gribaudo, a community author. Please reach out to your Microsoft contact if you are interested in …

Lazy evaluation, streaming and immutability are key Power Query concepts which must be understood to truly grasp how Power Query “thinks.” Want to test your understanding in these foundational areas—and try to grow it—by tackling an assignment?!Your TaskCode up a single row table containing the follo

Discover the power of Power Query and transform your data with ease. Learn tips and tricks in this free beginner's guide.

There’s only one rule. Don’t break the fold! Before we start enforcing all these rules, we should start with something like a solid foundation of what does and doesn’t fold in Power Query and their SQL equivalents. Now, if you found this page and we’re like “what in the world is query folding?” read this […]

Using Merge statements? Alex shows you how that can break the fold in Power Query! He’s got you covered though and shows you a different way to approach it to make folding work! Using the UI! Alex Powers: https://twitter.com/notaboutthecell https://www.linkedin.com/in/alexmpowers/ https://itsnotaboutthecell.com/

Remove accents and other diacritics from text in Power Query by converting the text to a binary using the Greek code page and converting back

Prevent the "The resultset of a query to external data source has exceeded the maximum allowed size" error in Power BI by building aggregations

The environment concept (in our opinion) is one of the most important concepts in M, while it is one of the least obvious ones. This series of posts is written in collaboration with Imke Feldmann from thebiccountant.com Part 1 – Introduction Part 2 – Environments in single nested records and let-expressions Part 3 – Global and local environments and […]

Referencing a different query in Power Query will usually return the final step. But what if you want to fetch another step within that query?

Allow end users to pass any value they want to a dynamic M parameter in a Power BI DirectQuery dataset

There’s only one rule. Don’t break the fold! Before we start enforcing all these rules, we should start with something like a solid foundation of what does and doesn’t fold in Power Query and their SQL equivalents. Now, if you found this page and we’re like “what in the world is query folding?” read this […]

This shows how to put your entire query into Power Query Advanced Editor allowing you to see the entire query.

I had to do this for a client the other day, and I realized I hadn’t blogged about it. Let’s say you need to include data in a Power BI model, but the only source of the data is a matri…

There is an abundance of APIs around us, and we use them in our daily routine without thinking about them anymore.

How to use the Query option of the OData.Feed function in Power Query and Power BI

We’ve just released support for implementing native query support in your own Power Query custom connectors through the use of the Power Query SDK. This new support allows Power Query connector developers to implement support in their connectors to enter a native query that can run against their data sources through the use of the […]

Learn to solve the dynamic data sources error with OData.Feed in Power BI by relying on query folding