Genie Framework improves Spark Pool utilization by executing multiple Synapse notebooks on the same spark pool instance. Uses vaccum and optimize to maintain efficient delta tables.

Using optimize and vaccum to removed unused delta patition files. Helps maintain a minimized delta table size footprint.

Proper use of table distributions in Synapse Dedicated SQL Pools is easily the #1 shortcoming in Synapse implementations.I regularly see large queries that t...

CSV? Parquet? Delta? Which file format should you use to get the best out of Synapse Serverless SQL pool? Let's demistify pros and cons of each file type!