A non-beginner Data Engineering Roadmap — 2025 Edition
Master advanced Data Engineering with this 2025 roadmap! Explore tools, skills, and resources to excel in Python, SQL, CI/CD, AI, cloud, and more
On Spark, Hive, and Small Files: An In-Depth Look at Spark Partitioning Strategies
One of the most common ways to store results from a Spark job is by writing the results to a Hive table stored on HDFS. While in theory…