Data modeling tool for NoSQL, storage formats, REST APIs, and JSON in RDBMS
Data Engineering
Using Amazon SageMaker Lakehouse with DuckDB
and Glue Data Catalog
Incremental Processing using Netflix Maestro and Apache Iceberg
Exploring Spark Catalog — Mastering Pyspark
Data cataloguing in Spark | by Petrica Leuca | Medium
Streaming from Apache Iceberg - QCon NY 2023
Streaming from Apache Iceberg
Building Low-Latency and Cost Effective Data Pipelines
Steven Wu @ Apple
red-data-tools/YouPlot: A command line tool that draw plots on the terminal.
Data processing with Spark: data catalog – own your data
Delivering High Quality Analytics at Netflix
Same Data, Sturdier Frame: Layering in Dimensional Data Modeling at Whatnot
Unit Testing for Data Engineers.
r/dataengineering - What did ETL look like before the "modern data stack" was a thing?
Resolving Late Arriving Dimensions
r/dataengineering - Which lakehouse table format do you expect your organization will be using by the end of 2023?
🫡🐳 pedramdb🫡🐳 on Twitter
Data Systems Tend Towards Production
.jpg?width=92&height=&ar=&mode=&format=avif&dpr=2)
Airbyte Monitoring with dbt and Metabase - Part I | Airbyte
Building a Data Engineering Project in 20 Minutes
r/dataengineering - Has anyone built a data warehouse primarily using Databricks?
The Contract-Powered Data Platform | Buz
The Breakdown: Databricks, Snowflake, and Open Source Positioning in the Data World
Yet another post on Data Contracts - Part 1
The missing piece of the modern data stack
Kicking the tires on dbt Metrics
The modern data experience (w/ Benn Stancil)
Engineers Shouldn’t Write ETL: A Guide to Building a High Functioning Data Science Department | Stitch Fix Technology – Multithreaded
Viewpoint | dbt Docs
Upgrading Data Warehouse Infrastructure at Airbnb
We the purple people
The end of Big Data