Inspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no easy task. The process involves not just the transfer of data but ensuring its integrity, error r...
The Billion Row Challenge (1BRC) - Step-by-step from 71s to 1.7s
I took part in the Billion Row Challenge. Enjoy a deep, step-by-step summary of how you get from a Parallel Java Streams implementation that takes 71 seconds to a super-optimized version that takes 1.7 seconds. Example code and walkthroughs included!
What is Kubernetes? An Unorthodox Guide for Developers
You can use this guide to get up to speed with Kubernetes as a developer. From its very basics to more intermediate topics like Helm charts and how all of this affects you as a dev.
Meta reveals their serverless platform processing trillions of function calls a day
XFaaS is Meta's private platform for "Hyperscale and Low Cost Serverless Functions." It is more efficient than AWS Lambda, Azure Functions, and Google Cloud Functions.
How to design resilient and large scale data systems
Whenever you’re building a data system, there’s a million things to consider. Gone are the days of just shoving everything into MongoDB and calling it “web scale.” In this newsletter, we’ll be going over the considerations you should be thinking about when building out large scale data systems.