Infrastructure

This page describes the lifecycle of a Pod. Pods follow a defined lifecycle, starting in the Pending phase, moving through Running if at least one of its primary containers starts OK, and then through either the Succeeded or Failed phases depending on whether any container in the Pod terminated in failure. Like individual application containers, Pods are considered to be relatively ephemeral (rather than durable) entities. Pods are created, assigned a unique ID (UID), and scheduled to run on nodes where they remain until termination (according to restart policy) or deletion.

SkyPilot uses the venerable SQLite for state management. SQLite can handle millions of QPS, and terabytes of data. However, our efforts to scale our Managed Jobs feature ran up against the one downfall of SQLite: many concurrent writers. Since SkyPilot typically runs as a CLI on your laptop, we wanted to stick with SQLite, so we decided to figure out how we can make it work. We were very surprised with some of our findings.

Install MongoDB Community Edition on macOS using the Homebrew package manager.

By Daniel Heinen

In this section, I talk about why VPCs were invented and how they work.

In the world of cloud computing, particularly with serverless architectures like AWS Lambda and distributed databases like DynamoDB, the…

A device or service that distributes traffic across multiple servers or microservices.

While we have managed to make our deployments successful most of the time, there is still that little percentage where human nature kicks in. Learn about the most common mistakes we encountered.

Andy rises from the ashes of his dead startup and disusses what happened in 2024 in the database game.

Oliver Koo | Staff Software Engineer

Learn about the benefits of policy and code, the challenges presented by OPA's Rego and Policy-as-Graph, and possible solutions.

After setting up a functional Kubernetes cluster in Blog 1, the cluster is just at the starting point. While it could handle basic tasks…

I recently upgraded my old laptop from 16GB to a whopping 64GB of RAM. With this much power, it no longer struggles under the weight of a…

9 Principles for Doing Node.js Right in Enterprise Environments

Here's a short and sweet story about a Friday deploy. I love Friday deploys.

This talk illustrates the hype behind WebAssembly and why it may be the future of the Cloud. Talk includes: * What Wasm is, how it works and why its suited for Serverless - How one can get started with Wasm using open source frameworks * Live Demo

In the last few years, we’ve witnessed the introduction of several new lightweight Kubernetes...

AT Protocol is the tech developed at Bluesky for open social networking. In this article we're going to explore AT Proto from the perspective of distributed backend engineering.

Comparing the outbox pattern to alternatives like “listen-to-yourself” and 2-phase commit (2PC) transactions. What’s the best choice for data exchange flows between microservices?

Post-acquisition, we migrated Baselime from AWS to the Cloudflare Developer Platform and in the process, we improved query times, simplified data ingestion, and now handle far more events, all while cutting costs. Here’s how we built a modern, high-performing observability platform on Cloudflare’s network.

Reduce image size, build time, and more with these techniques.

Infrastructure costs can unexpectedly increase and harm your project success. Here are several common issues that repeatedly cause budget problems in software projects.

PostNL shared insights and guidance from its transition from outsourced IT project delivery to an in-house product delivery capability. By embracing cloud-native technologies, with an emphasis on serverless services, the company achieved significant gains in productivity and market responsiveness while reducing operational costs.

With Email Routing, you can effectively start receiving Emails in any of your domains for any number of custom addresses you want and forward the messages to any existing destination mailboxes

Learn how we approached migrating our Wafris v1 client based on Redis to a new faster, easier to use SQLite architecture.

Read how we’re scaling PostgreSQL at the petabyte scale to power our query monitoring feature, Insights.

Everything you need to quickly get prepared for FAANG system design interviews. Written by former Meta and Amazon interviewers, this guide breaks down the core concepts, patterns, frameworks, and technologies needed to ace your system design interviews. It also breaks down some of the most commonly asked system design questions and provides detailed answers.

Distributed Tracing is scary and complicated... right?