Infrastructure

Infrastructure

Using the OpenAI platform to analyse automated test failures
Using the OpenAI platform to analyse automated test failures
A look at how to develop a Nightwatch.js plugin which sends the test failure and associated errors to a service which integrates with the OpenAI platform to analyse the errors and get some actionable feedback
·labs.pineview.io·
Using the OpenAI platform to analyse automated test failures
Create your first containerized Azure Functions
Create your first containerized Azure Functions
Get started by deploying your first function app from a Linux image in a container registry to Azure Functions.
·learn.microsoft.com·
Create your first containerized Azure Functions
Debugging network stalls on Kubernetes
Debugging network stalls on Kubernetes
In this deep-dive, we identified and worked through sporadic latency issues with services running on Kubernetes in our environment.
·github.blog·
Debugging network stalls on Kubernetes
Online migrations at scale
Online migrations at scale
Online payment processing for internet businesses. Stripe is a suite of payment APIs that powers commerce for businesses of all sizes.
·stripe.com·
Online migrations at scale
Sharding & IDs at Instagram
Sharding & IDs at Instagram
With more than 25 photos and 90 likes every second, we store a lot of data here at Instagram. To make sure all of our important data fits…
·instagram-engineering.com·
Sharding & IDs at Instagram
Sharding Pinterest: How we scaled our MySQL fleet
Sharding Pinterest: How we scaled our MySQL fleet
This is a technical dive into how we split our data across many MySQL servers. We finished launching this sharding approach in early 2012, and it’s still the system we use today to store our core…
·medium.com·
Sharding Pinterest: How we scaled our MySQL fleet
Scaling Kubernetes to 7,500 nodes
Scaling Kubernetes to 7,500 nodes
We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models.
·openai.com·
Scaling Kubernetes to 7,500 nodes
Rebuilding our tech stack for the new Facebook.com
Rebuilding our tech stack for the new Facebook.com
Facebook.com launched in 2004 as a simple, server-rendered PHP website. Over time, we’ve added layer upon layer of new technology to deliver more interactive features. Each of these new features an…
·engineering.fb.com·
Rebuilding our tech stack for the new Facebook.com
Converting stateful application to stateless using AWS services | Amazon Web Services
Converting stateful application to stateless using AWS services | Amazon Web Services
Designing a system to be either stateful or stateless is an important choice with tradeoffs regarding its performance and scalability. In a stateful system, data from one session is carried over to the next. A stateless system doesn’t preserve data between sessions and depends on external entities such as databases or cache to manage state. […]
·aws.amazon.com·
Converting stateful application to stateless using AWS services | Amazon Web Services
What happens when databases crash?
What happens when databases crash?
Databases have tables and indexes stored in files. As you create rows, the database system writes to data pages in memory which is then written to data files on disk. There is a problem though, what…
·medium.com·
What happens when databases crash?
The Roots of Today's Modern Backend Engineering Practices
The Roots of Today's Modern Backend Engineering Practices
What accidentally taking down Amazon.com in 1997 taught Joshua Burgin; tech industry veteran and one of Amazon’s first 100 employees
·blog.pragmaticengineer.com·
The Roots of Today's Modern Backend Engineering Practices