System Architecture

Crude data is similar to crude oil—in its raw form, it’s usually too messy to be useful

Posted by Giles Hogben, Privacy Engineering Director Most modern consumer messaging platforms (including Google Messages) support end-to-...

Intel's new chips are engineering marvels, but software developers will need to recompile and rewrite software to exploit their performance benefits.

The Defense Department's Chief Digital and AI Office is working to understand the resources needed for integration of the department-wide framework.

TimescaleDB is a time-series SQL database providing fast analytics, scalability, with automated data management on a proven storage engine.

ARMO introduces Kubescape 3.0 at KubeCon North America 2023.

A pilot study shows how machine learning can be applied at the edge using Docker and a microservices architecture to process video data.

SOCKET.IO 4.0 IS HERE ~/Projects/tweets/index.js const io = require('socket.io')(80); const cfg = require('./config.js

A summary of working with microservices for five years

Find out what high availability infrastructure is, some best practices to properly implement it, and how using EaaS can help ensure high availability.

How the Kubernetes Gateway API sets the stage for multicluster deployments.

The producer-consumer pattern and the fan-out fan-in pattern are both used to manage workloads and process data concurrency, but they have…

Astra Taylor discusses her new book about how modern capitalism undermines social stability.

Update (2021-10-16): While this list was intended as a demonstration of the kinds of things you can do with Embark, there has been some interest by readers in reproducing these demos exactly on their machines. So I have added a “Play by play” section under each demo listing the sequence of actions in the demo. Embark is a fantastic and thoughtfully designed package for Emacs that flips Emacs’ action → object ordering without adding a learning curve.

Think way back to 2016. The X-Files came back after 14 years, a 4-inch lock of John Lennon’s hair sold for $35,000 and there was a baby born with DNA from three parents. Weirdness all around, especially on the Apple campus. They were convinced the iPad was the future of computing, deep into “what’s a computer” thinking yet still produced laptops with 3-year-old chips in them. Whilst everyone pointed towards a touchscreen Mac, they instead gave users a weird strip you could interact with and took away their function keys.

An approach called “decoupling” could provide better privacy and security online

Many application technologies enable secure communication between two entities by means of Transport Layer Security (TLS) with Internet Public Key Infrastructure using X.509 (PKIX) certificates. This document specifies procedures for representing and verifying the identity of application services in such interactions. This document obsoletes RFC 6125.

Service-to-service (S2S) authentication is a critical, yet extremely complex component of network security.

How the tech news aggregator daily.dev created an AI search, including using an LLM Gateway to streamline and optimize interactions with LLMs.

Homepage of the ADR GitHub organization

ADRs document architecturally significant decisions made over time

You really can’t find a better example of APIs.json, then the one for Twilio. Twilio doesn’t have their own official APIs.json (yet), but I created one that I think really shows the strength of the API discovery format. I still have more work to do, but this Twilio APIs.json shows how the format can be used to index an API operation, while revealing individual human and machine readable properties of multiple APIs, as well as a common set of properties across all APIs–this version of my APIs.json for Twilio covers six of their APIs:

I need a master APIs.json for Amazon Web Services. I need an index of all the AWS APIs I depend on, and would like to have an index of the rest when I am ready to put to work. It is a daunting challenge to hand-craft an operational index of AWS, but I gotta start somewhere, so I headed over to the APIs.json Builder and added the name, description, and URL for the AWS developer portal.

Containers and virtual machines on Linux communicate with the world via virtual network devices. This arrangement makes the full power of the Linux networking stack available, but it imposes the full overhead of that stack as well. Often, the routing of this networking traffic can be handled with relatively simple logic; the BPF-programmable network device, which was merged for the 6.7 kernel release, makes it possible to avoid expensive network processing, in at least some cases.

Empowering video editors with multimodal machine learning to discover perfect moments across the entire Netflix catalog

Traces give us the big picture of what happens when a request is made to an application. Whether your application is a monolith with a single database or a sophisticated mesh of services, traces are essential to understanding the full “path” a request takes in your application. Let’s explore this with three units of work, represented as Spans: hello span: { "name": "hello", "context": { "trace_id": "0x5b8aa5a2d2c872e8321cf37308d69df2", "span_id": "0x051581bf3cb55c13" }, "parent_id": null, "start_time": "2022-04-29T18:52:58.