LLMs as Parts of Systems - Marc's Blog

System Architecture
Living with LLMs (2023 - 2025)
More than two years into the AI hype, here’s a grounded overview of this period from the perspective of a regular software developer.
SHRDLU - Wikipedia
On the Value of Abstractions
A reflection on why starting with abstractions—even simple ones—pays off in real-world development.
Universal Tool Calling Protocol (UTCP): A Revolutionary Alternative to MCP
A Comprehensive Guide to the Safer, Scalable Alternative to Model Context Protocol
Designing AI Applications: Principles from Distributed Systems Applicable in a New AI World
Learn how to make unreliable AI APIs reliable using proven distributed systems patterns. Real example: reduced LLM costs from $20 to $0 with transactional outbox.
Building a Carbon and Price-Aware Kubernetes Scheduler
Kubernetes and cloud infrastructure have revolutionized how we deploy and manage applications and services, but with traditional data…
Instruction set architecture - Wikipedia
Man-Computer Symbiosis
Fiat–Shamir heuristic - Wikipedia
What is zk-SNARKs? An Introduction to this Privacy Protocol
Guide to zk-Snarks & how this technology works within privacy cryptocurrencies such as ZCash, Bitcoin Private & inclusion in Ethereum.
What Are Bullet Proofs? Guide to Confidential Cryptocurrency Transactions
Bulletproofs are an important innovation of zero-knowledge proofs & other protocols used to secure and obfuscate cryptocurrency transactions
Intel® Gaudi® 3 AI Accelerator HL-338 PCIe Add-In Card Product Brief
The Intel® Gaudi® 3 Al accelerator PCIe card (HL-338) is designed to deliver performance and efficiency in a standard PCIe card form factor. The training and inference accelerator is built on the Intel® Gaudi® 5th generation high-efficiency heterogeneous architecture, now in 5nm process technology with state-of-the-art performance, scalability and power efficiency.
Intergalactic Computer Network - Wikipedia
Man–Computer Symbiosis - Wikipedia
Why Generics Belong in Infrastructure, Not in Architecture
Generics are a low-level tool. They are powerful, but dangerous when they escape into the higher layers
Licklider Transmission Protocol - Wikipedia
How We Built Exactly-Once Delivery Without Checkpoints or Latency Penalties
Implementing “Exactly once” data delivery in distributed / streaming systems is no easy endeavor.
In this blog post, we’ll walk through a couple of strategies we implemented in Epsio for end-to-end “exactly-once” data delivery that are a-bit differe...
Why Names Break Systems
Web systems are designed to be simple and reliable. Designing for the everyday person is the goal, but if you don’t consider the odd man out, they may encounter some problems. This is the everyday …
Idempotency in 1 diagram and 144 words
Explained as simply as possible… but not simpler.
No Customer Left Behind: A Self-balancing Task Scheduler | Engineering @ Lucio
How redefining fairness made our platform more responsive
Taming Eventual Consistency—Applying Principles of Structured Concurrency to Distributed Systems
An introduction to structured concurrency, a new way to design distributed systems, and Scoop, a POC orchestration library.
My DataBase Server And My ORM — This Is Beautiful
Getting excited about the upcoming deployment, and showing off my backend solution.
Why You Shouldn’t Treat Your Database as an Integration Platform
In this post I’m going to try to outline a workflow, it’s a platform that me and my team have been working on, which serves as an…
Rosie Pattern Language / Rosie · GitLab
Rosie Pattern Language (RPL) and the Rosie Pattern Engine, including librosie, CLI, REPL, and standard pattern library.
Parsing expression grammar - Wikipedia
Bonfire
A federated social network for individuals and communities to design, operate and control their own digital lives.
Bookmarkable by Design: URL-Driven State in HTMX | Loren Stewart
Build stateful HTMX applications using URL parameters as your state store, creating naturally bookmarkable and shareable interfaces
Information on RFC 9810 » RFC Editor
From XML to JSON to CBOR - The CBOR, dCBOR, and Gordian Envelope Book