irthomasthomas/llm-model-gateway: OpenAI-compatible API server for simonw's llm cli
OpenAI-compatible API server for simonw's llm cli. Contribute to irthomasthomas/llm-model-gateway development by creating an account on GitHub.
AI/ML
How streaming LLM APIs work | Simon Willison’s TILs
I decided to have a poke around and see if I could figure out how the HTTP streaming APIs from the various hosted LLM providers actually worked. Here are my notes so far.