OpenRouter
The unified interface for LLMs. Find the best models & prices for your prompts
LLM serving
Ollama
Get up and running with large language models.
LM Studio - Discover and run local LLMs
Find, download, and experiment with local LLMs
sgl-project/sglang: SGLang is a fast serving framework for large language models and vision language models.
SGLang is a fast serving framework for large language models and vision language models. - sgl-project/sglang
vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs
A high-throughput and memory-efficient inference and serving engine for LLMs - vllm-project/vllm