Troyanovsky/Local-LLM-comparison: Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.
This tool for running LLMs on your own laptop directly includes an installer for macOS (Apple Silicon) and provides a terminal chat interface for interacting with models. They already have …
Weeknotes: Self-hosted language models with LLM plugins, a new Datasette tutorial, a dozen package releases, a dozen TILs
A lot of stuff to cover from the past two and a half weeks. LLM and self-hosted language model plugins My biggest project was the new version of my LLM …