Ollama
Runs language models on your machine with one command.
CLIOpen source
Tool that downloads and runs open language models locally, with a compatible API and a simple CLI.
When to use
To use open LLMs locally, with privacy, offline and at no per-use cost.
When to avoid
If your hardware is weak or you need the quality of the largest frontier models.
Alternatives
They do a similar job. Compare before choosing.
Graphical app to download and chat with local models.
AppFreeLLM inference in C/C++, efficient even on ordinary CPUs.
LibraryOpen source★ 132.9K
Related
From the same area, with a close purpose.
Framework to chain LLMs, tools and data.
FrameworkOpen source★ 148.7KTypeScript toolkit for AI apps, with streaming and multiple providers.
LibraryOpen source★ 27.6KAI model and dataset hub, and the Transformers library.
ServiceFreemium★ 168.4KOpen source coding agent inside VS Code.
AppOpen source★ 71.1K