Infrastructure
Serving, hosting and plumbing for AI workloads.
llama.cpp
Open Source“The engine underneath much of local AI, LM Studio included. It's more hands-on than Ollama or LM Studio, and in return gives you the most direct control over hardware, quantization and performance.”
Local LLMOpen SourceC++ ★ 133k
LM Studio
Free“The friendliest way to run local models if you'd rather click than type. Search Hugging Face, chat, then turn on a local server for your apps. Free for home and work, though the app itself isn't open source.”
Local LLMDesktop AppMLX
Ollama
Free / cloud from $20/mo“The easiest way to put an open model behind an API on your own machine. Install it, run one command, and your apps and coding agents can talk to it. Local use is free; you only pay if you want Ollama's cloud models.”
Local LLMOpen SourceCLI ★ 185.5k