llama.cpp
View profileDevelopment & infrastructureSelf-hosted
FreeOpen sourceWhat you can do
- Run GGUF models through a configurable local inference engine.
Before choosing
- It has no built-in account or UI; compiling and tuning require hands-on setup.
