app · Mintplex Labs

AnythingLLM

AnythingLLM (by Mintplex Labs) is an all-in-one, private AI workspace: drop in PDFs, documents, or a whole folder and chat with them — with citations — in a familiar ChatGPT-style UI. It is provider-agnostic, so you can run a fully local model (built-in, or via Ollama / LM Studio) or bring your own cloud key (OpenAI, Anthropic, Gemini). When you point it at a local model, nothing leaves your machine. It ships as a one-click desktop app for Mac/Windows/Linux and as a Docker server you can self-host as a shared, always-on team endpoint that exposes an OpenAI-compatible API. Its angle, versus Ollama / LM Studio / Jan, is document-RAG and AI agents bundled in — those tools run models; AnythingLLM turns a model into a private assistant over your own knowledge. Open source under MIT.

  • free
  • cloud
  • self-host
  • Open source
  • Docker

Docker image mintplexlabs/anythingllm:latest · Original container source

What it can help with

  • private rag
  • document chat
  • pdf indexing
  • self-hosted api
  • docker deployment
  • local model
  • citation support
  • team endpoint