Everyone wants the chat, nobody asked who can reach it

In a lab it starts with a good idea. Lena, a postdoc in an eight-person structural biology group, wants an assistant for drafting methods, cleaning up Python scripts and summarising papers, including unpublished work. The institute offers no assistant of its own, and its rules keep unpublished results out of cloud chatbots. The group has a workstation with a large graphics card under a desk. On Tuesday she has a chat interface with a local model running on it. On Wednesday a colleague asks if he can use it from his office. On Thursday someone suggests "just opening the port".

In a company it looks different and ends the same way. Jonas is the quality manager at a twenty-person medical device supplier. Six people in quality draft SOP changes and answer customer questionnaires. He wants one assistant for them, with one set of rules, instead of six private chatbot accounts. There is no graphics card in the building, so the model will come from a provider through an API key. His managing director asks one question: "Who else can see what we type into it?"

Both of them are about to run a service for other people. This book shows you how to start it on one machine, where every prompt goes, and what has to be true before a colleague logs in.

You are at Level 4 Integrator: the group's real systems and data are in the loop. A mistake here doesn't spoil one chat. It exposes every chat of every colleague, runs up a bill on the company's key, or opens the machine it runs on to people it was never meant for.

After this you can

  • Run Open WebUI through Heidelberg AI Desk and connect it to a model: a local one in Ollama or LM Studio, or a provider through an API key.
  • Say where every prompt goes for the model you connected, and what Open WebUI keeps on your machine.
  • Decide who may reach the assistant, how people get an account, and which data classes it may see.
  • Set up accounts so new people wait for your approval and only named people can administer it.
  • Name what has to change before a team uses it from other computers, and which books cover the server part.

Before you start