T15-L03 · AI in research · Level 3 Builder · 17-minute read, plus 4 hours of doing, and the wait for review

The approval is older than the tool

A clinical study at a Heidelberg hospital asks 240 patients how their recovery went after knee surgery. One question is free text. A doctoral student has a prototype that sorts the answers into themes with an AI model, and it works well on made-up comments. Her supervisor says: "Try it on ten real ones, just to see." The ethics approval is two years old. It describes statistical analysis inside the hospital. It doesn't mention an AI model, let alone a cloud service in another country. The comments carry a study code, and the study nurse has the list that connects each code to a name.

In a company it's a medical-device maker running a usability study. Twenty clinicians and patients are interviewed about a new insulin pen, and the transcripts are full of diagnoses, doses and hospital names. A usability engineer wants the company's approved assistant to sort the transcripts into use-error categories. The consent form says the recordings will be "analysed by the study team".

In both cases ten rows would be a transfer, and the approval doesn't cover it. You are at Level 3 Builder: colleagues will depend on this step, and it touches people who never agreed to what you're about to do. This book shows you how to get the right people to decide, and how to build the step so that it stays inside what they decided.

After this you can

  • Map one AI step's data from source to deletion, including the copies nobody sees, and mark every fact you can't yet show.
  • Write a one-page review request that compares what was approved with what you now propose, and names who decides.
  • Build the step so it can only do what the approval allows: minimised input, a model that stays on your organisation's hardware, and results a person accepts.
  • Test the step on items two researchers coded by hand, against an agreement threshold you set before the test.
  • Hand the step to a colleague who reruns it from the README alone and knows when to stop.

Before you start