The better prompt that changed nothing

Amir, a PhD student, is filling in a table for his group: how long each of twelve published studies washed its samples before measurement. The PI, the principal investigator who leads the group, will use the table to set the group's own protocol. He attaches the twelve abstracts and asks. The assistant gives three durations and says nine are "not reported". He rewrites the prompt to be more precise, adds "think carefully", and runs it again. Same result. The durations aren't in the abstracts. They're in the methods sections, which he never attached.

In a company it's a customer service colleague asked whether order NS-204 can still be cancelled. She attaches the whole email thread with the customer and the supplier agreement. The answer quotes a 14-day notice period. That came from version 2 of the agreement, which sat in the same folder as version 3 and was attached by mistake. Version 3 says 30 days.

In both cases the prompt was fine. The sources were wrong: one was missing, the other was stale. You are at Level 2 Power user: your team sees the result. When the wrong sources go in, the PI sets a protocol on a guess, or a customer gets a rule that no longer applies. And when a colleague reruns your question next month with their own attachments, they get a different answer. This book shows you how to pick the sources, lay them out, and pass them on so the answer can be repeated.

After this you can

  • Tell a missing-source failure from a wording failure by keeping the prompt fixed and changing only the sources.
  • Decide for each candidate document whether to include it, leave it out or summarise it.
  • Keep numbers, conditions and exceptions as short exact quotes with their source and version.
  • Lay out a request so instructions, question and sources stay apart, and text inside a source can't redirect the task.
  • Hand a colleague a context packet they can rerun without your chat history and get the same answer.

Before you start