Run your organisation's AI tools as one set: a register with admins, contracts, data terms and renewal dates, a quarterly review of use, cost and terms from the admin consoles, a routine for price, terms and model changes, deliberate consolidation and retirement, and a handover so the set survives you.
Matching textT16-L05 · Choose tools · Level 5 Operator · 18-minute read, plus 5 hours of doing over a quarter Keep Your Toolset Useful Nobody has the list Katrin runs research IT for an institute
Move a team from one AI tool to another without losing work, access rules or a way back: list everything the old tool holds, decide what moves, what is rebuilt, archived or dropped, re-test the real jobs in the new tool, revoke every old key, and switch in stages with a rollback you have tried.
Matching textT16-L04 · Choose tools · Level 4 Integrator · 19-minute read, plus 5 hours of doing over three weeks Replace a Tool Without Losing Your Work The switch that looked like a download The
Preview: Test a Tool on Your Own Work Before Your Team Depends on It
Level L03
T16
17 min read
Before colleagues rely on an AI tool's output, test it on 15 to 20 past cases whose right answers you already know. Write the scoring rule first, count first-pass results, repairs and critical failures, and leave a decision with a routing rule, a fallback and a case pack a colleague can rerun.
Matching textT16-L03 · Choose tools · Level 3 Builder · 16-minute read, plus 3 hours of doing Test a Tool on Your Own Work Before Your Team Depends on It The demo that read every
Preview: Test Driven PROMPT Engineering: Using Promptfoo to COMPARE Prompts, LLMs, and Providers.
youtube
17 min video
Express desired model behaviour as explicit test cases and output assertions. Offline evaluation is not a per-item runtime guard; recording-era cost/latency ratios are not general claims.
Matching text… item. Its cost and speed comparisons are historical examples.
T16-L03: See repeatable cases and explicit assertions turn model comparisons into checks you can rerun. This optional technical…
Preview: How to Build AI Governance in 5 Practical Steps Real Usecase
youtube
Start governance with an inventory and connect it to risk and monitoring. General governance, not current EU legal advice or deputy-drill proof.
Matching text… is not current legal advice or proof of deputy readiness.
T16-L05: Connect your tool register to vendor-risk review and continuing monitoring, so it stays useful after initial approval. This…
Preview: Experimental Design: Variables, Groups, and Controls
youtube
Understand variables and controls behind fair baseline comparisons. Transferable biology experiment-design lesson, not AI selection; apply to identical inputs and total checking/repair time.
Matching textT16-L01: Learn experimental groups, controls and variables. Apply that foundation to a challenger versus your current method with identical inputs and criteria. This 2016 biology lesson is not…