Judgment in the Age of AI · Article 42
Without records, only the outcome remains after an event. Nobody can tell whether an error came from data, model, prompt, tool or human judgement. Important AI use should produce a readable decision receipt, much like a transaction.
Eight fields on the receipt
- Task: What the system was asked to do;
- Time: When it ran and which cut-off date applied;
- Input: Data used and its version;
- System: Model, tools and important setting versions;
- Output: Original recommendation and stated uncertainty;
- Grounding: Sources, rules and external checks;
- Human action: Who accepted, changed or rejected what;
- Outcome: Final decision, notified parties and next review date.
Records need boundaries too
An audit log should not become a new privacy warehouse. Retain only what accountability requires, protect access, set a retention period, and avoid copying passwords, complete sensitive documents or irrelevant personal information into the log.
Good records do not pretend that a system never fails. They let a team explain a decision, locate the problem, remedy affected people and improve the next case.
References
Discover more from Geoffrey Chen
Subscribe to get the latest posts sent to your email.