Judgment in the Age of AI · Article 47
A score of 82 appears more scientific than “reasonably suitable”, but decimals and ranking can package uncertain judgement as exact measurement. The choice of indicators, weighting and treatment of missing information all disappear behind one number.
Ask whether the number survives three questions
- Calibration: How often do cases scored 82 actually succeed?
- Sensitivity: Does one reasonable change of assumption move 82 to 65?
- Resolution: Is the difference between 82 and 80 larger than measurement error?
Return false precision to decision bands
| Band | Action |
|---|---|
| Strong evidence and clear separation | Act under the stated rule |
| Close result or assumption-sensitive | Gather information and compare manually |
| Insufficient data or high consequence | Do not score; move to specialist review |
Do not let AI choose your values by choosing the weights. Write down the criteria that matter, minimum thresholds and non-tradeable conditions before inspecting its evidence. A good decision matrix displays trade-offs; a bad total disguises value choices as mathematical facts.
References
Discover more from Geoffrey Chen
Subscribe to get the latest posts sent to your email.