Skip to content

Operational procedures for using the Mechanistic Validity framework.

GuideWhat it does
A — Audit a claimThe 5-pass procedure for evaluating any MI claim
B — Write a verdictThe full verdict-statement template with worked examples
C — Pick a mode tagDecision tree for choosing the correct description-level tag
D — Choose an instrumentCriterion → instrument lookup table
E — Report a baselineBaseline reporting rules (random-vector, untrained-model, published SOTA)
F — Run a convergence checkMulti-instrument agreement protocol
G — Handle disagreementWhat to do when instruments diverge
  1. C — decide what level of claim you are making.
  2. D — identify which instruments you need.
  3. E — compute and report the required baselines.
  4. F — check whether your instruments agree.
  5. If instruments disagree → G before writing the verdict.
  6. B — write the verdict statement.
  7. A — audit your own claim before publishing.