Ultra-long-horizon coding
FrontierSWE V2
Engineering problems that would occupy a person for days: systems implementation, performance work, scientific computing and AI research, with up to twenty hours per task. Partial credit is awarded, because finishing one outright is still rare. Higher is better.
Rankings
Higher is betterFrontierSWE V2 — frequently asked questions
Engineering problems that would occupy a person for days: systems implementation, performance work, scientific computing and AI research, with up to twenty hours per task. Partial credit is awarded, because finishing one outright is still rare. Higher is better.