Ultra-long-horizon coding

FrontierSWE V2

Engineering problems that would occupy a person for days: systems implementation, performance work, scientific computing and AI research, with up to twenty hours per task. Partial credit is awarded, because finishing one outright is still rare. Higher is better.

Rankings

Higher is better

FrontierSWE V2 — frequently asked questions

Engineering problems that would occupy a person for days: systems implementation, performance work, scientific computing and AI research, with up to twenty hours per task. Partial credit is awarded, because finishing one outright is still rare. Higher is better.