Benchmark scores went from 1.96% to over 70% while their meaning eroded. What SWE-bench measures, what it misses, and what I saw migrating this blog with Claude Code.
Benchmark scores went from 1.96% to over 70% while their meaning eroded. What SWE-bench measures, what it misses, and what I saw migrating this blog with Claude Code.