SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro. Post navigation An update on our mental health-related work Advancing independent research on AI alignment
