The reason we've stopped using SWE-bench Verified for evaluation
SWE-bench Verified, once a trusted benchmark for AI coding ability, is losing credibility due to two core problems: flawed test cases that let models pass without truly solving issues, and training da…