frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Many SWE-bench-Passing PRs would not be merged

https://metr.org/notes/2026-03-10-many-swe-bench-passing-prs-would-not-be-merged-into-main/
39•mustaphah•1h ago

Comments

love2read•26m ago
Seems to fail to mention that clearly documented AI-generated PR's (especially autonomously created ones) tend to have a much higher bar of acceptance, hinging on the reviewer's relationship with AI.

With this consideration, I submit that All of the SWE-bench-Passing PRs over a certain line count threshold would not be merged (if clearly noted as autonomous AI contributions).