Lately Github PRs have been drowning in a flood of AI slop. I’ve been seeing it myself, and I’m not the only one: https://x.com/mitchellh/status/2011819428061855915
I think it’s great that folks are using AI tools to code faster and better, but too many folks are abusing them to make low-quality contributions to public repos. This takes a lot of reviewers’ mindshare.
IMO there needs to be a mechanism to flag low-effort PRs with AI slop, so you can just skip reading them. So I built one: https://haystackeditor.com/slop-detector
It’s a simple AI slop detector, and I also included some AI slop examples and a “Is it Slop or Not?” game for fun.
It detects AI messups like: - changes totally unrelated to PR purpose - hallucinated functions - duplicate code (specifically, when the AI re-implements a functionality that already exists elsewhere) - terrible comments
Would you use a tool like this?