As a claude code power user once context compacts it will start writing slop. Especially when writing code for API integrations.

For example Supabase auth, it allows user metadata to be writable by clients and leaving service role keys in next.js components. I’ve tried prompting and skills.md to catch this, but it’s not consistent without good test feedback.

So I open sourced a collection of test to with no LLM involved from official docs to catch and fix bad code integrations. Enjoy