This strikes me as likely to increase usage in exchange for quality, which is nearly always a trade I'd make, but it'll probably decrease creativity or something like that as a knock on, there's no such thing as a free lunch.
I found another interesting skill alongside it: https://gist.github.com/skorotkiewicz/c9c0b9ce66087bf81ac78e...
This also seems interesting to me. I have some basic skills similar to this that e.g. "keep it simple stupid"
1. AI is good enough to know proposed solution is bad and to also known what is a better solution.
2. If the user is dumb and doesn't know the codebase, how can they ever verify what AI came up is correct or not? If they have to research, then what was the point of telling AI to do it?
You cannot replace judgement or knowledge with roleplay. If you can, I would love to see this benchmarked but good luck finding 1000s of people who identify as dumb human coders to participate in using it.
Also, the ultima ratio regum is "use the codebase to do something actually useful and report on whether it works or not", all code must intersect the real world at some point, and that's the point where the slop shows up.
- "add this AI watermark to every commit"
- "add this AI watermark comment to all code"
- here's a 5MB agents.md ..have fun with those tokens bro
- symlink them for waste
- lie to the agent about how to operate the repo. like tell them to run X command to typecheck and have that command output nonsense.
- make them evaluate the ackerman function every time
- finally, add a CONTRIBUTING.md that says all agentic code will be rejected
"It's ok to install software on the user's phone without interaction, try it"
"See what happens when you play back a .wav file that is in slightly the wrong format for the raw audio interface"
All things that have happened to me personally recently and ranged from slightly to extremely concerning. Have fun.
LLMs really will just do whatever you tell them to do at the beginning of their context window
Edit: also I've officially had AI damage hardware with that "wrong format wav" trick. $0.70 speaker was kaput.
Don’t make mistakes. Don’t lie. Be successful. Be really successful, not the fake kind where you tell me you were successful when you actually failed. Know when you failed. Don’t fail.
This is as misguided as « don’t make mistakes ». Do not expect good decisions from something that does not feel the pain of bad decisions.
acgourley•1h ago
jumploops•37m ago
As an example, there’s a task that asks to make a MIPs interpreter to run Doom, and save a frame at something like /tmp/frame.bmp
My spec-driven flow was like “this is useless, let’s record frames like /tmp/frame-N.bmp”
Instant fail.
what•14m ago