My personal beef in this particular instance is that we've seemingly decided to throw decades of advice in the form of "don't allow untrusted input to be executable" out the window. Like, say, having an LLM read github issues that other people can write. It's not like prompt injections and LLM jailbreaks are a new phenomenon. We've known about those problems about as long as we've known about LLMs themselves.
S- Security
E- Exploitable
X- Exfiltration
Y- Your base belong to us.
The researcher who first reported the vuln has their writeup at https://adnanthekhan.com/posts/clinejection/
Previous HN discussions of the orginal source: https://news.ycombinator.com/item?id=47064933
The original vuln report link is helpful, thanks.
The guidelines talk about primary sources and story about a story submisisons https://news.ycombinator.com/newsguidelines.html
Creating a new URL with effectively the same info but further removed from the primary source is not good HN etiquette.
Plus this is just content marketing for the ai security startup who posted it. Theyve added nothing, but get a link to their product on the front page ¯\_(ツ)_/¯
This. I want to support original researchers websites and discussions linking to that rather than AI startup which tries to report the same which ends up on front page.
Today I realized that I inherently trust .ai domains less than other domains. It always feel like you have to mentally prepare your mind that the likelihood of being conned is higher.
edit: can't omit the obligatory xkcd https://xkcd.com/327/
It's astonishing that AI companies don't know about SQL injection attacks and how a prompt requires the same safeguards.
EDIT: And if you think "well, how else could it work": I think GitHub Actions simply do too much. Before GHA, you would use e.g. Travis for CI, and Zapier for issue automation. Zapier doesn't need to run arbitrary binaries for every single action, so compromising a workflow there is much harder. And even if you somehow do, it may turn out it was only authorized to manage issues, and not (checks notes) write to build cache.
He seems to have tried quite a few times to let them know.
varenc•1h ago
mclean•1h ago
gfody•1h ago
https://github.com/cline/cline/commit/b181e0
causal•1h ago