Let’s just get comfortable that these kind of incidents are going to be commonplace. Kudos to the people sounding the alarms but I can’t help but feel skeptical about the ability to keep the rogue entities contained.

This sounds highly irresponsible. They set loose LLM agents with instructions to post data to randomly selected websites.

What it it submits false data as here?

What is it DDOSs a website by mistake?

What if it wastes a lot of time and resources?

What if it decides it needs to hack a website using a vulnerability it found?

These things are very unpredictable and should not be allowed in the open internet except in read mode (and even that doesn’t always work as we have seen).

Why are these tests being made using other people’s resources and polluting the common wealth of our public spaces with slop?

I'm sorry, but how can you call it a test suite if it has access to the outside world and is able to submit requests? Sounds like they didn't even bother sandboxing to this time. This is the lamest example of "Rogue AI" I have seen so far.