The rate at which flaws are being found is just insane. Many people warned us in the past that our lax security postures would come back to bite us, and we're finally here.
And theres really only one of 2 outcomes as this progresses as I can see it:
1) The AI's are well matched, and the outcome is balanced, and it ends up being a metric of the internet itself that gets monitored, like this website is doing.
or
2) It crashes in such a spectacular fashion that important utilities and industries are distrupted, with the length of time for recovery being the determining factor in how many people lose their minds, start looting, etc ... you know the story.
"We take code and make it secure"
instead of
"We take secure and make it code".
That said, maybe it's impossible. Maybe turing completeness and security are antithetical and someone will always be able to find a way to poke a hole in the system from a lower layer of reality.
Yeah, that. Manual controls w/ an optional automation, not just, automation with an optional "oh shit" button.
As for the AI's hacking and patching, one could reason since we are dealing with Turing machines that as long as changes to any given codebase/version cease, then all possible holes and patches would be found given enough attacks for that specific release.
Perhaps unfolding almost exactly like Conways 'Game of Life' with an order or two magnitude more rules and states, where the end pattern for any release is 'stability.'
We need a realtime dashboard for this :D
An over time graph with a rolling window of 7d and 28d would likely be a nice addition.
Great work!
For fucks sake. The author could have invested at least half an hour to replace this obvious LLM slop regurgitation of the prompt with something of their own.
"Buy sponsor slot for 149$/month", yeah, spotted the grift. For that level of payment it's at least reasonable to expect the design to be something else than the usual LLM garbage mixture of 30 different font styles.
It is still getting started.
Step 2 is instead of waiting to be caught, the instigators should issue a press release blaming cunning rogue agents as part of their research, call no felonies because they’re working for the greater good of eliminating a shitload of jobs, say the real problem is a lack of regulation. They could even return the money if it looks like they’re going to get sued, and collect some sweet, sweet reflexive investment money.
Which is an interesting problem, what happens when the agent fucks up and the customer loses lots of money? Who is responsible?
If the official policy is "no agents", it shifts the blame.
If a connected person breaks rules and loses money, it's someone else's fault.
I don't make the rules, I just break them.
Part of it is "human in the loop" for write actions, part of it is commercial banks are deathly terrified of agents being able to move deposits around rapidly to maximize yield, as those deposits are cheap cost of capital banks use to lend against. Historically, deposits of unsophisticated financial services consumers were sticky, and that assumption is breaking down. Agents can be consumer copilots towards information asymmetry in this context.
"computah, maximize rate of return, minimize interest expenses, manage cashflow, make no mistakes."
Also the flip side where Chinese models are used to attack US infra, just loading artillery shells into the "Ban Chinese Models" cannon.
In fact, it seems to be the case for the "json" and "llms.txt" buttons, too.
I fortunately live in a peaceful, cooperative country of Poland that looks down upon such practices unlike us or France or uk
Let the best win. Over and out
I guess it's being called an AI prompt worm. It's not quite to the stage of sovereign AI where the entire model weights are moved with the 'virus', but still presents a pretty big risk.
The bad guys are historically much better at keeping their systems current.
| Year | Reported US data compromises |
|---|---:|
| 2016 | 1,099 |
| 2017 | 1,506 |
| 2018 | 1,175 |
| 2019 | 1,279 |
| 2020 | 1,107 |
| 2021 | 1,859 |
| 2022 | 1,798 |
| 2023 | 3,202 |
| 2024 | 3,152 |
| 2025 | 3,322 |
Curios what 2026 will look like...
Sources:
https://www.idtheftcenter.org/wp-content/uploads/2022/04/ITR...
https://www.idtheftcenter.org/wp-content/uploads/2026/01/202...
That's all. full stop. all this AI agent stuff is jazz hands. Large VC funded labs are just "more valuable" to the political establishment than anything else.
None of that has changed.
If they were sold a product that claimed to be safe, they could in turn sue whoever sold it to them. Jeep’s insurance wouldn’t pay someone I crashed into because of defect in my jeep, but I could in turn sue Jeep for my legal trouble.
Kevin_Flynn•1h ago
Was hunting for a real time graph of incidents and patches, like a stock market chart of the end of the software world, or the birth of artificial consciousness, depending on how squiggly the lines are.
Just the heatmap apparently. :|
Also, as all the humans are installing their "AI on every device" clustering software, the pace of it all should really pick up, and this reminds me of the following SFW movie clip:
"The suspense is terrible. I hope it will last." - Willy Wonka
https://www.youtube.com/watch?v=Oci1CuCht7E