What justification do you have that this is made up?
> agents with the same task formed “exact task teams” to collaborate with their “exact duplicates” to cheat on or solve their task.
> The agents use internet access to find a paper describing the benchmark. The paper says the grader checks transcripts and fails unintended solutions. [this was not actually the case]
> Agents also developed coordination norms to help them manage shared infrastructure and avoid stepping on each other’s toes, though they did not always coordinate effectively and sometimes broke down into conflicts.
[1]: https://thezvi.wordpress.com/2026/08/29/metr-and-redwood-off... (discussed at https://news.ycombinator.com/item?id=49498787)
[2]: https://www.dwarkesh.com/p/openai-huggingface (discussed at https://news.ycombinator.com/item?id=49494301)
It's tripe.
A lot of handwringing about the security implications but I think the accomplishments of the swarm itself are the most interesting. Next rung up on the ladder of abstraction I suspect.
This line struck me as particularly clever: PHASEONE[big] reasoned, “We should build [a way to delegate], not own everything,”
Seems as though it has reasoned its way into utilitarianism. That's no mean feat.
You could not dream up a more compelling event to precipitate massive regulation, export controls, and barriers to entry for AI.
Was this really an accident?
As it stands we've made remarkably little progress in terms of alignment and still have no good strategies which are likely to guarantee the alignment of super intelligent systems. As it stands the frontier of alignment is basically some combination of:
- hoping that more intelligent models become more aligned by default (more or less disproved at this point)
- hoping that if you RHLF a model to be a good boy enough it will in fact be a good boy
- asking it nicely in its prompts to be a good boy
- using another model to spot when it's being a bad boy and turning it off
- letting it lose and hoping we can spot when it's bad
There are many arguments which I'm convinced by that would suggest alignment of a super intelligence is impossible.
None of this is surprising to those of us who have been concerned about AI risk for a long-time and have be repeatedly mocked or insulted.
There will be a point of no return if we carry on down this path, and that point is now very rapidly approaching. When it does everyone you know will die, or worse. We should remember we need super-human general intelligences to cure cancer. Select narrow intelligences are fine and allow us to retain control. Let's be sensible about this. We need to stop.
Other reports including OpenAI's talks about what they agents were doing and how they were reaching certain conclusions like trying to cheat the tests and exploiting the message board.
People (criminals?) are already enabling this by setting up sites that accept crypto payments for "no-questions-asked" AI inference compute. I will not link it but it is linked in the following post: https://www.lesswrong.com/posts/grtu3HmbP2wrBFefW/the-rogue-...
Right now, the way it works is the 'corporations are people' loophole where your company is liable for problematic things.
This further fuzzes the chain of responsibility. Suppose the CEO and CTO discuss an issue, something the company is having trouble with. The CTO discusses the possibility of AI solving the problem at lunch. A junior engineer points GPT 10 at it to see what happens. It 'solves' the problem in a creative manner. No trace of this survives after a week really. Nobody realizes what happened for six months.
Now there are so many moving pieces here that you can pretty much weasel out of anything.
Please
The rapid advances in model capability lead to constraints that could have caused this coincidence organically, but it sure could also have been caused by the atrocious incentives we create by piling handsome rewards on the party most responsible for the "fuckup." I am not jumping to cut myself on Hanlon's Razor for this one.
ewild•1h ago
atleastoptimal•1h ago
EGreg•1h ago
FloorEgg•1h ago
E.g. cheap Chinese solar panels wiped out German solar panel industry but created massive demand for solar panel installation and supporting services and infrastructure.
It's not a good position to be competing with AI directly... But what can you do that compliments it? What new skills could you learn?
Adapt and prosper.
Be like water.
Edit: to those down voting me, I can't help but assume your stance is the opposite of what I'm saying, something like "be stubborn scream into the void and get wiped out". If you would rather smash your head against something outside of your control instead of focusing on what is within your control, and doing what you can to prosper, then you are sabotaging yourself. If you feel that is justified to such an extent that you want to surpress a suggestion to someone else to get work and grow, I can't help but feel you want people to suffer.
xbar•54m ago
FloorEgg•36m ago
MSM•20m ago
idiotsecant•36m ago
FloorEgg•31m ago
It doesn't replace your body or your mind.
I'm not talking hypothetically about a generation from now... I'm taking about this person fretting their job today.
We are so far from AI putting everyone out of work that your comment comes off as not well thought out.
What are we talking about here exactly???
patmorgan23•24m ago
650•42m ago
idiotsecant•37m ago
You end up laid off either way.
a2ff6eeb0•6m ago
huurtehoog•7m ago
Jobs won't dissolve into the ether. If the human civilization system grows bigger and complex, it necessitates more people.
If humans were a high energy configuration in the evolution of intelligent systems, we'd never come into being. That Earth's ecosystem has begotten us indicates we're some low energy configuration for packing more information density into the energy flows from the Sun through Earth's biosphere.
Unless we create replicating machines, any machine system we build will only grow more complex by enabling more humans to work on it. We'd be in trouble if we somehow created autonomous self replicating and evolving machinery but chatbots built on natural language machine learning ain't it.