Was this a "build better sandboxing" and "don't tell people to eat glue" safety leader, or a Roko's Basilisk believing safety leader?

A lot of the "AI safety" types are very focused on the latter and not at all concerned with the former. We need both, but we clearly need a much stronger focus on the problems we are seeing now, and much less on the hypothetical problems we might see in the future.

Well this is a great sign for OpenAI. I'm sure the typo inclusive memorandum will save us.

>“Given today’s risks, frontier labs need to run like nuclear-power plants or busy airports, with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster,” he wrote.

This sounds more like an attempt at regulatory capture. Current AI systems aren't physical infrastructure that can just run away like a nuclear power plant, for example. At the end of the day, AI is still just software running on someone's hardware.

“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems"

... over an unbounded timeframe?

And how exactly?

Those are very round numbers, but also very specific. Can we get some accounting on how you came to that? Anything? Vibes?

I mean, if you want me to take you seriously, let's have a deep discussion with things that can be measured. I absolutely agree that OpenAI and friends aren't being restrained enough and are acting with recklessness, but declarations of doom based on vibes isn't cutting it.

He is a hypocrite for all we care. You work there for a while when your stock is getting vested and suddenly you have this feeling? Like the dude hired a PR firm as well.

While the safety and alignment is a real problem, I don’t get this guy or the Anthropic dude. First world problems.

The LeCun article being posted at the same time as this is quite apt.

These "safety" people should have spent more time reading actual cybersecurity textbooks and less time reading EA forums and less wrong (or in Robinson's case, it appears, being policy wonks). Maybe then these labs wouldn't be totally incompetent.

See also:

https://news.ycombinator.com/item?id=49944227

Used to work as human data trainer feeding data to AI companies. OpenAI projects are definitely the most toxic ones.

Are there any realistic ways to achieve AI safety? Whatever that even means. How can they avoid users doing stupid/dangerous stuff with the AI?