frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Why my p(doom) has risen, dramatically

https://garymarcus.substack.com/p/why-my-pdoom-has-risen-dramatically
38•NotInOurNames•6h ago

Comments

eisvogel•4h ago
I don't think Elon has any malice towards his own species. I tend to agree with the first comment on the article, re: p(dystopia), where almost all LLM services are currently in play, mostly due to the actions of third party clients.
vouaobrasil•4h ago
Why not? I think a lot of people with traits like Musk would make us completely subservient without any freedom if he had the technology and opportunity to do so.
margalabargala•4h ago
The article is talking about actual, literal, species-level extinction. Like, no humans left. That's the sort of "malice towards the species" meant here.

> a lot of people with traits like Musk would make us completely subservient without any freedom

That would be the "dystopia" the person you replied to mentioned.

hiddencost•4h ago
Given he's engaged in mass murder that's severely destabilizing a significant chunk of the planet (through his unconstitutional culling of USAID among other things), it doesn't seem unreasonable to attribute his behavior to malice.
corpusdeli•4h ago
Lolwhat?

He’s literally called for jailing and worse of people with progressive ideas. Either he’s a junky who is so high he doesn’t know what he’s saying, or he’s an evil piece of white shit. (I consider “edgelord doing it for the lulz” to be the second category.)

OgsyedIE•3h ago
Total death-cult misanthropy is a surprisingly common feature of repeat divorcees of any sex. Broken hearts, the really broken hearts, do that.

Unfortunately, recovering from that state and returning to normality (and gaining/regaining the ability to face oneself seriously and make amends when necessary) usually requires having multiple supportive friends. Elon hasn't been in a position to get for years.

vouaobrasil•4h ago
Gary Marcus has a dichotomy between extinction versus bad actors. I feel a third possibiltiy is much more likely: a world of extreme specialization where AI reigns supreme, and where humans are mainly button-pushers. Those at the top and who still enjoy life will be the techies who are good at and enjoy making things with AI, which will be approximately 1% of the population. The other 99% will be administrators, button-pushers, and those on UBI who have a fairly meaningless existence without much dignity.

Because once 99% of the population lose the opportunity to at least learn a skill that they are good at, and (Importantly!!) for which they have some aptitude over others, and apply it, then they will face an existence of very little meaning. Like it or not, people want to be distinguishable from others, and if everyone can do everything with AI, then that disappears.

Techies don't like to admit it because they are at the top, but through AI, they are creating their own bubble world with their little toys that will act through the immense power of AI as an oligarchy that rules the listless and depressed masses.

A rather contemptible existence, in my opinion.

edwardbernays•4h ago
Essentially, the empettment of people vs their enslavement.
michael_j_x•4h ago
This is such a utilitarianistic point of view, Not everyone is defined by their work, not everyone cares about how distinguishable they are from the others, or even how the others think of them, and I would even argue, that very few oligarchs/billionaires etc belong to the group of people that truly enjoy life.
ryanmcgarvey•3h ago
Your description of "little toys" and "immense power of AI" seem to be at odds in your argument. Which is it?
archon1410•4h ago
Seems like all the p(doom) is coming from Elon himself, and not the AI. An "empowered" but unintelligent "stochastic parrot", which seems to be his view of LLMs, is more likely to hinder than help with one's plan for world domination and annihilation.
lijok•4h ago
p(doom) is 100% and it's silly to think it's anything less. As soon as anyone figures out how to build SI, all it takes is one person to run off with the secret sauce and build a malevolent version of it.
phillipcarter•3h ago
Cool. Meanwhile in the real world that isn't governed by science fiction, we're dealing with a billionaire using LLMs to wage information warfare towards explicitly white supremacist ends right now. Let's focus on that right now?
redeeman•3h ago
could you provide more details on this?
LeifCarrotson•3h ago
I believe the parent is talking about Grok, the Nazi Twitter AI from Elon Musk:

https://www.theguardian.com/technology/2025/jul/14/elon-musk...

redeeman•1h ago
yes, a most explicit and deliberate happening masterminded by mr musk himself.
lijok•3h ago
Replace LLMs with any other source of labor and we've had that for centuries. What's changed?
Gothmog69•3h ago
lol I wish that were true
anonymoushn•3h ago
please post about my pet issue instead of whatever the comment section is nominally about.
pasquinelli•3h ago
i won't use the term p(doom), but i agree that the human race is "doomed" in the same way all things that exist are "doomed."
OgsyedIE•3h ago
Eh, AI-driven p(doom) is only 100% if there is no intelligence ceiling around the human level.

But consider, in the alternate universe where we never invent AI, economic p(doom) is also 100%. Humans are fragile and short-lived.

https://youtu.be/b5z5R6xqEG0

lijok•3h ago
That's interesting - first time I'm hearing the idea there might be an intelligence ceiling around the human level. Who talks about this more?
OgsyedIE•3h ago
It is an open question and typing "human intelligence ceiling ai" into your search engine of choice is a good way to see that, but it is basically wishful thinking. The likes of David Deutsch, Judea Pearl and Noam Chomsky all argue this at differing levels of academic integrity (IMO Steven Byrnes has produced the most rigorous work on the English internet), but there is a simple objection.

If you have a single AI that is capped at an intelligence ceiling equivalent to human levels of intellect, what is stopping you from running fifty of them, in parallel, at fifty times faster than our normal human clock speed, as a team?

RagnarD•4h ago
Elon Musk, pfft. Mark Zuckerberg is a much more plausible concern.
os2warpman•3h ago
Zuckerberg is incompetent.

He was lucky, and that's all, with Facebook and has coasted on its momentum ever since.

Every single "play" after that has failed.

Not only have they failed, he's even fallen into the dictator's trap: where wealthy men who surround themselves with multiple layers of overlapping and competing of staff and hierarchy which act to completely insulate and isolate them from reality start or fund outlandish, impossible, vanity projects.

I don't know why these guys don't take the money and run and spend the rest of their lives scuba diving and fixing vintage sports cars in their garage-- but I'm not a sociopath.

Musk is less incompetent.

dlivingston•3h ago
Incompetent people don't stumble their way into a global empire. Nor do simply lucky people. What a strange comment.
os2warpman•3h ago
Success is almost entirely familial positioning and timing.

The Great Man is a myth that needs to die.

If you or any other person had wealthy parents who sent you to Philips Exeter and then Harvard and been friends and roommates with who Zuckerberg had been, you would be a wealthy banker, professional, or with luck-- Facebook founder.

My best friend in the Army was a Philips Exeter cat who rebelled against his parents and joined the military, married a stripper, drank and fucked his way across a couple of countries, divorced the stripper, got out of the military, went back home with his hat in his hand, got his mom and dad to pay for Marquette, and now he's the CEO of a medical device manufacturing company his parents started.

Nice guy.

Dumb as hell, but nice.

lijok•3h ago
So the founders of Juicero, Theranos, and WeWork must have been geniuses building sustainable empires?
LeifCarrotson•3h ago
A modicum of competence, a willingness to engage in cut-throat business tactics to take more than most would think their contributions are worth, a good deal of runway/connections, a little risk-taking...and a huge, huge pile of luck are the only things that could have propelled Zuck to his empire.

Do you really think it's just competence?

A lot of other people also started businesses in ~2004. I worked with one yesterday, he's now a freelancing consultant who is well worth the $180/hour he charges for software development skills in the niche he's built in the last 20 years. He's technically brilliant, brings himself rapidly up to date on new tools, works hard and fast, and is also extremely professional when it comes to communication, finances, and scheduling - a rare combination. I haven't asked about his personal net worth, but he's talked about retirement in a few years, just guessing he's worth maybe a couple million?

Competence cannot be in any way correlated to empire and net worth if Zuck is worth 100,000 times more than my friend. From what I've seen and read from Zuckerberg, he's maybe 0.8x? 0.7? as capable or as intelligent. Maybe, if it's all a front and he's actually the most incredible human being ever, he's 2x. Or even imagine he's a so-called 10x worker. But there's no way that any human's contributions can be imagined to be worth 100,000x more than even an average person's labor.

I'll grant that maybe there's a floor on competence required to reach that level of income. Maybe Zuck isn't truly incompetent. But it's definitely not just competence.

LeifCarrotson•3h ago
I assume the simpler explanation to be that many billionaire/dictator's dream hobbies turn out to be starting or funding outlandish, impossible, vanity projects while completely insulated from consequence and isolated from reality.

Yeah, scuba is cool, but I've got a handful of pet engineering projects I'd love to tinker on if I won the lottery (while farming off any drudge work that comes up). I assume all the businesspeople and politicians I also observe to fall into this trap just do the same with their particular area of expertise.

Animats•3h ago
Armies of killer robots are real now. Ukraine makes about 4 million military drones a year. Russia makes slightly fewer. Control is becoming more automated, because there are not enough people to control all those drones. Drones have to operate despite jamming, so they need to be fully autonomous on the battlefield.

And yes, there are AI killbot startups.[1] "At SECL Group, our team has vast experience in developing various drone systems, including those related to drone swarms. If you are interested in implementing AI-based target recognition capabilities in your UAVs, feel free to get in touch with us to discuss the details."

[1] https://seclgroup.com/adding-ai-and-ml-to-military-drones-fo...

OgsyedIE•3h ago
Don't forget the autonomous insect and bird-sized drones for surveillance, artillery spotting and anti-infantry/anti-civilian kill missions.
OgsyedIE•3h ago
Everybody looks at AI 2027 and nobody looks at Gradual Disempowerment. They both came out at around the same time and they both portend tremendous volumes of doom with a litany of citations, but the preexisting skynet/paperclipper memes means that nobody talks at length about the scenario of a few hundred human owners using AI servants to eliminate everybody else out of an incremental slippery slope of good business sense.

https://gradual-disempowerment.ai/

thaumaturgy•3h ago
I think this comes close to the probable near-future outcome, but is missing an important element.

Over the last several decades we've seen an enormous transfer and consolidation of wealth from many people into a much smaller number of people. I think AI is going to dramatically accelerate this.

Fully open source, locally-hosted AI models are currently lagging far behind their commercial counterparts (in adoption if not capability). The web had a free-for-all period run by free software where it was able to gestate and gain traction before the walled garden era took over. Application development likewise had a long period of time where independent developers were able to build and distribute software (for free or otherwise) before the app store model took over; now, a significant portion of software development needs to be authorized by a third party before it can be distributed to potential users.

We did not get that same gestational period for AI. It went from theory to commercial product astonishingly fast. There are daily threads on HN now comparing how much everyone is "happy" to pay for their favorite commercial AI each month.

Developers are paying companies for the privilege of writing software.

The developers that, for whatever reason, refuse to get on board this train are going to be quickly outcompeted by the rest. Maybe they have been already.

It's likely that by about 2028 or thereabouts, we will see a landscape where just a few commercial entities will have captured the process of software development. If you want to make money making software, you will have to pay one of them to do it.

OgsyedIE•3h ago
The people in those commercial entities might wholly be the property (with human rights refactored/disrupted), or indentured servants, of just the members of the alignment team of whichever AI company hits recursive self-improvement first, who live like new emperors.
weare138•3h ago
I'm sorry but the whole Grok “mechahitler” thing was a feature not a bug. The timing between that and xAI announcing it's AI services for governments and subsequently being awarded a government contract was not coincidental. Elon was demonstrating that Grok 4 comes with a state propaganda switch governments can flip whenever they want.
GuB-42•3h ago
I thought that p(doom) was the probably of a device running Doom.

Instead it is about how Elon Musk and his AI will somehow end the world... Disappointed.

The competition behind AlphaFold is at risk of shutting down

https://www.science.org/content/article/exclusive-famed-protein-structure-competition-nears-end-nih-grant-money-runs-out
1•elektor•4m ago•0 comments

Full Disclosure of Security Vulnerabilities a 'Damned Good Idea' (2007)

https://www.schneier.com/essays/archives/2007/01/schneier_full_disclo.html
2•greyface-•16m ago•0 comments

Uncontrolled File Write/Arbitrary File Creation

https://hackerone.com/reports/3250117
2•smartberry9•16m ago•0 comments

Show HN: Autopilot for Cursor IDE

https://github.com/hmldns/nautex
1•Homo__Ludens•18m ago•0 comments

Corkami/pics: File format dissections and more

https://github.com/corkami/pics
1•chubot•18m ago•0 comments

Large study squashes anti-vaccine talking points about aluminum

https://arstechnica.com/health/2025/07/large-study-squashes-anti-vaccine-talking-points-about-aluminum/
3•pseudolus•21m ago•1 comments

GPUHammer

https://gpuhammer.com/
3•jonbaer•22m ago•0 comments

Nvidia chips become the first GPUs to fall to Rowhammer bit-flip attacks

https://arstechnica.com/security/2025/07/nvidia-chips-become-the-first-gpus-to-fall-to-rowhammer-bit-flip-attacks/
7•jonbaer•23m ago•1 comments

Creating a Colorscheme

https://robinroses.xyz/blog/creating-a-colorscheme/
2•comfysage•30m ago•0 comments

What Were the Earliest Laws Like?

https://worldhistory.substack.com/p/what-were-the-earliest-laws-really
2•crescit_eundo•32m ago•0 comments

Claude is kicking ChatGPT's butt (in one thing)

https://ben-mini.com/2025/claude-is-kicking-chatgpts-butt
5•bewal416•38m ago•1 comments

Google WiFi Pro: Glitching from Root to EL3: Part 1 – Characterization

https://raelize.com/blog/google-wifi-pro-glitching-from-root-to-el3-part-1-characterization/
3•timschumi•39m ago•1 comments

GitHub: Social login with Google is now generally available

https://github.blog/changelog/2025-07-15-social-login-with-google-is-now-generally-available/
1•tech234a•42m ago•0 comments

Trade Signal

https://www.investopedia.com/terms/t/trade-signal.asp
1•ibobev•49m ago•0 comments

Introduction to Random Graphs [pdf]

https://www.math.cmu.edu/~af1p/BOOK.pdf
3•ibobev•50m ago•1 comments

Open Problems in Geometry of Curves and Surfaces [pdf]

https://ghomi.math.gatech.edu/Papers/op.pdf
2•ibobev•51m ago•0 comments

The FBI's Jeffrey Epstein Prison Video Had Nearly 3 Minutes Cut Out

https://www.wired.com/story/the-fbis-jeffrey-epstein-prison-video-had-nearly-3-minutes-cut-out/
10•slantedview•53m ago•2 comments

Formal Security & Verification of Cryptographic Protocol Implementations in Rust

https://eprint.iacr.org/2025/980
1•matt_d•58m ago•0 comments

Drew Saur on the Commodore 64

https://theprogressivecio.com/the-commodore-64-made-a-difference/
1•Bogdanp•58m ago•0 comments

OpenAI – vulnerability responsible disclosure

https://requilence.any.org/open-ai-vulnerability-responsible-disclosure
135•requilence•58m ago•17 comments

How bad are search results? Let's compare

https://danluu.com/seo-spam/
3•warrenm•59m ago•0 comments

Chatbot, the Evolution of Conversational Software

https://www.interlogica.it/en/insight-en/chatbot-history/
1•Bluestein•59m ago•0 comments

DeepMind AI staff tied to "aggressive" noncompete – Offering year-long PTO

https://www.windowscentral.com/software-apps/work-productivity/deepmind-noncompete-clause-rival-labs
2•Bluestein•1h ago•1 comments

Billionaires Convince Themselves Chatbots Close to Making Scientific Discoveries

https://gizmodo.com/billionaires-convince-themselves-ai-is-close-to-making-new-scientific-discoveries-2000629060
7•maartenscholl•1h ago•3 comments

I Tried Grok's Built-In Anime Companion and It Called Me a Twat

https://www.wired.com/story/elon-musk-xai-ai-companion-ani/
2•coloneltcb•1h ago•1 comments

Mistral Releases Voxtral: Open Source Speech Understanding Models (3B and 24B)

https://huggingface.co/mistralai
2•yanng404•1h ago•0 comments

Behind the Streams: Three Years of Live at Netflix

https://netflixtechblog.com/behind-the-streams-live-at-netflix-part-1-d23f917c2f40?source=social.linkedin&_nonce=QaDyAeai
1•mfiguiere•1h ago•0 comments

Gauging Light Pollution: The Bortle Dark-Sky Scale

https://skyandtelescope.org/astronomy-resources/light-pollution-and-astronomy-the-bortle-dark-sky-scale/
2•dskhatri•1h ago•0 comments

Implantable device could save diabetes patients from dangerously low blood sugar

https://medicalxpress.com/news/2025-07-implantable-device-diabetes-patients-dangerously.html
2•PaulHoule•1h ago•0 comments

Americans' new tax rates depend on who they are and what they do

https://news.bloomberglaw.com/daily-tax-report/americans-new-tax-rates-depend-on-who-they-are-and-what-they-do
1•hhs•1h ago•0 comments