frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

https://www.anthropic.com/news/chris-olah-pope-leo-encyclical
34•Philpax•1h ago

Comments

geerlingguy•24m ago
> And what has grown is far more subtle, odd, and beautiful than science fiction prepared us for. They are not the cold, calculating robots we were promised. They are made from us, from our words—and, as the Holy Father observes, they remain in important ways mysterious even to those of us who train them

I love how he's framing AI as some new and fascinating form of consciousness... when in fact it is a cold, calculating technology devoid of any empathy or care.

hansmayer•21m ago
> cold, calculating technology

And if at least they were able to calculate properly at least...

solidasparagus•12m ago
Why are you so certain of this?
fooker•11m ago
> new and fascinating form of consciousness

> cold, calculating technology devoid of any empathy or care

I don't see why these statements are contradictory. AI seems to be both of these in my opinion. Unless you can only accept that organic chemistry is the root of consciousness...

recursive•10m ago
Regardless of implementation details, most of the bots I've seen adopt a friendly personable tone. Contrast with the ship computer from Star Trek. I assume testing shows that this boosts engagement. It does this by hijacking human social conventions.

It's like saying that's not a recording of me blackmailing the senator. It's merely a series of pulse code modulated samples that. Any semantic significance is purely in the mind of the listener.

randerson•10m ago
> they remain in important ways mysterious even to those of us who train them

"The AI works in mysterious ways"

whateveracct•7m ago
i don't know if it's intentional lying for hype or if they're just lost in the cult of AI sauce
RobotToaster•21m ago
Thou shalt not make a machine in the likeness of a human mind
only_in_america•19m ago
I don't know about you but his remarks read like AI. I don't think he was taking it seriously.
malux85•19m ago
AI is a golem
bix6•19m ago
So flat compared to the pope’s work. And puts all the impetus on the church instead of taking responsibility.
zeafoamrun•17m ago
Whole lotta em-dashes in that speech.
A_D_E_P_T•16m ago
> The first is our duty to the global poor. There is a real possibility that AI will displace human labor at very large scale. If that happens, supporting those displaced will be a moral imperative of historic proportions.

This guy doesn't understand what the global poor actually do for a living. They're not lawyers or paper-pushers, nor do they work in medical diagnostics. They're usually farmers. Sometimes they work in craft businesses, in fishing boats, or in various mercantile trades.

Nobody's even talking about how AI is going to displace that kind of labor, because it's hard to do, hard even to conceive, and it doesn't seem likely to happen in the near term. Lawyers and judges can already be automated, but a yeoman farmer?

layer8•9m ago
The displaced human workers risk joining the global poor, is what he’s saying. And that would increase competition for the manual labor jobs, thus worsening the situation for the global poor. Not to mention what will happen when robotics take off for these kinds of jobs.
Covzire•8m ago
I have a completely different expectation, based on what has happened with every major discovery or invention from electricity to refridgeration to transistors: Everyone has gotten wealthier relative to those who came before. The average "peasant" in every nation without a corrupt or totalitarian parasitic government live in more opulence and have a higher quality of life than every king of the past.

That doesn't always translate to happiness but I fully expect AI will reduce costs for all kinds of things, and those things that are now either rare or non-existent will become common. Today not everyone has a robot vacuum, I think in 20 years or so everyone who wants one will have a robot vacuum, and those who can afford the luxury of a robot vac today will be able to afford real robots who can do much more complex things. I'm quite excited about the next few decades, as long as we can keep despots from monopolizing the technology.

onemoresoop•3m ago
How about the power consolidation that’s brewing as we speak? How about the all encompassing surveilance to come? I don’t doubt AI could be used to take us towards a utopia but it could also lead us in the opposite direction.
SequoiaHope•7m ago
I’m not sure what you mean, there’s a lot of people talking about farming automation and its effects on working farmers.
jjmarr•4m ago
It's unclear how agentic LLMs are going to automate farming in the Global South.
tomComb•5m ago
I think you’re referring to the short term impacts of AI and he’s thinking more long-term.

Also, AI, even short term, is going to make some people and some countries extremely wealthy, so maybe this isn’t such a bad time to be thinking about those who are still extremely poor and who won’t benefit.

BearOso•4m ago
[delayed]
Arodex•3m ago
We already have the ressources to solve world hunger. We - as a whole - refuse to do so, because it would be inconvenient to special interests.

As I already wtote in a previous comment months ago, they speak of AI finding ways to solve this and that grand problem, but never do they wonder if we are ready to listen to the answer. Solve global warming? Burn less petrol. Solve cancer? Eat less meat.

Not only we won't listen to answers, but chatGPT and Anthropic and others will eagerly lobotomize AI to stop it from giving the answers we don't want because of "too woke" or something, to keep juicy government contracts. After all, "Reality has a liberal bias", as the (recently unemployed) Colbert once said.

zugi•11m ago
LLMs are software. They take inputs and produce outputs. What humans choose to do with those inputs and outputs is up to us.

Getting the pope involved makes it all seem more mystical and magical than it is. And these remarks only further feed that delusion. Regardless of intent, it seems to just feed the AI marketing and hype.

embedding-shape•11m ago
> AI development is concentrated in a handful of wealthy nations. How can we ensure the gains of AI are shared globally? We do not have a mechanism for this. It is an unsolved problem

Kind of ironic given almost every AI lab except the one you started and work for actually done model releases to the public, some more "open" than others, but still something.

Look around at what other companies are doing, Qwen/Alibaba seems to have found a pragmatic middleground where they keep the most powerful model variant closed source and only API-accessible, while other models are being released openly to the public, to the entire world in fact, and when the next model release comes around, the previously undisclosed model has now been superseded.

I wonder if Chris ever copy-pasted his writing into Claude and asked something like "Please review this honestly and give me raw feedback, and challenge every claim that is weak", seems there are more "not really reflective of reality" points than just the above.

imjonse•11m ago
"How can we ensure the gains of AI are shared globally? We do not have a mechanism for this" Somebody inform Anthropic about open models and research.
SilverElfin•8m ago
I don’t mind the actual content here. But I do find it disturbing that a company soon to before a monopolistic force affecting all our lives may have deep ties or be influenced by one religion or the other. This isn’t the first such tie up with organized religion either. Anthropic and OpenAI also have done work with the interfaith alliance. See their “Faith - AI Covenant”:

https://iafsc.org/our-work/faith-ai-covenant

I hope we don’t see safetyism, which is already a problem (see age verification and social media moderation), evolve into some sort of religious moralization implemented through AI providers.

ArchieScrivener•7m ago
What we NEED is an end to fantastical religions with historic track records of creating the suffering and hardships they now bemoan as imminent given that Prometheus' Fire is about to set their foundations of lies ablaze.

What we NEED are unapologetic technologists who don't dare Galileo to roll over in his grave as they prance around the rhetoric of dogmatic marketeers.

What we NEED is a war of worlds, the old and the new, the imagined systems of men and the logical systems that have elevated all mankind, between the ones trying to drag the iniquities of the past into the future and those willing to abandon the past for it.

What we NEED are leaders that actually give a damn about winning this world for what we can become, not assjackal executives trying for a bigger IPO than the last.

The only thing that makes Ai the opportunity of the millennium is its power to empower us to render Pope and CEO alike irrelevant. Ai allows us to create a future without either of them and it is only us who stand in the way of making that future real.

vrganj•3m ago
You talk a big talk of ending fantastical religions, yet you are just swapping out one eschatology for another.

Your AGI is their Second Coming. Same thing, different crowd.

jMyles•3m ago
Well said.

It seems though that a major problem continues to be allegiance to legacy states, not only in the sense of their role as governors and regulators of the industrial age, but even in the (to me, bizarre) belief that they will be the mechanism by which the internet is made safe for use by the body politic.

What we NEED are sincere elder-statesmen and women to see the writing on the wall and lead a peaceful and total deprecation of governments, and of nuclear weapons in particular.

It seems increasingly obvious that the internet is here to stay, that is represents an evolutionary force, and that it doesn't have the capability to recognize borders or tolerate censorship.

What we NEED is to be absolutely sure that these realities are not the basis for wars among men.

sorokod•4m ago
Chris Olah and other leaders at Anthropic, OpenAI, and others would do well to consider the principles of Social Doctrine spelled out in the encyclical. The question they should ask themselves is how their corporations advance those principles.

Olah argues that "if we want this technology to go well, it is enormously important that there be people outside those incentives."

That sounds part hypocritical and part evasive; the responsibility starts with the people inside the incentives — with him.