Help me imagine it, what are some examples of widespread flourishing we can look forward to?
SamAs hypothetical friends - not sure if he has any _real_ friends as that requires trust, which is famously antithetical to interacting with SamA - becoming more powerful and wealthy.
Need any more examples of flourishing?
We have enough technology and resources to make it a heaven for everyone except for unpreventable diseases or similar.
Yet we do not because we did not crack the human-alignment problem.
That’s the problem we need to solve, not the resource problem.
If we solve the resource problem before the human alignment problem, we will cause unimaginable suffering.
But surely the people who aren't committing to not use technology for autonomous death deserve a more charitable reading.
absolute underpants gnomes reasoning
If the intention is to bury all that then I think it's going to have the exact opposite effect and make everyone remember.
I can't believe it has to be said. Yet, here we are. Nice to haves include: "We will not participate in the use of AI for mass surveillance," and "We will not participate in the use of AI for (cyber-)warfare."
Especially if you include things that are not normally acceptable such as suicide bombers, poison gas, etc.
Also it has been proven that in real modern warfare cheap drones seem to dominate. So unless we have a kill-bot that can withstand explosives while staying lightweight and operable with good KD (drones are 1.0 or less). kill-bots would have to have a KD of 100 to break even.
* This will change anytime we want, whether you agree or not
* For employees who are following current "principles", when we change, if you are strict about principles, then please leave, we will hire new people
> 1. Democratization. We will resist the potential of this technology to consolidate power in the hands of the few.
For example they could publish their models and research... instead of doing the opposite of what they claim being their very first principle.
Superintelligence aside, power in the present is already held by a small handful of companies, at least in the west. The principles are pretty good, vacuous though they may be.
> We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions. Therefore, if a value-aligned, safety-conscious project comes close to building AGI before we do, we commit to stop competing with and start assisting this project. We will work out specifics in case-by-case agreements, but a typical triggering condition might be “a better-than-even chance of success in the next two years.”
What do people think is the probability that OpenAI would ever actually do this?
- Democratization. Why is it your prerogative sam bro? In other words, what he means is consolidate access so "We" can democratize. We choose who gets what.
- Empowerment. People are empowered by default. Its the totalitarians who curtail the empowerment. The fact that sam things he has the power to "empower" people is arrogant at best. People are empowered already, you just build the tools and make the tools accessible at a reasonable price.
- Universal prosperity. This one pisses me off the most. Who TF made you the benevolent mayor of universe? Are you running for president of the universe and people ask: Hey sam, what would you do as a president of the universe? "I will bring universal prosperity".. yaaaay Sama for president. FFS!
- Adaptability Yep. we'll kiss the ring of whoever is in power, until we get in power. then we will adapt if needed to your needs.
You know who else has principles: Meta. (https://www.meta.com/about/company-info/?srsltid=AfmBOooT6i0...)
- Give people a voice. Read: ensure you control their voice. My take: who tf are you to give anyone a voice? Everyone HAS a voice.
- Build connection and community. Read: ensure that you control all the connections and communities so that you can steer elections and other important things. My take: people have been connecting already for thousands of years.
- Serve everyone Read: control who you serve. My take: Serve everyone, except for totalitarian regimes and people with ideas that are not aligned with ours.
etc. etc.
Like who is the intended audience and what purpose does this serve?
I can't imagine that this will have the same powerful effect that Google's 'don't be evil' stuff did all those years ago.
People are just too cynical and have enough experience being burned by big tech companies. You might think that I'm speaking from a place of age and experience but I think this applies to everyone, young and old -- we're all using these devices and services from the cradle now it seems and we've all been burned by them or know someone who has been burned by them -- kids know the big tech rug pull just like they know they rug that they crawl on while sucking on a pacifier.
So what's the point of this? Is the intended audience internal? Like is it just for the people who work at openai to distract them from the news the stories that they hear in the news about their companies and the stuff they hear people say about them in social gatherings before they admit that they work for openai?
Green Party voters; Technophobic readers of The Guardian[1]; Account managers at image-washing nonprofits; and possibly an anti-Roko's Basilisk.
[1] As opposed to technophilic Guardian subscribers, myself included; just to be clear that I'm not dunking on the newspaper itself.
1. Democratization is centralization. We will resist the potential of this technology to consolidate power in the hands of the few, by consolidating it in the hands of us, who are not few but correct.
2. Empowrment is compliance. We believe AGI can empower everyone to achieve the goals we have determined are worth achieving.
3. Prosperity is scarcity. We want a future where everyone can have an excellent life, which will require new economic models because the old ones will no longer function, for reasons unrelated to us.
4.Resilience is dependence. AGI will introduce new risks, which only AGI can solve, which only we can build.
5. Adaptability is revisionism. We continue to believe the only way to meet the challenges of an unpredictable future is to be prepared to update our positions, our charter, our nonprofit status, our safety commitments, our board, our cofounders, and our prior statements, all of which were operative at the time and are now inoperative and were never said.
And this won’t happen.
So another “do no evil” bla-bla which will ultimately be dropped
Altman's 'beliefs' in his response to the moltov cocktail
https://blog.samaltman.com/2279512 (https://news.ycombinator.com/item?id=47724921)
read: https://openai.com/index/our-principles/
then analyze it critically through the lens of https://www.orwellfoundation.com/the-orwell-foundation/orwell/essays-and-other-works/politics-and-the-english-language/
translate the original article using Orwells principles - what is it really saying?
tldr: We are building a machine that we do not fully understand, which will upend the global economy and introduce severe new risks, but we promise we are doing it for your own good.
gigatexal•1h ago
All the major AI shops are out trying to be the king of the jungle -- I don't think there can be a market in the end for all of them to be worth 2T+ giants.