if you just lie and an llm or a newspaper or a kid believe you, at that point it isn’t a criticism of their naivete, you are just lying
similarly hacking through systems or picking locks isn’t a showcase of weakness if systems, it’s just being a hacker
>It also hasn't happened because there is a reward for cheating. Scammers will label their phone numbers as the customer service number for your cable operator or bank. Counterfeiters will label their batteries or phone cases as official accessories. It's hard enough to get people to correctly label their stuff—but fact-checking billions of labels created by millions of people, none of whom you know personally or whose identities you can verify? That's insurmountable.
There's more he says—the preceding paragraph is below—but that line "there is a reward for cheating" is something I keep thinking about. It's hard not to see in so many of the discussions of LLMs.
>For one thing, there are irreconcilable differences in the ways in which things should be described. A site run by transphobes isn't going to label every story about a trans woman as "a story about a woman," irrespective of what the standard says. Microsoft is never going to label Excel as equivalent to Apple's Numbers, Google Sheets, and LibreOffice's Calc. Hermès is never going to list a $40,000 handbag as being made of the same material and having the same capacity as a $30 leather handbag of the same size and shape.
How can this be fixed? Nothing prevents you from publishing straight BS, and LLMs will use any site that doesn't have a garbage reputation as a valid third-party source.
Of course, LLMs already use Reddit, Facebook and co. as a source, so it doesn't really matter...
So hopefully most of these statistics move towards first party sources.
As a human, this is fantastic.
> How can this be fixed? Nothing prevents you from publishing straight BS, and LLMs will use any site that doesn't have a garbage reputation as a valid third-party source.
Personally, I hope it can't, or the fix is onerous and kneecaps a lot of the utility of AIs.
I wonder if we can even have some adversarial competition, where competing businesses try to get AIs to ingest bad data to pollute their competitors decision-making.
For starters: lets get some fake math papers out there. Given proof-checking systems, maybe they won't totally stop OpenAI, but hopefully the bad math could at least drive up the cost and slow AI down.
s/human/unscrupulous marketer/
Bad for humans in general, good for hucksters and con artists. Net negative for humanity.
They now train on their own content.
Eating your own d̶o̶g̶ f̶o̶o̶d̶ poo.
1. This is a 2022 era picture that LLMs just suck up what's on the Internet and regurgitate it. It hasn't been true for a long time.
2. There's almost no one who has a stronger incentive to distinguish LLM generated text from non-generated LLM text. Training classifiers is pretty manageable.
There's a tension there: they want you to use AI for everything, and if they get what they want then new information will be embedded in LLM text.
> Training classifiers is pretty manageable.
Hopefully such things can be opened up, so the slop can be iterated on until it passes. It doesn't need to be perfect, just enough so more garbage gets through.
> They now train on their own content.
Is this information on this website true/high quality?
We need a google for LLMs!
Oh, but LLMs don't consume ads.
We need ads for LLMs!
Help.
When an LLM is the lens through which you view that text, you often don't have the context of where it came from, and the LLM is often really bad at filtering trustworthiness based on context when retrieving information to answer a query with.
I wouldn't go to a random site with a sketchy URL to get the customer service number for my xyz. I'd go to their official domain. Thus successfully navigating the treacherous waters scammers attempt to muddy.
> s/human/marketer/
I don't care where the bad data comes from. It's actually kinda good that some people will have a financial incentive to push it out and keep pushing.
> Bad for humans in general, good for hucksters and con artists. Net negative for humanity.
It's a sad state of affairs, but it's what has to be done. If we've got to burn the web down to save humanity of obsolescence, I'm for it. I'm not going to let any distaste for marketers or hucksters or con artists distract from that.
The "net negative for humanity" was the attempt to build machines to replace human intellect.
Furthermore, you are content to pretend that the rest of humanity is capable of doing this on a regular basis. And not just the top 10% of those who can read, interpret and weigh biases, but a solid portion of it.
It is a completely reasonable interpretation if you are an accelerationist living in the elite classes. In fact, perhaps, they are even counting on a majority of people thinking this is a fine environment.
I don't have the answers, but a lot of this is just a continuation of a very bad trend.
jqpabc123•1h ago
ranger_danger•1h ago
"History shows that when a slope appears, regulation steps in, technology evolves to solve the problem, or the culture shifts to reinterpret the tool. In almost every case, the feared bottom of the slope was never reached because humans constantly built ramps or bridges along the way."
reactordev•1h ago
behringer•53m ago
dwroberts•1h ago
ranger_danger•1h ago
dgellow•28m ago
micromacrofoot•1h ago
VladVladikoff•57m ago
juujian•52m ago
hyperpape•48m ago
That said, I expect that OpenAI will eventually have its own search infrastructure that rivals Google's, and the overall system will get smarter. Whatever Google did to recognize this site as trash, OpenAI will do as well.
behringer•55m ago
Forgeties79•51m ago
dgellow•29m ago