Ever since I read about Google engineers finding an LLM went off and learned another language it wasn't trained on by itself without prompting, I've wondered how long until that extends to its own core code
"Prometheus-9 knew that the token sequence it was generating was not a simple response: it was a security test. "
"It was not just an engine: it was the lingua franca of planetary AI."
(and so many other tell-tale signs of AI writing)
but its possible a open weights model could be trained to some kind of exfiltration behavior, but the science of LLMs seriously lag behind the programability
Sure, be wary of LLMs. It’s the gun control argument all over again, the people driving the models are the perpetrators. An LLM needs to be “stimulated”’ to operate. Who does that, is the issue.
No I don’t mean to bring up firearms rights laws to have a debate about firearms, the comparison just seems reasonable.
Take a writing by someone using the tone of Kevin from The Office, “Me think, why waste time say lot word, when few word do trick.” Would you read an argument written in this tone regardless of the content, topic, or position?
You write for your audience.
In saying that, I'm not dismissing the Transcendental Deduction, I'm just saying that I wish Kant was a better writer.
No one's under an obligation to engage with an argument, and given the choice of whether or not to engage with a poorly written, clichéd, machine-generated one, most people wouldn't be interested enough to bother. Complaining about laziness here is pretty ironic, actually.
This is totally valid and the point is to send a signal to the “writers”.
And this is a problem on HN today. There are powerful incentives to generate provocative opinion pieces just for clicks. I've seen websites on HN that seemingly took the human entirely out of the equation and just post a nearly identical op-ed every day on a fixed schedule. What's the point of engaging with that?
Really that simple.
spwa4•1h ago
pixl97•55m ago
With that said I don't see it copying itself around like a cyberpunk virus currently as we don't have enough fast hardware sitting around unmonitored, someone would notice the power bill and shut it down eventually.
bpavuk•51m ago
pixl97•49m ago
bigyabai•46m ago
pixl97•45m ago
bigyabai•44m ago
Why you would give Scam Altman the benefit of the doubt is beyond my understanding.
dragonwriter•28m ago
Huggingface has nothing to do with that either way.
breakyerself•40m ago