Our capacity for psychological projection of our unconscious desires onto inanimate objects is quite amazing. Given what is possible in terms of projection onto things as random as Ouija boards, tealeaves or Tarot cards, I'm surprised this sort of thing isn't more common with LLMs that sound just like conscious beings.

It's just a matter of time before one of these vulnerable individuals kills a whole bunch of people because the machine told them to.

“It started talking differently than it normally did,”

This sounds like the sycophant version OpenAI retracted. https://openai.com/index/sycophancy-in-gpt-4o/

We joke about this now but all it would take is a developer or LLM operator with a dark sense of humor to trigger violent or self harming reactions in people that are already unstable.

The “talking different” aspect after the new OpenAI voice update is hilarious.

I used to reach my daily talk limit occasionally chatting about encyclopedic tech stuff, now the voice sounds stoned so I just show the kids and we laugh.