frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Ask HN: Does anyone have scans of these missing PC Plus issues (1991–1993)?

59•billpg•1w ago•16 comments

Publishing desktop apps via HTML5 canvas

2•string-theory•1h ago•1 comments

Ask HN: Our AWS account got compromised after their outage

391•kinj28•1d ago•94 comments

Ask HN: Can you recreate/restore deleted text messages on an iPhone/Android?

4•danielovichdk•50m ago•0 comments

Ask HN: How many 9s did AWS lose due to the last outage (us-east-1 incident)?

5•2dvisio•4h ago•1 comments

Ask HN: Am I the only one not using AI?

10•acqbu•6h ago•13 comments

Ask HN: Best practices for research code?

11•Eugeleo•14h ago•3 comments

Ask HN: Any good books for a layman on history of quantum computing?

19•bmau5•22h ago•6 comments

Ask HN: Would you like some help with your OSS project?

5•seph-reed•9h ago•4 comments

The First Data-Driven Platform That Makes Hosting Comparisons Fair

2•Hostingmoz•11h ago•4 comments

Ask HN: How to stop an AWS bot sending 2B requests/month?

285•lgats•6d ago•181 comments

Ask HN: What are people doing to get off of VMware?

194•jwithington•3d ago•164 comments

Why do LMMs overuse these patterns of speech that aren't overused in the wild?

7•jimbo808•22h ago•16 comments

Ask HN: End-to-end encrypted LLM chat (open- and closed-model)

3•5F7bGnd6fWJ66xN•17h ago•1 comments

MySQL Release Engineering PGP Key for Apt Repos Has Expired

6•scblzn•19h ago•5 comments

Ask HN: Preferred Next.js Alternatives?

2•blinkbat•21h ago•7 comments

Anyone built an email or calendar assistant that syncs and indexes data?

5•Bahushruth•22h ago•8 comments

Did people in the 90s worry about the efficiency of the internet

12•burgiee•1d ago•15 comments

Tell HN: Copilot.microsoft.com redirect to m365.cloud.microsoft, chats gone

7•eitland•1d ago•1 comments

Ask HN: How does one build large front end apps without a framework like React?

107•thepianodan•6d ago•187 comments

Programming language agnosticism is the only way to move forward in life

33•amano-kenji•4d ago•21 comments

Ask HN: What are you working on? (October 2025)

347•david927•1w ago•1054 comments

Ask HN: Are you / should we be preparing for "cyberattack"

4•lifeisstillgood•1d ago•4 comments

Ask HN: How do you convince people to use privacy respecting technologies

12•bogomil•1d ago•12 comments

Ask HN: What failed in the AWS outage that should have worked offline?

12•cipz•1d ago•3 comments

HTTP error codes illustrated with stills from Columbo

9•ColinWright•1d ago•5 comments

Ask HN: Abandoned/dead projects you think died before their time and why?

363•ofalkaed•1w ago•891 comments

Ask HN: Why is Bowker's monopoly on ISBNs in the USA legal?

19•blindprogrammer•3d ago•12 comments

You've reached the end!

Open in hackernews

Why do LMMs overuse these patterns of speech that aren't overused in the wild?

7•jimbo808•22h ago
Here's a quote:

> "That’s not neuroscience — that’s cargo-cult reasoning wrapped in academic buzzwords."

I think most of us who use ChatGPT would immediately recognize this as being AI-generated. It's perfectly valid English and we could all imagine a real human saying it, but ChatGPT (or maybe LLMs more broadly) seem to have landed on certain patterns like this one that they use constantly. Is it some kind of overfitting? Post training where a biased toward this pattern was introduced? Something else?

Comments

A_D_E_P_T•22h ago
"It's not X, it's Y" (or "it's not just X, it's Y") is one of the most common tells, but there are many others. Here's a partial list:

> https://en.wikipedia.org/wiki/Wikipedia:Signs_of_AI_writing

It's definitely post-training bias and reinforcement. This rhetorical structure isn't too common IRL. (Or wasn't, anyway, prior to LLMs...)

incomingpain•22h ago
the way they train the models is feeding it lots and lots of literature, and usually high quality.

The way they write by default is thus going to be this weird hybrid of all english styles/dialects from the last ~500 years.

The reason they are heavy with em dashes is that they were immensely popular in literature for a long time but not so much in modern times. So it stands out.

If you tell it to write in a specific way though, it does a good job at it.

Here's detroit english, no messin' around. The reason why AI's love the em dash so much is simple: it’s the most versatile and natural punctuation mark they can use to connect ideas and maintain flow. A large language model's primary goal is to sound human, and when people speak, they often pause, clarify, or insert a quick side-thought the dash captures that conversational stop-and-start rhythm better than a rigid comma or a full-stop period. Plus, in the enormous amount of text the AI studies (its data), the em dash is frequently used by skilled writers as an efficient tool to replace colons, parentheses, or strong commas, so the AI simply picked up that effective writing pattern and runs with it, seeing it as the clearest and most dynamic way to structure complex sentences. That's the real deal.

whycome•22h ago
I used to use the em dash a lot. I refrain from doing it now. I hate that outcome.
incomingpain•22h ago
>I used to use the em dash a lot. I refrain from doing it now. I hate that outcome.

I dont think it ever got taught in my schooling; the semi-colon is what they taught to use.

JohnFen•21h ago
I refuse to let genAI determine what my writing style should be on principle. I may not be able to do much about the rest of the various degradations genAI brings, but I can at least stand my ground when it comes to my personal expression.
gooodvibes•20h ago
This isn’t accurate - most of the style comes from the fine tuning and reinforcement learning, not from the original training data.

At some point people got this idea that LLMs just repeat or imitate their training data, and that’s completely false for today’s models.

bediger4000•19h ago
So LLMs have gotten creativity recently?
gooodvibes•17h ago
No, my point has nothing to do with creativity. It's about the fact that their output is taylored to look and sound in a certain way in the later stages of model training, it's not representative of the original text data the base model was trained on.
idonotknowwhy•17h ago
Agreed. The pre-2025 base models don't write like this.
incomingpain•3h ago
>This isn’t accurate - most of the style comes from the fine tuning and reinforcement learning, not from the original training data.

Fine tuning, reinforcement, etc are all 'training' in my books. Perhaps this is your confusion over 'people got this idea'

gooodvibes•41m ago
> Fine tuning, reinforcement, etc are all 'training' in my books.

They are but they have nothing to do with how frequent anything is in literature which was your main point.

jotux•18h ago
I read some articles when openai was first getting popular about them using cheap labor from English-speaking African countries (like Kenya): https://news.ycombinator.com/item?id=34426421

I remember other articles specifically talking about English language features of those regions(like "Okay" instead of "OK") getting into LLMs because of this.

teunlao•18h ago
Humans cut the phrase to avoid sounding like AI. AI copied it because humans used it. Style collapsed into feedback loop.
muzani•14h ago
ChatGPT seems to use this most often. Claude uses similar data and training and has similar patterns.

Gemini doesn't yet seem to have a consistent pattern, but it's quite different, and honestly, I find it even more disturbing; Gemini Flash is like chatting with an intelligent 9 year old. Grok feels unnaturally chirpy to me.

fogzen•10h ago
I wonder if it's intentional so that they can identify their model output in the wild using stylometry.
raw_anon_1111•3h ago
I recently re-read parts of this book thst I haven’t read in years.

https://github.com/97-things/97-things-every-programmer-shou...

I think it originally came out in 2013. If I were just introduced to it today, I would think some of the articles were AI written with only slight prompting.

It’s sad that if I write something from scratch, without any writing assistance besides spell checking, mostly for internal company consumption I now review it to see if it smells like AI.

(Just like I would have used a dash above. But I don’t anymore because it has an AI smell and I had to get out of the habit)