frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Detecting LLM-Generated Texts with “Classical” Machine Learning

https://blog.lyc8503.net/en/post/llm-classifier/
46•uneven9434•1h ago

Comments

cyanydeez•1h ago
today, sure.

Tomorrow, the LLMs will be training the humans thought patterns that will directly start skewing their natural writing.

Generation alpha is going to have a lot of trouble if we keep perpetuating the myth that you can really interpret text in an ongoing fashion.

unfocso•1h ago
I had done the same for classifying and generating bookmarks of thousands of datasheets, along with a very naive yolo-based classificator (to detect pages made out of diagrams and pictures mostly).

Done with GLM-OCR, I had to watch text sloooowly crawl out of the llm and still have to live with hallucinations and the model not following the schema

Krssst•1h ago
The classifier does not seem so big, I wonder if something like it for English could be used in a browser extension to run against every single paragraph being displayed ?

If the internet is going to drown in LLM text it would be nice to have tools to detect that automatically just like we have adblockers today to avoid wasting time on ads.

(the article was a good read, thanks!)

xiaoyu2006•56m ago
I assume different models will have different distribution, so it has to be kept updated?
Krssst•50m ago
The article mentions that AI texts are often caught by multiple models, so hopefully text from newer LLMs could still be caught without updating the model?
aberoham•51m ago
I wonder about this technique vs simple SVM classifiers: https://x.com/rosmine/status/2056406399471558872?s=20
akersten•49m ago
Text is simply not information dense enough to be able to decode some arbitrary signal of provenance from it. Sure you might be able to detect today's tells (particular sentence structures preferred by Claude, phrases, etc) to get you some arbitrary chance percentage it was machine generated, but it's a bad fiction to perpetuate that any of this is anything more than tarot card reading.

Images, absolutely, there are tell-tale artifacts from today's generators that simply aren't emitted by "natural" paths to create them, and you can "detect AI" with high confidence (for now). Words, no, the signal is far too sparse and we are well into undetectable sophistication with today's models, let alone tomorrow's.

jgalt212•41m ago
It depends on how much text. For example, chardet often falls down on short strings, but 1K characters it nails it.
stymaar•36m ago
> but it's a bad fiction to perpetuate that any of this is anything more than tarot card reading.

Hard disagree. LLMs (especially base ones, that only received pre-training) can produce output that is undistinguishable from human writing (because that's what they were trained to do).

But commercial chat models are specifically tuned in a way that maximizes user engagement. It's that specific tuning that is very easy to spot when reading AI slop, and that's not surprising that it's easy to spot automatically either. And I don't think that's going to change anytime soon, unless their incentives change.

(We can say exactly the same thing about man-made stuff optimized for a specific purpose, like stock photography, clickbait titles or industrial food: they aren't stereotypical because their creator lacks the skill to make them otherwise, they are like that because that's what works best).

empath75•33m ago
XiphiasX•44m ago
Anything too “clever” and “snappy” = instaLLM
teeray•35m ago
The problems are simply too great if an LLM detector has any false positives at all. Imagine how soul-crushing writing an entire dissertation by hand and having it rejected because some “good enough” LLM detector decides you write too much like an AI.
gleenn•26m ago
I think the fundamental problem is that training current SOTA AI models is very expensive. If a simple "classical" model can detect them, presumably at much lower algorithmic cost, then why wouldn't the model trainers use these same tools to feed back into their models to improve them at low cost to make them better? It's an arms race. Any cheap pattern can and presumably will be used to retrain if it becomes and effective way to catch AI.
It does mean that this will have a drift problem if it's just trained on the idiosyncrasies of model fine tuning. That's fine! But it is something to be aware of.
ravenstine•10m ago
They're also designed to not offend anybody, so their output tends to be very bland even compared to the most milquetoast of human beings. I was only surprised once when ChatGPT responded with an enthusiastic "hell yes" seemingly organically, but 99.9% of the time these AI services clearly are instructed and trained to provide flavorless word vomit. I don't think there's a technical reason why an LLM couldn't produce totally convincing output, but internet grifters don't need to go through that trouble. It's like how most phone, email, and social media scams come off as completely transparent to most of us, but that's the whole point; we're not the target audience of the scams. Readers looking for substance, nuance, and real opinions aren't going to notice if something with written by an LLM – unless there are some cliche punctuation tells.
zmjone2992•10m ago
i think one thing overlooked by this perspective is that many of a detectors adversaries are not that sophisticated. so despite this i think it is a useful thing to try to do. particularly when people are trying to do fraud which will often having to use abliterated models and generally trying to be as economical in their efforts
cyanydeez•5m ago
Sure it is; we do it all the time, and then we modify each other's etc, etc; english we speak today was spoke yesterday waspake the same in yesteryears; we have no trouble dating english or other languages to a time.

A better argument is people themselves are just too influenced by reading that they'll sound like LLMs in a couple of years.

Nintendo Switch Joy-Con Removable Battery Replacement Procedure

https://www.nintendo.com/en-gb/Support/Troubleshooting/Battery-replacement/Joy-Con-L-HAC-015-01-B...
1•haunter•1m ago•0 comments

Please Stop Making Me Opt Out of AI

https://www.wired.com/story/please-stop-making-me-opt-out-of-ai/
1•Brajeshwar•1m ago•0 comments

MergeStat: Query your Git repo with SQL

https://www.mergestat.com/
1•nvahalik•1m ago•0 comments

Young Drivers Are Going 'Psycho' on the Road–and Filming It

https://www.wsj.com/tech/personal-tech/dash-cams-drivers-tiktok-3101b404
1•bookofjoe•2m ago•1 comments

CLR: Checker of Lifetimes and other Refinement types for Zig

https://github.com/ityonemo/clr/
2•lioeters•3m ago•0 comments

SPCX is now Wall Street's most shorted new stock

https://invezz.com/news/2026/07/16/the-worlds-most-valuable-ipo-spcx-is-now-wall-streets-most-sho...
2•lbrito•3m ago•0 comments

Minefield Quiz: Countries of the World with No Borders

https://brilliantmaps.com/world-minefield-game/
1•Kaibeezy•5m ago•0 comments

Pricklypear: Vibeslop Interpreted Lisp with Postgres AST, Written in OCaml

https://pricklypear.rocks/welcome
1•sroerick•9m ago•1 comments

React Native in 2026

https://ben3d.ca/blog/react-native-in-2026
2•bhouston•9m ago•0 comments

Show HN: easy-tz – A fast, 10KB, dependency-free getTimeZonesAt(timestamp)

https://github.com/leeoniya/easy-tz
2•leeoniya•11m ago•0 comments

OneCommander: Modern File Manager for Windows 11 and 10

https://onecommander.com/
2•thunderbong•12m ago•0 comments

Switzerland turned its train tracks into solar power plants

https://www.goodgoodgood.co/articles/switzerland-train-tracks-solar-panels
2•MaysonL•12m ago•0 comments

Show HN: A Claude Code skill that finds dev tools – or stays silent

https://github.com/jaimeramiro-dev/gold-digger
1•jaimeramiro•13m ago•0 comments

Kbd-1.0-Codex-Micro

https://twitter.com/OpenAIDevs/status/2077425991790870644
1•sanj•13m ago•0 comments

Can AI reliably generate dashboards from Excel or CSV files?

https://dashboardbuilder.net/ai-generated-dashboard
1•Garywilson76•15m ago•0 comments

Choosing GPT-5.6 Sol, Terra, or Luna in Codex

https://twitter.com/pvncher/status/2077708372363624894
1•pretext•15m ago•0 comments

Show HN: Pagora AI, WordPress AI page builder that outputs plain HTML/CSS/JS

https://wordpress.org/plugins/pagora-ai/
1•azertyvode•15m ago•0 comments

Show HN: MechArchive – an open, sourced catalog of the robots

https://mecharchive.com/
1•filippogroppi•16m ago•0 comments

The Moment Steven Bartlett Realizes His Podcast Is Compromised [video]

https://www.youtube.com/watch?v=NA8Zf7NSHF0
2•Bender•17m ago•1 comments

Capture Clauses as Effects

https://blog.yoshuawuyts.com/capture-clauses-as-effects/
1•ambigious7777•17m ago•0 comments

Why standard time is better for your health than daylight saving time

https://www.washingtonpost.com/wellness/2026/07/16/why-standard-time-is-better-your-health-than-d...
2•jonah•17m ago•1 comments

AI chatbots are at risk of spreading government restrictions on online speech

https://www.msn.com/en-us/news/world/ai-chatbots-are-at-risk-of-spreading-government-restrictions...
2•galaxyLogic•18m ago•0 comments

Two things every MCP author should add

https://twitter.com/owjuhl/status/2077747945659646233
2•owjuhl•18m ago•0 comments

Under-16s to be banned from buying energy drinks

https://news.sky.com/story/under-16s-to-be-banned-from-buying-energy-drinks-13564058
3•austinallegro•20m ago•1 comments

Claudeisms: A list of words Claude Code overuses

https://github.com/archiewood/claudeisms
1•archiewood•20m ago•0 comments

Show HN: FilesFlow – Browser-based PDF and image tools that run locally

https://filesflow.net/
1•blert•20m ago•0 comments

Why people chasing after useless token saving plugins and ignoring real solution

1•yohji1984•20m ago•0 comments

German AI consortium releases Soofi S, an open 30B model that tops benchmarks

https://the-decoder.com/german-ai-consortium-releases-soofi-s-an-open-30b-model-that-tops-benchma...
7•amai•22m ago•0 comments

The Hunt for the Counterfeiter Trying to Make the Perfect Bill

https://www.nytimes.com/2026/07/16/magazine/counterfeit-dollars.html
2•paulpauper•22m ago•0 comments

Funding Canonical Visions //GMs

https://amazing-lantern-c21.notion.site/Funding-canonical-visions-GMs-396adeecc3dc804ab012f015f3b...
1•paulpauper•23m ago•0 comments