frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Springer Nature book on machine learning is full of made-up citations

https://retractionwatch.com/2025/06/30/springer-nature-book-on-machine-learning-is-full-of-made-up-citations/
104•ArmageddonIt•8h ago

Comments

veltas•7h ago
Unfortunately not surprising, the quality of a lot of textbooks has been bad for a long time. Students aren't discerning and lecturers often don't try the book out themselves.
gammalost•7h ago
I agree. I feel that Springer is not doing enough to uphold their reputation. One example of this being a book on RL that I found[1]. It is clear that no one seriously reviewed the content of this book. They are, despite its clear flaws charging 50+ euro.

https://link.springer.com/book/10.1007/978-3-031-37345-9

WillAdams•5h ago
Yeah, ages ago, when I was doing typesetting, it was disheartening how unaware authors were of the state of things in the fields which they were writing about --- I'm still annoyed that when I pointed out that an article in an "encyclopedia" on the history of spreadsheets failed to mention Javelin or Lotus Improv it was not updated to include those notable examples.

Magazines are even worse --- David Pogue claimed Steve Jobs used Windows 95 on a ThinkPad in one of his columns, when a moment's reflection, and a check of the approved models list at NeXT would have made it obvious it was running NeXTstep.

Even books aren't immune, a recent book on a tool cabinet held up as an example of perfection:

https://lostartpress.com/products/virtuoso

mis-spells H.O. Studley's name on the inside front cover "Henery" as well as making many other typos, myriad bad breaks, pedestrian typesetting which poorly presents numbers and dimensions (failing to use the multiplication symbol or primes) and that they are unwilling to fix a duplicated photo is enshrined in the excerpt which they publish online:

https://blog.lostartpress.com/wp-content/uploads/2016/10/vir...

where what should be photo of an iconic pair of jewelers pliers on pg. 70 is replaced with that of a pair of flat pliers from pg. 142. (any reputable publisher would have done a cancel and fixed that)

Sturgeon's Law, 90% of everything is crap, and I would be a far less grey, and far younger person if I had back all the time and energy I spent fixing files mangled by Adobe Illustrator, or where the wrong typesetting tool was used for the job (the six-weeks re-setting the book re-set by the vendor in Quark XPress when it needed to be in LaTeX was the longest of my life).

EDIT: by extension, I guess it's now 90% of everything is AI-generated crap, 90% of what's left is traditional crap, leaving 1% of worthwhile stuff.

cess11•3h ago
What reputation would that be?

It was, in part, Springer that enabled Robert Maxwell.

antegamisou•4h ago
Understandably I'm becoming a bit dogmatic but I'll say it again, AIMA/PRML/ESL are still the best reference textbooks for foundational AI/ML and will be for a long time.

AIMA is Artificial Intelligence: A Modern Approach by Stuart Russell and Peter Norvig

PRML is Pattern Recognition and Machine Learning by Christopher Bishop.

ESL is Elements of Statistical Learning by Trevor Hastie, Robert Tibshirani and Jerome Friedman.

ludicrousdispla•7h ago
>> LLM-generated citations might look legitimate, but the content of the citations might be fabricated.

Friendy reminder that the entire output from an LLM is fabricated.

amelius•6h ago
Fabricate is a word with ambiguous meaning. It can mean both "make up", but also simply "produce".
dwayne_dibley•5h ago
I fabricated this reply out of my brain.
ktallett•4h ago
I think in this situation both meanings are needing to be used. It produced made up content.
xg15•5h ago
Technically yes, but not all of it has lost grounding with reality?
mapleoin•5h ago
You could say that about Alice in Wonderland.
bryanrasmussen•4h ago
probably a better word here would be fabulated.

on edit: that is to say the content of the citations might be fabulated, while the rest is merely fabricated.

leereeves•4h ago
I didn't realize "fabulated" was a word. TIL, thank you. But in this case it doesn't sound like the right word; it means: "To tell invented stories, often those that involve fantasy, such as fables."

I think "confabulated" is more appropriate: "To fill in gaps in one's memory with fabrications that one believes to be facts."

techas•7h ago
I saw this recently on some congress abstracts. I think it is just AI generated content. References look real and don’t exist.
PicassoCTs•7h ago
To imagine this driving a singularity, meanwhile its putting the final nail in science, together with paper-spam and research-reward decline. They are going to hang us tech-priests from the lamp-posts when the consequences of this bullshit artistry hit home.
haffi112•7h ago
You would think that Springer did the due diligence here, but what is the value of a brand such as Springer if they let these AI slops through their cracks?

This is an opportunity for brands to sell verifiability, i.e., that the content they are selling has been properly vetted, which was obviously not the case here.

cess11•5h ago
Why would one think that? All of the big journal publishers have had paper millers and fraudsters and endless amounts of "tortured phrases" under their names for a long, long time.
WillAdams•5h ago
Back when I was doing academic publishing I'd use a regex to find all the hyperlinks, then a script (written by a co-worker, thanks again Dan!) to determine if they were working or no.

A similar approach should work w/ a DOI.

RossBencina•4h ago
In the past I've had GPT4 output references with valid DOIs. Problem was the DOIs were for completely different (and unrelated) works. So you'd need to retrieve the canonical title and authors for the DOI and cross check it.
thoroughburro•3h ago
And then make sure the arguments and evidence it presents are as the LLM represented them to be.
cyclecycle•1h ago
A classic case.

I work on Veracity https://groundedai.company/veracity/ which does citation checking for academic publishers. I see stuff like this all the time in paper submissions. Publishers are inundated

bumby•2h ago
Not all journals require a DOI link for each reference. Most good ones do seem to have a system to verify the reference exists and is complete; I assume there’s some automation to that process but I’d love to hear from journal editorial staff if that’s really the case.
Vinayak_A_B•6h ago
If I make a citation verifier, will conference/journal guys pay for it? First verify if the citation is legit, like the paper actually exists, after that another LLM that reads the paper cited and gives a rating out of 10, whether it fits the context or not. [ONLY FOR LIT SURVEY]
SiempreViernes•5h ago
No, they aren't paying the reviewers in the first place.
codewench•3h ago
So given that the output of an LLM is unreliable at best, your plan is to verify that a LLM didn't bullshit you by asking another LLM?

That sounds... counterproductive

thoroughburro•3h ago
You’re offering to doublecheck measurements made with a bad ruler by using that same ruler.
PeterStuer•2h ago
Given that the existence of a reference is fairly trivial to check, I'd wager the authors would not care enough to pay for this. As for 'fit', this is very much in the eye of the beholder and a paper can be cited for the most trivial part. Overcitation is usually not seen as a problem. Omitting citations the reviewer considers 'essential', often from their own lab or circles, is seen as non-negotiability.

So the better 'idea' would be to produce a CYA citation assistant that for a given paper adds all the remotely plausible references for all the known potential reviewers of a journal or conference. I honestly think this is not a hard problem, but doubt even that can be commercialized beyond Google Ads monetization.

amelius•6h ago
So was the entire text machine-generated?

Or did they take a human-written text and asked a machine to generate references/citations for it?

passwordoops•5h ago
Why would anyone write a book then ask for citations?
amelius•5h ago
Because collecting/formatting citations is not the most fun part of the writing process (?)

And maybe the authors were over-confident in the capabilities of current AI.

ktallett•4h ago
Many write and then find citations to fit what they said rather than write based on what citable sources suggest
zero_k•5h ago
Springer? You mean the publisher we are currently fighting so they won't mess up our peer-reviewed research paper that we wrote and paid for the privilege for them to mess up (ehm, sorry "publish")? Colour me surprised.
dandanua•5h ago
We are approaching publishers' heaven, where AI reviewers review AI written books and articles (with AI editors fixing their style), allowing publishers to keep collecting billions from essentially mandatory subscriptions from institutions.
flohofwoe•5h ago
It's fine, because human readers will also be replaced with AI which produce a quick summary ;)
dwayne_dibley•5h ago
'Based on a tip from a reader, we checked 18 of the 46 citations in the book.' Why not just check them all?
maweki•5h ago
They didn't just click a link. They contacted the supposed authors for comment. That would be a reason for not checking all of them.
b00ty4breakfast•4h ago
This seems like the very thing that AI advocates would want to avoid. It certainly doesn't fill me, as an outsider to the whole thing, with much confidence for the future of AI-generated content but maybe I'm not the target sucker....err, I mean target demographic
Isamu•4h ago
One of the potential uses of AI that I have most wanted is automated citation lookup and validation.

First check if the citation references a real thing. Then actually read and summarize the referenced text and give a confidence level that it says what was claimed.

But no, we have AI that are compounding the problem. That says something about unaligned incentives.

pyrale•2h ago
> One of the potential uses of AI that I have most wanted is automated citation lookup and validation.

Also one of the things AI is likely the least suited for.

best I could imagine an AI can do is offer sources for you to check for a given citation.

Isamu•1h ago
>Also one of the things AI is likely the least suited for.

I agree, if we are using the current idea of AI as language models.

But that’s very limiting. I’m old enough to remember when AI meant everything a human could do. Not just some subset that is being deceptively marketed as potentially the whole thing.

misja111•4h ago
"He (the author) did not answer our questions asking if he used an LLM to generate text for the book. However, he told us, “reliably determining whether content (or an issue) is AI generated remains a challenge, as even human-written text can appear ‘AI-like.’ This challenge is only expected to grow, as LLMs … continue to advance in fluency and sophistication.”

Lol, that answer sounds suspiciously much like LLM generated as well ..

DebtDeflation•3h ago
It's true that "AI detection algorithms" are not particularly reliable.

It's also true that if you have fake CITATIONS in your works that such algorithms aren't necessary to know the work is trash - either it was written by AI or you knowingly faked your research and it doesn't really matter which.

MengerSponge•3h ago
My "Plagiarism Machine #1 Fan" shirt has people asking a lot of questions already answered by my shirt.
PeterStuer•3h ago
Would it be possible to 'squat' the non existent references and turbo boost oneself into 'most cited author' territory? :)
MarlonPro•1h ago
Bad news for old-school people who still love books as a learning resource.

Soulful Machine: A Loopy Conversation with Chet

https://slow-thoughts.com/soulful-machine/
1•LearningToWalk•29s ago•0 comments

Nvidia becomes the first company to reach $4T in value

https://apnews.com/article/nvidia-4-trillion-chipmaker-7947e86a7ee9a994b9f16c3c0779b74f
1•gfortaine•6m ago•0 comments

Explaining assembly by playing SHENZHEN I/O [video]

https://www.youtube.com/watch?v=zycRrVS3NLc
1•aragonite•6m ago•0 comments

Is This Possible

1•terabaapmrtv•8m ago•0 comments

Browser Agents Love Graphs

https://asteroid.ai/blog/graph-powered-browser-agents
1•epi3•8m ago•0 comments

Fine-tuning NeoBERT for a multi-class text classification

https://eamag.me/2025/NeoBERT-Fine-Tuning
1•eamag•8m ago•0 comments

What's your experience using Lynx (mobile framework)?

2•isntThatSth•9m ago•0 comments

Ask HN: How do some platforms legally play copyrighted music?

1•absoluteunit1•9m ago•2 comments

Show HN: CreateMyBanner – AI-generated banners for social media

https://www.createmybanner.com/
1•ddoemonn•10m ago•0 comments

Retconning 'Russiagate': The CIA director encourages the rewriting of history

https://www.lawfaremedia.org/article/retconning--russiagate
2•nabla9•10m ago•0 comments

IBM Power11 Raises the Bar for Enterprise IT

https://newsroom.ibm.com/2025-07-08-ibm-power11-raises-the-bar-for-enterprise-it
1•doener•10m ago•1 comments

Comet Browser by Perplexity

https://comet.perplexity.ai/
1•RobinL•11m ago•1 comments

I still care about the code

https://martinfowler.com/articles/exploring-gen-ai/i-still-care-about-the-code.html
2•zdw•11m ago•0 comments

Design Considerations for an Anthropophilic Computer

https://web.stanford.edu/dept/SUL/sites/mac/primary/docs/bom/anthrophilic.html
1•chaosmachine•13m ago•0 comments

These People Believe They Made AI Sentient [video]

https://www.youtube.com/watch?v=sWZRQsejtfA
1•jackdoe•15m ago•0 comments

How (and why) to be a good customer

https://blog.abolyn.com/p/how-and-why-to-be-a-good-customer
1•aranibatta•16m ago•1 comments

Large Language Models as Autonomous Spacecraft Operators in Kerbal Space Program

https://arxiv.org/abs/2505.19896
2•Bluestein•16m ago•0 comments

Monorail: Pioneering $999 PCs from 1996

https://dfarq.homeip.net/monorail-the-pioneering-999-pc-from-1996/
1•zdw•19m ago•0 comments

Linda Yaccarino departs as boss of Musk's X

https://www.bbc.co.uk/news/articles/cx2gy3j9xq6o
1•Angostura•20m ago•0 comments

IBM Power11 Launched with Up to 2048 Threads and Ddimm Support

https://www.servethehome.com/ibm-power11-launched-with-up-to-2048-threads-and-ddimm-support/
1•rbanffy•23m ago•0 comments

Physicists Found the Ghost Haunting the Most Famous Particle Accelerator

https://www.popularmechanics.com/science/a65299485/physicists-find-ghost-haunting-most-famous-particle-accelerator/
2•Bluestein•25m ago•0 comments

Surprise Hair Loss Breakthrough: DNA Sugar Gel Triggers Robust Regrowth

https://www.sciencealert.com/surprise-hair-loss-breakthrough-dna-sugar-gel-triggers-robust-regrowth
2•amelius•27m ago•2 comments

Show HN: PastelPaste – A Minimal and Modern Pastebin Written in Rust

https://github.com/ni5arga/pastelpaste
1•ni5arga•28m ago•0 comments

Show HN: Mogg

https://mogg-brown.vercel.app/
1•Looksmaxxer•30m ago•0 comments

Nuclear Waste Reprocessing Gains Momentum in the U.S.

https://spectrum.ieee.org/nuclear-waste-reprocessing-transmutation
1•rbanffy•31m ago•0 comments

'Tactless': Brewing Resentments over Bank of Mum and Dad

https://www.telegraph.co.uk/money/property/buying-selling/resentment-brewing-friendship-groups-bank-of-mum-dad/
1•llimos•31m ago•0 comments

Stick-on monitor promises smarter, more accurate detection of sleep disorders

https://medicalxpress.com/news/2025-06-smarter-accurate-disorders.html
1•PaulHoule•32m ago•0 comments

Show HN: PromptDrifter – Catch LLM prompt drift before it breaks prod

https://github.com/Code-and-Sorts/PromptDrifter
2•feynmanquest•32m ago•1 comments

'It's been hell': Amazon packages mistakenly sent to SJ woman's home

https://abc7news.com/post/huge-pile-amazon-packages-fills-bay-area-womans-driveway-third-party-seller-uses-home-address-returns/17022284/
3•randycupertino•33m ago•3 comments

A chemical language model for molecular taste prediction

https://www.nature.com/articles/s41538-025-00474-z
2•yz-exodao•34m ago•0 comments