frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Ask HN: I Need Advice

4•TuxedoBuddy•2h ago•10 comments

Ask HN: Why big LLMs use "it's not A, it is B" pattern? Shared dataset supplier?

5•jumasheff•3h ago•3 comments

Ask HN: What do you believe or not believe about AI?

20•maniac_2000•23h ago•38 comments

Tell HN: I know Firefox has update when it starts to glitch

2•majkinetor•16h ago•3 comments

Ask HN: Why is pagination gone on "Ask HN", and showing only 19 items?

7•bigwheels•12h ago•3 comments

Expericencing an issue in Gmail where emails do not delete in Firefox

9•rc_kas•1d ago•4 comments

Ask HN: Do you still read clean code and software architecture books?

18•pelcg•2d ago•8 comments

Ask HN: Is it not possible to enroll for Apple Developer anymore?

32•olalonde•3d ago•17 comments

Old.reddit.com Gone

22•Balgair•17h ago•18 comments

Slow Cloudflare Connections

3•bryonyoni•1d ago•3 comments

DietPi v10.8 has been released

17•stephanstsdietp•1d ago•0 comments

Ask HN: T'was the night of Claude Reset and quota left: Funniest app you built?

10•julianpye•1d ago•4 comments

Ask HN: Can we do something about this impending AI dystopia

7•justforfunhere•1d ago•13 comments

Ask HN: Why Is Anthropic's Customer Support Bad?

4•tj-teej•2d ago•8 comments

Ask HN: We tax labour, why not tax AI?

7•roschdal•11h ago•5 comments

Is AI just another get rich quick scheme?

18•jqpabc123•4d ago•29 comments

What to do if you discover AI models trained using your copywrighted book?

16•andrea81•2d ago•8 comments

Ask HN: What are your career plans in the age of AI?

13•akudha•2d ago•22 comments

Ask HN: How do you grow OSS projects?

6•tarasyarema•2d ago•15 comments

Ask HN: Are tab completion models dead?

22•sandruso•3d ago•17 comments

Ask HN: Kimi Code hit its 5-hour limit after $1.37 of API usage

9•waximabbax•4d ago•4 comments

Necro-Economics Eyal Weizman

6•abdelhousni•1d ago•0 comments

Ask HN: How fast is your CI these days?

8•easterncalculus•3d ago•7 comments

Took apart Claude Code, then turned it into a free course on harness engineering

11•pauliusztin•4d ago•0 comments

Ask HN: Mined crypto on Azure when I was 13, after 12y still cannot open account

7•realaccfromPL•3d ago•2 comments

I'm creating my own OS, check it out, LimonOs no Unix no Linux

5•Drfoxi•3d ago•4 comments

You've reached the end!

Open in hackernews

Ask HN: Why big LLMs use "it's not A, it is B" pattern? Shared dataset supplier?

5•jumasheff•3h ago

Comments

1broseidon•3h ago
Primarily training data. A lot of times it’s a hedge to show two things and let the user decide which fits their framing best

Most of the large models collected data from marketing speak, opinion posts, etc (the whole internet basically). I feel like it’s a common sales pitch I’ve heard many times over - now it’s just compounded with everyone having access to the same pattern generator clanker

byoung2•3h ago
Remember in Jurassic Park where the dinosaur DNA was extracted from mosquitoes trapped in amber? That wasn't necessarily the best DNA, just the easiest to extract. The best writing might be love letters or high school term papers or PRDs meant for internal distribution, and these never get put online to be fed into LLM training sets. Instead we have 20 years of StackOverflow and Reddit posts saying "it's not a bug, it's a feature" or "Die Hard isn't an action flick, it's a Christmas movie" with 10k upvotes and LLMs learned that's how you get the biggest reaction with the least amount of words. It's not a bug, it's a...you get the point
jumasheff•45m ago
Got it. Sigh... I wonder how these arguably extra tokens affect GPU utilization. So much waste!