frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Ask HN: What's the best hackable smart TV?

41•xrd•4d ago•41 comments

How can newbies make proper use of AI and still be good developers?

4•Doublentender•1h ago•1 comments

Lost all my sites overnight: Vercel terminated my account without notice

2•hikerell•2h ago•4 comments

Ask HN: How are founders finding investors without warm intros in 2025?

2•paulwilsonn•4h ago•4 comments

Looking for 5 B2C startups or agencies to pilot next-gen product discovery

2•AdityaBuilds•6h ago•1 comments

Ask HN: Build Your Own LLM?

5•retube•6h ago•7 comments

Ask HN: What do you think of web-components?

4•jerawaj740•1h ago•0 comments

Ask HN: Does anyone want to take on the payment processing networks with me?

10•ziyadparekh•22h ago•8 comments

Ask HN: Anyone using Cursor/Claude Code for non-coding workflows?

4•opuslabs•1d ago•2 comments

Ask HN: Most effective way to reduce excessive digital media consumption?

14•SeanAnderson•1d ago•35 comments

Ask HN: How to find a non-technical co-founder/sales person?

8•darkhorse13•1d ago•12 comments

GitHub Actions seem to be down

8•arbol•1d ago•1 comments

Ask HN: Why aren't wet labs more automated?

5•andrewrn•1d ago•7 comments

Ask HN: Any advice on pivoting out of VC-backed tech?

87•AbstractH24•4d ago•60 comments

Ask HN: Low entry barrier hobby that can potentially generate income?

8•shivajikobardan•1d ago•13 comments

Ask HN: Great Firewall in Iran?

10•minebreaker•2d ago•13 comments

Ask HN: Why is software quality collapsing?

70•razoorka•6d ago•112 comments

Ask HN: Do you roll your own agent or use a framework?

11•break_the_bank•3d ago•7 comments

Ask HN: Why did COM/SOAP/other protocols fail?

26•smj-edison•1w ago•56 comments

Ask HN: What do you wish existed? (October 2025)

13•pwlm•3d ago•19 comments

From Docker Desktop (300% CPU) to Colima and Portainer (0.2%) on macOS

11•muthuishere•4d ago•1 comments

Ask HN: Career Burnout Looking for Options

21•ultrasounder•3d ago•26 comments

You've reached the end!

Open in hackernews

Ask HN: Build Your Own LLM?

5•retube•6h ago
The best way to really understand how something works is to build it yourself. So I am wondering if there are any good tutorials on building your own LLM from scratch. I.e. implementing tokenisation, embeddings, attention and so on. I am not suggesting one could replicate chatGPT, but more a toy model that implements the core features but based on a much smaller corpus and training data.

Comments

2ro•6h ago
How about this?

https://mathstodon.xyz/@empty/115088095028020763

retube•5h ago
thanks
pm2222•5h ago
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp...
retube•5h ago
thanks. looks potential
ryanchants•17m ago
I'd get it straight from Manning and save a few bucks and take out the middle man: https://www.manning.com/books/build-a-large-language-model-f...
sfmz•5h ago
Andrej Karpathy: Let's build GPT: from scratch, in code, spelled out. https://www.youtube.com/watch?v=kCc8FmEb1nY
beardyw•4h ago
Andrej Karpathy's Nano GPT is reasonably accessible and easy to run.

https://github.com/karpathy/nanoGPT