I wanted to understand transformers at a level where nothing is magic, so I'm building a ChatGPT-style model from first principles in TypeScript. Why not Python? I've found that reimplementing concepts in a different language forces me to grasp the nuance of the implementation. Chapters cover dataloaders, embeddings, and the attention mechanism so far. Feedback welcome if anything's unclear.
Comments
pluc•2h ago
Why does it start at Chapter 2? Is it one of those JavaScript integer quirks?
wateralien•2h ago
Chapter 1 was the chapter about why you shouldn't use Typescript for this.
baraa_•2h ago
Chapter 1 exists. It's just a Promise that never resolved
pluc•2h ago
wateralien•2h ago
baraa_•2h ago