MyTorch – Minimalist autograd in 450 lines of Python

https://github.com/obround/mytorch

93•iguana2000•1d ago

Comments

jjzkkj•1d ago

HmcKk

jerkstate•1d ago

Karpathy’s micrograd did it first (and better); start here: https://karpathy.ai/zero-to-hero.html

richard_chase•23h ago

Harsh.

whattheheckheck•22h ago

Why is it better

tfsh•22h ago

Because it's an acclaimed, often cited course by a preeminent AI Researcher (and founding member of OAI) rather than four undocumented python files.

nurettin•22h ago

Objective measures like branch depth, execution speed, memory use and correctness of the results be damned.

CamperBob2•21h ago

Karpathy's implementation is explicitly for teaching purposes. It's meant to be taken in alongside his videos, which are pretty awesome.

gregjw•21h ago

it being acclaimed is a poor measure of success, theres always room for improvement, how about some objective comparisons?

geremiiah•17h ago

Ironically the reason Karpathy's is better is because he livecoded it and I can be sure it's not some LLM vomit. Unfortunately, we are now indundated with newbies posting their projects/tutorials/guides in the hopes that doing so will catch the eye of a recuiter and land them a high paying AI job. That's not so bad in itself except for the fact that most of these people are completely clueless and posting AI slop.

iguana2000•16h ago

Haha, couldn't agree with you more. This, however, isn't AI slop. You can see in the commit history that this is from 3 years ago

forgotpwd16•17h ago

Cleaner, more straightforward, more compact code, and considered complete in its scope (i.e. implement backpropagation with a PyTorch-y API and train a neural network with it). MyTorch appears to be an author's self-experiment without concrete vision/plan. This is better for author but worse for outsiders/readers.

P.S. Course goes far beyond micrograd, to makemore (transfomers), minbpe (tokenization), and nanoGPT (LLM training/loading).

alkh•22h ago

Imho, we should let people experiment as much as they want. Having more examples is better than less. Still, thanks for the link for the course, this is a top-notch one

iguana2000•18h ago

Karpathy's material is excellent! This was a project I made for fun, and hopefully provides a different perspective on how this can look

khushiyant•17h ago

Better readme would be way to go

CamperBob2•11h ago

In iguana2000's defense, the code is highly self-documenting.

It arguably reads cleaner than Karpathy's in some respects, as he occasionally gets a little ahead of his students with his '1337 Python skillz.

brandonpelfrey•14h ago

Having written a slightly more involved version of this recently myself I think you did a great job of keeping this compact while still readable. This style of library requires some design for sure.

Supporting higher order derivatives was also something I considered, but it’s basically never needed in production models from what I’ve seen.

iguana2000•9h ago

Thanks! I agree about the style

Show HN: Terminal UI for AWS

Lessons from 14 Years at Google

Why does a least squares fit appear to have a bias when applied to simple data?

During Helene, I just wanted a plain text website

The unbearable joy of sitting alone in a café

Street Fighter II, the World Warrier (2021)

The Showa Hundred Year Problem

Linear Address Spaces: Unsafe at any speed (2022)

The year of the 3D printed miniature and other lies we tell ourselves

I charged $18k for a Static HTML Page (2019)

Eurostar AI vulnerability: When a chatbot goes off the rails

Ripple, a puzzle game about 2nd and 3rd order effects

Millennium Challenge: A corrupted military exercise and its legacy (2015)

Show HN: An interactive guide to how browsers work

Web development is fun again

Six Harmless Bugs Lead to Remote Code Execution

The baffling purple honey found only in North Carolina

Agentic Patterns

Show HN: Hover – IDE style hover documentation on any webpage

The great shift of English prose

Moiré Explorer

Anti-aging injection regrows knee cartilage and prevents arthritis

Bison return to Illinois' Kane County after 200 years

Show HN: An LLM-Powered PCB Schematic Checker (Major Update)

FreeBSD Home NAS, part 3: WireGuard VPN, routing, and Linux peers

Claude Code On-the-Go

Using Hinge as a Command and Control Server

Trellis AI (YC W24) is hiring engineers to build AI agents for healthcare access

How I archived 10 years of memories using Spotify

Stop Forwarding Errors, Start Designing Them