If you like Andrej Karpathy's nanoGPT but can't find one for great open source models such as Qwen, this repo is for you!
It includes all variants of Qwen3 and Qwen 2.5 VL, with text + image input support and both dense and Mixture of Experts implemented from scratch.
Feel free to leave a star or any feedback
iiTsEddy•2h ago
If you like Andrej Karpathy's nanoGPT but can't find one for great open source models such as Qwen, this repo is for you!
It includes all variants of Qwen3 and Qwen 2.5 VL, with text + image input support and both dense and Mixture of Experts implemented from scratch.
Feel free to leave a star or any feedback