AI · alternatives · 2026
24 alternatives to Every number in a tiny GPT, from one forward pass to one step of RLHF
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1

Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines). - joennlae/tensorli
2023 · github.com · its alternatives →
- 2MI
very much inspired by karpathy's microgpt of the same name. it's (by default) a 4000 param GPT/LLM/NN that learns to generate names. this is sorta an educational tool in that you can visualize the activations as they pass through the network, and click on things to get an explanation of them.
Feb 2026 · microgpt.boratto.ca · its alternatives →
- 3

Flash Attention in ~100 lines of CUDA (forward pass only) - tspeterkim/flash-attention-minimal
2024 · github.com · its alternatives →
- 4

Long-simmering side project that is finally ready to see the light. HAMTs are a cool persistent data structure and implementing one has been a lot of fun. Beyond the code, there is likely some value in the extensive and largely complete implementation docs; basic benchmarks are linked in the README, too. Kind of aiming to be "the libavl for HAMTs". That is obviously a high and aspirational bar but a distinct possibility if it stirs up a little interest and/or contribution. Anyways, it's time for this to go out, collect feedback and maybe even some use outside of toy projects. Let me…
2023 · github.com · its alternatives →
- 5BA
2016 · baseconv.ddns.net · its alternatives →
- 6

A tiny version of GPT fully implemented in Python with zero dependencies - isaacperez/tinygpt
2024 · github.com · its alternatives →
- 7M3
2015 · memorize39digitsofpi.com · its alternatives →
- 8TT
For the last few weeks, I have been working on training an LLM from scratch and deploying it in production on Google Cloud Platform. Finally, I trained a 30 million parameter model on 1 billion tokens and deployed it as a web service. You can access the LLM using this site - https://kunalmishra.info The following steps were taken to build Tiny Tales GPT 1. Downloaded and preprocessed 8GB of dataset using multiprocessing library. 2. Tokenized the data using byte pair encoding to create 1 billion tokens sharded in different bin files. 3. Defined a training setup and trained the model…
2024 · kunalmishra.info · its alternatives →
- 9MI
The release of microgpt by Andrej Karpathy is a foundational moment for AI transparency. In exactly 243 lines of pure, dependency-free Python, Karpathy has implemented the complete GPT algorithm from scratch. As a PhD scholar investigating AI and Blockchain, I see this as the ultimate tool for moving beyond the "black box" narrative of Large Language Models (LLMs). The Architecture of Simplicity Unlike modern frameworks that hide complexity behind optimized CUDA kernels, microgpt exposes the raw mathematical machinery. The code implements: The Autograd Engine: A custom Value class that…
Feb 2026 · its alternatives →
- 10

A simple re-implementation of Google's sparsehash as a learning excercise. - qpfiffer/Simple-Sparsehash
2015 · github.com · its alternatives →
- 11SD
2015 · vpj.github.io · its alternatives →
- 12BC
2022 · bits.kodare.com · its alternatives →
- 13TA
2019 · ten-lang.io · its alternatives →
- 14
hg_sdf▲7A glsl library for building signed distance functions
2015 · mercury.sexy · its alternatives →
- 15

- 16AC
2022 · thetinytools.com · its alternatives →
- 17TY
2021 · phoe.github.io · its alternatives →
- 18

A simple GPU hash table implemented in CUDA using lock free techniques - nosferalatu/SimpleGPUHashTable
2020 · github.com · its alternatives →
- 19TA
2016 · williamngan.github.io · its alternatives →
- 20CF
2018 · medium.com · its alternatives →
- 21TT
2015 · dfkoz.com · its alternatives →
- 22SY
2022 · simplerlist.com · its alternatives →
- 23AV
2017 · khamidou.com · its alternatives →
- 24AH
2022 · danieljanus.pl · its alternatives →
Also compare
- less than 650 LOC trainable GPT only using NumPy alternatives
- Microgpt is a GPT you can visualize in the browser alternatives
- Flash Attention in ~100 lines of CUDA alternatives
- A hash array-mapped trie implementation in C alternatives
- Baseconv: a (very) tiny number conversion utility alternatives
- TinyGPT – A Simple, Educational Deep Learning Library alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →