Every number in a tiny GPT, from one forward pass to one step of RLHF
Every number in a tiny GPT, from one forward pass to one step of RLHF launched on October 7, 2026 with 8 votes, #683 of 3,597 launches that month and more than 75% of that year's launches.
Does a similar job
all alternatives →
less than 650 LOC trainable GPT only using NumPy2023 · github.com · ▲90Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines). - joennlae/tensorli
- MIMicrogpt is a GPT you can visualize in the browserFeb 2026 · microgpt.boratto.ca · ▲282
very much inspired by karpathy's microgpt of the same name. it's (by default) a 4000 param GPT/LLM/NN that learns to generate names. this is sorta an educational tool in that you can visualize the activations as they pass through the network, and click on things to get an explanation of them.
Flash Attention in ~100 lines of CUDA2024 · github.com · ▲230Flash Attention in ~100 lines of CUDA (forward pass only) - tspeterkim/flash-attention-minimal
A hash array-mapped trie implementation in C2023 · github.com · ▲171Long-simmering side project that is finally ready to see the light. HAMTs are a cool persistent data structure and implementing one has been a lot of fun. Beyond the code, there is likely some value in the extensive and largely complete implementation docs; basic benchmarks are linked in the README, too. Kind of aiming to be "the libavl for HAMTs". That is obviously a high and aspirational bar but a distinct possibility if it stirs up a little interest and/or contribution. Anyways, it's time for this to go out, collect feedback and maybe even some use outside of toy projects. Let me…
- BABaseconv: a (very) tiny number conversion utility2016 · baseconv.ddns.net · ▲5
TinyGPT – A Simple, Educational Deep Learning Library2024 · github.com · ▲13A tiny version of GPT fully implemented in Python with zero dependencies - isaacperez/tinygpt
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Launched alongside, October 2026
the whole month →
A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.
Life & fun · 3d ago · permit.petercai.com
- IV
Life & fun · 15d ago · tanzaniaeducationproject.org
Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.
Life & fun · 16d ago · bigwords.page
Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.
Life & fun · 10d ago · guitoro.com