TurboGPT: train 22KiB transformer in 13s

In plain words

TurboGPT is a tool that trains a small GPT transformer model in under a minute using CUDA acceleration. It is designed for developers and researchers who want to quickly experiment with transformer training. The project is hosted on GitHub where users can contribute to its development.

written from the facts on this page · September 2026

• 
  less than 650 LOC trainable GPT only using NumPy2023 · github.com · ▲90

  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines). - joennlae/tensorli

• MI
  Microgpt is a GPT you can visualize in the browserFeb 2026 · microgpt.boratto.ca · ▲282

  very much inspired by karpathy's microgpt of the same name. it's (by default) a 4000 param GPT&#x2F;LLM&#x2F;NN that learns to generate names. this is sorta an educational tool in that you can visualize the activations as they pass through the network, and click on things to get an explanation of them.

• 
  GPT-2 implemented using graphics shaders2025 · github.com · ▲228

  Back in the old days, people used to do general-purpose GPU programming by using shaders like GLSL. This is what inspired NVIDIA (and other companies) to eventually create CUDA (and friends). This is an implementation of GPT-2 using WebGL and shaders. Enjoy!

• 
  GPT-J2021 · 6b.eleuther.ai · ▲394

  Open-source cousin of GPT-3, everyone can use it

• 
  Flash Attention in ~100 lines of CUDA2024 · github.com · ▲230

  Flash Attention in ~100 lines of CUDA (forward pass only) - tspeterkim/flash-attention-minimal

• IM
  I made a GPU VRAM calculator for transformer-based models2023 · vram.asmirnov.xyz · ▲135

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 16d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 28d ago · world.pixverse.video

• 
  An e-ink frame that hears birds and draws them as 1800s illustrations▲2,389

  E-ink bird frame for Raspberry Pi - real-time bird detection by audio, fully local AI, rendered as real, hand-cut 1800s bird illustrations. - arnegiacomo/fugleramme

  AI · Sep 2026 · github.com

• WI
  What if the speed of light was 5 km/h?▲629

  Special relativity simulator in which light crawls along at a human speed, so Lorentz contraction, aberration and Doppler shift happen at walking pace.

  Life & fun · Sep 2026 · rivendell.dmitrybrant.com

• 
  Jev▲544

  Fast, structured AI decisions for software automation

  AI · Sep 2026 · console.typesafe.ai

• 
  ReSO AI▲510

  Get discovered & recommended when customers ask AI

  AI · Sep 2026 · resollm.ai

• 
  Kilo Code for iOS and Android▲498

  Start coding agents, control sessions, review PRs. Anywhere.

  Dev tools · Sep 2026 · kilo.ai

• 
  AINA▲497

  Find your job search blind spots with an AI coach

  AI · Sep 2026 · aina-tech.io