I created a Neural Network from scratch, in scratch
I spent the past week implementing a 1 Layer Neural Net and training it on MNIST within the visual scripting language provided by scratch.mit.edu. It was tedious, but ultimately not too difficult. The code runs incredibly slowly, so much so that 64 samples of MNIST takes 5+ hours to train on my machine. There were a lot of little mini challenges that were fun to overcome (implementing softmax was very tricky). If you're interested, I encourage you to try and improve on it! More details in the linked blog post.
I created a Neural Network from scratch, in scratch launched on July 15, 2024 with 7 votes, #1,887 of 5,184 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.
What it does
I recently spent the better part of last week doing exactly what the title says. I implemented a 1 layer Feed Foward Network and trained it on (some of) MNIST. All in scratch . It would help a lot to understand the basics of Deep Learning when reading this, but I’ll try to make it accessible to anyone with a high level understanding of the field. MNIST is an image classification dataset consisting of labeled 28 by 28 grayscale images of digits from 0-9. The goal of the model is to correctly identify the label of each image. For each image, the model should output a series of probablities, representing how likely the model believes that the image belongs to a given class. \[ \begin{bmatrix}…from bell-boy.github.io
Does a similar job
all alternatives →
100 Vibe Coding2025 · 100vibecoding.com · ▲351Hi HN, I have been making side projects since I was 14, and my team mate (this is his very first side project! Congrats!) designed and implemented the UI. Over time, people kept asking me how they could start coding and turn ideas into reality. So we had an idea. Coding is changing. With AI, the bottleneck is no longer writing every line by hand but knowing how to prompt effectively to reach a working outcome. Our objective is not to make people code better, or even learn to be a proficient software engineer, but just to keep it simple and start building. We want to remove fear and barriers…
I'm 15 and built a neural network from scratch in C++,just math2025 · github.com · ▲8I’m 15 and self-taught. I'm learning ML from scratch because I want to really understand how things work. I’m not into frameworks. I prefer math, logic, and C++. I implemented a basic MLP that supports different activation and loss functions. It was trained via mini-batch gradient descent. I wrote it from scratch, using no external libraries except Eigen (for linear algebra). I learned how a Neural Network learns (all the math) -- how the forward pass works, and how learning via backpropagation works. How to convert all that math into code. I’ll write a blog soon explaining how MLPs work in…
I wrote my first neural networkMar 2026 · github.com · ▲6I have been interested in neural nets since the 90's. I've done quite a bit of reading, but never gotten around to writing code. I used Gemini in place of Wikipedia to fill in the gaps of my knowledge. The coolest part of this was learning about dual numbers. You can see in early commits that I did not yet know about auto-diff; I was thinking I'd have to integrate a CAS library or something. Now, I'm off to play with TensorFlow.
- AVA Visual and Interactive Guide to the Basics of Neural Networks2016 · jalammar.github.io · ▲63
Discussions: Hacker News (63 points, 8 comments), Reddit r/programming (312 points, 37 comments) Translations: Arabic, French, Spanish Update: Part 2 is now live: A Visual And Interactive Look at Basic Neural Network Math Motivation I’m not a machine learning expert. I’m a software engineer by train
- W1Watch 14-Byte AI "brains" attempt to solve a 2D maze (Its hard)Jul 2026 · con-dog.github.io · ▲25
Hey HackerNews, I built this project over the last few weeks as a palette cleanser from a failed game launch. I wanted to learn a bit about AI/Neural-Networks and naively thought I could build a tiny maze-solving AI in a weekend with a 100% solve rate. Well - I couldn't, but I got pretty close. 14 Bytes total model size, and a 96.5% solve rate on unseen mazes. Trained across 46 phases experimenting with different ideas to improve the model (better performance, smaller size). Its quite fun to watch the model attempt to solve the maze, when they fail its usually due to getting stuck in a…
- IMI made a 5 hour neural networks class with no prerequisites2017 · neuralnetsforhackers.teachable.com · ▲17
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, July 2024
the whole month →
Many years ago, I made VJ softwares (to mix live visuals in clubs) for unexpected platforms like the Game Boy Advance, the Playstation 2 and the Raspberry Pi. This year, I’m back with a new web-app: Pikimov. Inspired by Photopea (a free Photoshop clone), I created this web-based motion design & video editor as an alternative to After Effects, to fill empty void. It's free, without signup, without cloud uploads (your files stay on your machine), and your projects are not used for AI models training.
AI · 2024 · pikimov.com
