Building a web search engine from scratch with 3B neural embeddings

In plain words

This is a technical guide for developers interested in creating a web search engine using 3 billion neural embeddings. It covers the foundational architecture and implementation details needed to build a search system from the ground up. The resource is designed for engineers and researchers who want to understand how modern embedding-based search engines work and implement their own version. It was published on Wilson L.'s blog in August 2025.

written from the facts on this page · September 2026

From the sources

A while back, I decided to undertake a project to challenge myself: build a web search engine from scratch. Aside from the fun deep dive opportunity, there were two motivators: A simple question I had was: why couldn't a search engine always result in top quality content? Such content may be rare, but the Internet's tail is long , and better quality results should rank higher than the prolific inorganic content and engagement bait you see today. Another pain point was that search engines often felt underpowered, closer to keyword matching than human-level intelligence. A reasonably complex or subtle query couldn't be answered by most search engines at all, but the ability to would be…from blog.wilsonl.in

• 
  Exploring HN by mapping and analyzing 40M posts and comments for fun2024 · blog.wilsonl.in · ▲520

  Accessible end-to-end deep dive of crawling, embedding, projecting, and semantic searching all of Hacker News for my Hackerverse project.

• AD
  A discovery-focused search engine for Hacker News2024 · hn.trieve.ai · ▲193

  We (Nick, Dens, Denzell, Fede, Drew, Aaryan, and Daniel) have been building HN Discovery, a discovery-focused search engine for Hacker News, in our spare time for the past 6 months and are excited to show it! It adds the following features relative to the existing keyword search interface and preserves the existing ones: - no-JS version (hnnojs.trieve.ai) - site:{required_site} and site:{negated-site} filters - public analytics - LLM generated query suggestions based on random stories - recommendations - dense vector semantic search - SPLADE fulltext search - RAG AI chat - order by…

• 
  I mapped HN's favorite books with GPT-4o2024 · hnbooks.pieterma.es · ▲285

  Hey HN! I love finding new books to read on here. I wanted to gather the most mentioned books and recreate the serendipity of physical browsing. I scraped 20k comments from HN threads related to reading, extracted the references and opinions using GPT-4o mini, and visualised their embeddings as a map. - OpenAI's embeddings were processed using UMAP and HDBSCAN. A direct 2D projection from the text embeddings didn't yield visually interesting results. Instead, HDBSCAN is first applied on a high-dimensional projection. Those clusters tend to correspond to different genres. The genre…

• SC
  Semantic clusters and embeddings for 500k Hacker News comments2024 · app.airtrain.ai · ▲114
• IM
  I made a website to semantically search ArXiv papers2024 · papermatch.mitanshu.tech · ▲324

  As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for. I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4]. To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric. I would…

• WS
  Web search using a ChatGPT-like model that can cite its sources2022 · beta.sayhello.so · ▲318

  We’ve trained a generative AI model to browse the web and answer questions/retrieve code snippets directly. Unlike ChatGPT, it has access to primary sources and is able to cite them when you hover over an answer (click on the text to go to the source being cited). We also show regular Bing results side-by-side with our AI answer. The model is an 11-billion parameter T5-derivative that has been fine-tuned on feedback given on hundreds of thousands of searches done (anonymously) on our platform. Giving the model web access lessens its burden to need to store a snapshot of human knowledge…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 16d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 28d ago · world.pixverse.video

• 
  Trace▲1,555

  Workflow Automations for the Human 👾 AI Workforce

  AI · 2025 · trace.so

• 
  I spent 6 years building a ridiculous wooden pixel display▲1,145

  I built the world's most impractical 1000-pixel display and anyone in the world can draw on it. It draws a single pixel at a time and takes 30-60 minutes to complete a single image. Anyone can participate in the project by voting for the next image to be drawn, and submitting images. https://kilopx.com/

  Work · 2025 · benholmen.com

• 
  Indy AI by Contra▲1,070

  Job boards are dead. Your network is alive

  AI · 2025 · contra.com

• 
  Kitten TTS – 25MB CPU-Only, Open-Source TTS Model▲1,003

  Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…

  AI · 2025 · github.com

• 
  I was curious about spherical helix, ended up making this visualization▲865

  I was wondering how I can arrange objects along a spherical helix path, and read some articles on it. I ended up learning about parametric equations again, and make this visualization to document what I learned: https://visualrambling.space/moving-objects-in-3d/ feel free to visit and let me know what you think!

  Life & fun · 2025 · visualrambling.space

• 
  The current sky at your approximate location, as a CSS gradient▲788

  For HTML Day 2025 [1], I made a web service that displays the current sky at your approximate location as a CSS gradient. Colours are simulated on-demand using atmospheric absorption and scattering coefficients. Updates every minute, without the use of client-side JavaScript. Source code and additional information is available on GitHub: https://github.com/dnlzro/horizon [1] https://html.energy/html-day/2025/index.html

  Dev tools · 2025 · sky.dlazaro.ca