AI · alternatives · 2026

24 alternatives to Building a web search engine from scratch with 3B neural embeddings

End-to-end deep dive of the project, spanning a large GPU cluster, distributed RocksDB, and terabytes of sharded HNSW.

This is a technical guide for developers interested in creating a web search engine using 3 billion neural embeddings. It covers the foundational architecture and implementation details needed to build a search system… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.

1
Exploring HN by mapping and analyzing 40M posts and comments for fun▲520
Accessible end-to-end deep dive of crawling, embedding, projecting, and semantic searching all of Hacker News for my Hackerverse project.
2024 · blog.wilsonl.in · its alternatives →
2AD
A discovery-focused search engine for Hacker News▲193
We (Nick, Dens, Denzell, Fede, Drew, Aaryan, and Daniel) have been building HN Discovery, a discovery-focused search engine for Hacker News, in our spare time for the past 6 months and are excited to show it! It adds the following features relative to the existing keyword search interface and preserves the existing ones: - no-JS version (hnnojs.trieve.ai) - site:{required_site} and site:{negated-site} filters - public analytics - LLM generated query suggestions based on random stories - recommendations - dense vector semantic search - SPLADE fulltext search - RAG AI chat - order by…
2024 · hn.trieve.ai · its alternatives →
3
I mapped HN's favorite books with GPT-4o▲285
Hey HN! I love finding new books to read on here. I wanted to gather the most mentioned books and recreate the serendipity of physical browsing. I scraped 20k comments from HN threads related to reading, extracted the references and opinions using GPT-4o mini, and visualised their embeddings as a map. - OpenAI's embeddings were processed using UMAP and HDBSCAN. A direct 2D projection from the text embeddings didn't yield visually interesting results. Instead, HDBSCAN is first applied on a high-dimensional projection. Those clusters tend to correspond to different genres. The genre…
2024 · hnbooks.pieterma.es · its alternatives →
4SC
Semantic clusters and embeddings for 500k Hacker News comments▲114
2024 · app.airtrain.ai · its alternatives →
5IM
I made a website to semantically search ArXiv papers▲324
As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for. I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4]. To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric. I would…
2024 · papermatch.mitanshu.tech · its alternatives →
6WS
Web search using a ChatGPT-like model that can cite its sources▲318
We’ve trained a generative AI model to browse the web and answer questions/retrieve code snippets directly. Unlike ChatGPT, it has access to primary sources and is able to cite them when you hover over an answer (click on the text to go to the source being cited). We also show regular Bing results side-by-side with our AI answer. The model is an 11-billion parameter T5-derivative that has been fine-tuned on feedback given on hundreds of thousands of searches done (anonymously) on our platform. Giving the model web access lessens its burden to need to store a snapshot of human knowledge…
2022 · beta.sayhello.so · its alternatives →
7
Google EmbeddingGemma 2free▲318
An open, lightweight multimodal embedding model
17d ago · blog.google · its alternatives →
8
Hacker Search – A semantic search engine for Hacker News▲233
Hi HN! I'm Jonathan and I built Hacker Search (https://hackersearch.net), a semantic search engine for Hacker News. Type a keyword or a description of what you're interested in, and you'll get top links from HN surfaced to you along with brief summaries. Unlike HN's otherwise very valuable search feature, Hacker Search doesn't require you to get your keywords exactly right. That's achieved by leveraging OpenAI's latest embedding models alongside more traditional indexes extracted from the scraped and cleaned up contents of the links. I think there are many more interesting things…
2024 · hackersearch.net · its alternatives →
9
Turn any website into a knowledge base for LLMs▲305
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
10
Real-time system that tracks how news spreads across 200k websites▲256
I built a system that monitors ~200,000 news RSS feeds in near real-time and clusters related articles to show how stories spread across the web. It uses Snowflake’s Arctic model for embeddings and HNSW for fast similarity search. Each “story cluster” shows who published first, how fast it propagated, and how the narrative evolved as more outlets picked it up. Would love feedback on the architecture, scaling approach, and any ways to make the clusters more accurate or useful. Live demo: https://yandori.io/news-flow/
Nov 2025 · yandori.io · its alternatives →
11IB
I built an open source AI video search engine to learn more about AI▲145
Hi there! When Supabase announced their recent hackathon, I thought it was a good time to build something to learn more about so many of the new AI models and tech out there. From the different techniques of embedding documents to the future RAG. With the rise of short form content with TikTok and Youtube. A lot more knowledge is in videos than ever before. Finding specific answers within millions of videos can be difficult for any one person to go through. So the question is if there is Google that indexes text on website making it easier to find based on the context of on your question,…
2023 · avse.vercel.app · its alternatives →
12AT
Analyzing top HN posts with language models▲117
Hi HN, I spent a few weeks looking at the top HN posts of all time. This included exploration, clustering, creating visualizations, and zooming in on what (to me personally) seems like some of the best discussions on here. Three things in this post: 1- The interesting groups of HN posts 2- The interactive visualizations that you can explore in your browser 3- The data from this exploration -- this includes CSV of the titles as well as the text embeddings of 3,000 Ask HN articles. Blog post about this whole process here: [1] ============ 1- The interesting groups of HN posts From the…
2022 · its alternatives →
13
Embeddinghub: A vector database built for Machine Learning embeddings▲118
The Virtual Feature Store. Turn your existing data infrastructure into a feature store. - featureform/featureform
2021 · github.com · its alternatives →
14FS
Feep! search, an independent search engine for programmers▲182
Hi HN! This started late last year as an afternoon project to play around with ElasticSearch, and then I kept thinking of new features I wanted to add. I still have a lot of things I want to build, but now seemed like a good time to put it out there: even if the results aren’t nearly the quality I’d like, I’ve still found it useful and I want to show it off! I’ve been working on it since September 2021, but only in fits and starts. The entire thing runs on a computer in my living room (there’s a picture on the About page); I haven’t done any load testing so we’ll see how it holds up.
2022 · search.feep.dev · its alternatives →
15
Demystifying Advanced RAG Pipelines▲131
I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…
2023 · github.com · its alternatives →
16
A fast HNSW implementation in Rust▲111
HNSW implementation in Rust. Reference: https://arxiv.org/ftp/arxiv/papers/1603/1603.09320.pdf - swapneel/hnsw-rust
2024 · github.com · its alternatives →
174E
40M embeddings to find who knows what on HN▲33
2024 · blog.wilsonl.in · its alternatives →
18AG
A GPU-accelerated binary vector index▲65
This is a vector index I built that supports insertion and k-nearest neighbors (k-NN) querying, optimized for GPUs. It operates entirely in CUDA and can process queries on half a billion vectors in under 200 milliseconds. The codebase is structured as a standalone library with an HTTP API for remote access. It’s intended for high-performance search tasks—think similarity search, AI model retrieval, or reinforcement learning replay buffers. The codebase is located at https://github.com/rodlaf/BinaryGPUIndex.
2025 · rlafuente.com · its alternatives →
19
A search engine based on social signals▲46
We built a search engine that shows you the most engaging stories/topics being shared across Twitter, Facebook, Linkedin, and Google+. We crawled over 15 million articles the past 3 months, retrieved the total number of Facebook likes, tweets, Google+’s etc and built a search index around it. Here's what our infrastructure looks like: Rails/Redis: We use the Sidekiq gem as a message queue. We have hundreds of workers that do the crawling, data mining, and number crunching. ElasticSearch: We built the search index using ElasticSearch, with the data imported from our Postgres…
2013 · buzzsumo.com · its alternatives →
20
HNSW index for vector embeddings in approx 500 LOC▲73
Heirarchical Navigable Small Worlds. Contribute to dicroce/hnsw development by creating an account on GitHub.
2025 · github.com · its alternatives →
21
ColBERT Build from Sentence Transformers▲66
Neural Search. Contribute to raphaelsty/neural-cherche development by creating an account on GitHub.
2023 · github.com · its alternatives →
22
Embeddinghub▲118
An open-source database for machine learning
2021 · github.com · its alternatives →
23SH
Search HN for interesting comment sections▲60
I built this tool to help me find interesting discussions on Hacker News. I love reading HN discussions almost more than the articles themselves. However, I found that full text search, although highly performant, is not always good at surfacing interesting discussions on a certain topic -- especially if you don't know what to search for exactly. I built this by scraping the most recent ~6 million posts (that's about 2 years of history) and putting the resulting posts and their vector embeddings into Postgres. Let me know what could be improved, and if you'd like a more detailed writeup of…
2024 · searchhacker.news · its alternatives →
24
Embeddable HNSW Library for Go▲11
Frustrated by the inability to play with semantic search / ANN in Go w/o a heavy-weight external DB, I created this HNSW library. I hope other gophers find it useful.
2024 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →