Alternatives
Products that do what Related Website Finder Experiment Thingy does
Been messing with cosine similarity and decided to try calculating nearest neighbors over the entire link graph for the marginalia search engine. Turns out that you can just bruteforce that in a day or two. And the results are pretty good. One drawback is that depending on if you're looking at an older website, a lot of the links are dead. The deduplication isn't great either.
- 1ME
I've been a bit obsessed with the idea of flipping through the internet a bit like you would a magazine, of undirected browsing as a discovery mechanism, and I think I'm approaching something that's beginning to feel pretty fun. The link at the top will return results out of a pool of approximately 10,000 domains, you can refresh to get new ones. You can also explore in a directed fashion by using the 'Similar Domains'-buttons. These are not random. A sampler, beyond the random sites offered with the head link https://search.marginalia.nu/explore/www.amiga-news.de…
2022 · search.marginalia.nu
- 2FB
Hey there HN! We’re Antonio, Luca, and Yuhang, and we’re excited to introduce Fast GraphRAG, an open-source RAG approach that leverages knowledge graphs and the 25 years old PageRank for better information retrieval and reasoning. Building a good RAG pipeline these days takes a lot of manual optimizations. Most engineers intuitively start from naive RAG: throw everything in a vector database and hope that semantic search is powerful enough. This can work for use cases where accuracy isn’t too important and hallucinations are tolerable, but it doesn’t work for more difficult queries that…
2024 · github.com
- 3TA
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io
- 4IM
As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for. I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4]. To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric. I would…
2024 · papermatch.mitanshu.tech
- 5IM
Hi HN, I am Jiayuan, and I'm here to introduce a tool we've been building over the past few months: Devv (https://devv.ai). In simple terms, it is an AI-powered search engine specifically designed for developers. Now, you might ask, with so many AI search engines already available—Perplexity, You.com, Phind, and several open-source projects—why do we need another one? We all know that Generative Search Engines are built on RAG (Retrieval-Augmented Generation)[1] combined with Large Language Models (LLMs). Most of the products mentioned above use indexes from general search engines…
2024 · devv.ai
- 6VF
We’ve just open-sourced Vicinity, a lightweight approximate nearest neighbors (ANN) search package that allows for fast experimentation and comparison of a larger number of well known algorithms. Main features: - Lightweight: the base package only uses Numpy - Unified interface: use any of the supported algorithms and backends with a single interface: HNSW, Annoy, FAISS, and many more algorithms and libraries are supported - Easy evaluation: evaluate the performance of your backend with a simple function to measure queries per second vs recall - Serialization: save and load your index for…
2024 · github.com
- 7FS
Hi HN! This started late last year as an afternoon project to play around with ElasticSearch, and then I kept thinking of new features I wanted to add. I still have a lot of things I want to build, but now seemed like a good time to put it out there: even if the results aren’t nearly the quality I’d like, I’ve still found it useful and I want to show it off! I’ve been working on it since September 2021, but only in fits and starts. The entire thing runs on a computer in my living room (there’s a picture on the About page); I haven’t done any load testing so we’ll see how it holds up.
2022 · search.feep.dev
- 8AF
2024 · github.com
- 9FV
I recently found myself computing the similarity between lots of very high dimensional vectors (i.e., sentence embedding vectors from LLMs), and I wanted to try some more powerful measures of similarity/dependency than just Cosine similarity, which seems to be the default for everything nowadays because of its computational efficiency. There are many other more involved measures that can detect more subtle relationships, but the problem is that some of them are quite slow to compute, especially if you're trying to do it in Python. For my favorite measure of statistical dependency,…
2023 · github.com
- 10AP
2018 · github.com
- 11MR
I've open-sourced the script I use to find related blog posts (and to describe why they're similar). Works on any set of markdown articles, so should fit into any SSG workflow. Uses embeddings to calculate the similarities, and GPT4 to add descriptive text.
2023 · tomhazledine.com
- 12LP
2014 · linkwok.com
- 13
- 14MS
Some of this has previously been available in a somewhat inaccessible format. I've recently been working on a redesign of the marginalia search website.
2024 · test.marginalia.nu
- 15AN
Hey folks, There has been some talk about search engines here so I thought maybe I'd share a new project I'm working on. Built it partly to help me sell my own projects. Still a lot of work to be done but would be happy to get feedback. Very early phase so don't trust your life with it. Cheers --- Edit: if anyone needs a free/no CC account just DM me on https://www.linkedin.com/in/crufter/
2024 · singulatron.com
- 16IS
Everything that would be here is in the README. I hope this gets big, it has tons of potential.
2013 · github.com
- 17FF
A little while ago I built an automated website that finds free stuff while filtering out scams. It works in an interesting way. Most freebie sites on the web contain a mix of real, useful free stuff and scammy affiliate and pyramid schemes. I realized that affiliate links are always unique (because they need to contain an affiliate code) while real freebies have URLs that co-occur across multiple sites at roughly the same time. I wrote a crawler in Perl and MySQL that looks for repeating, off-domain URLs that temporally cluster on multiple free stuff sites. I was surprised and pleased to…
2011
- 18MS
Hello HN! I've been working on http://underthesite.com for the last month and now think it is ready for some full strength HN feedback. What do you guys think? It crawls up to 10 pages of a given site while you wait, looking for community-provided CSS / XPath selectors and regular expressions. Additionally, I'd like to appeal to you to submit matchers for technologies that you care about. Technologies are easy to add, so add your favorite jQuery plugins, analytics tools, client-side node.js wrappers, what have you. I'm going to be running a large crawl in the next few days and want to make…
2011
- 19MA
Hey everyone! I’m excited to announce the release of my last project, MiniSearch. I admire Perplexity.ai, Phind.com, You.com, Bing, Bard and all these search engines integrated with AI chatbots. And as a curious developer, I took the chance and created my own version. Using Web-LLM and Transformers.js to provide browser-based text-generation models on desktop and mobile, I built a minimalist self-hosted search app on which an AI analyses the results, comments on them and responds to your query summarising the info. In the backend, it still queries a real search engine, but besides that,…
2023 · huggingface.co
- 20TT
In an effort to understand it, I put together a simple, pure python implementation of HNSW, an approximate nearest neighbor library. Learned a lot, and I think for anyone interested in vector search it's an exercise that's absolutely worth doing. The code is optimized (imo) for readability, and working (albeit, quite slowly) on putting together a tutorial that walks through the motivation and implementation of HNSW. There's also working code examples for using the library for text and image search with sentence transformers and CLIP!
2025 · github.com
- 21AB
Hey HN Community! We built this simple community search tool that basically allows people to search through thousands of past Reddit threads and tens of thousands of recommendations using tags. It mostly covers a few bigger subreddits like r/BIFL, r/MFA, r/AskMen, r/SkincareAddiction but along the way, I expanded it to include other smaller subreddits too. In addition to filtering by category, power users can also search by -Body Fit (big thigh, long torso) -Occupation (work in retail, teacher, doctor) -Age (18-24, 25-35), Size (height, weight) -Brand comparison (similar…
2022 · reddrecs.com
- 22SL
2017 · chrome.google.com
- 23CD
We ran the Leuven community detection algorithm on popular users on Bluesky (where the graph has edges determined by Jaccard similarity of a users' followers). We identified 118 communities and based on the names and descriptions of the top 10-20 users had LLMs generate title and descriptions for them. There are communities like "Feline enthusiasts", "Web Professionals", a bunch of NSFW ones and quite many communities are many different flavors of progressive/liberal activists.
2025 · blue.facts.dev
- 24IM
AI search results are quickly becoming more important than SEO, but as businesses, we have no visibility over it! That's why I'm building "Ahrefs for AI search results". Track keyword performance on AI tools like ChatGPT, Claude, Perplexity & more
2025 · linrush.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →