Marginalia Site Explorer Rabbit Hole Generator

I've been a bit obsessed with the idea of flipping through the internet a bit like you would a magazine, of undirected browsing as a discovery mechanism, and I think I'm approaching something that's beginning to feel pretty fun. The link at the top will return results out of a pool of approximately 10,000 domains, you can refresh to get new ones. You can also explore in a directed fashion by using the 'Similar Domains'-buttons. These are not random. A sampler, beyond the random sites offered with the head link https://search.marginalia.nu/explore/www.amiga-news.de…

Been messing with cosine similarity and decided to try calculating nearest neighbors over the entire link graph for the marginalia search engine. Turns out that you can just bruteforce that in a day or two. And the results are pretty good. One drawback is that depending on if you're looking at an older website, a lot of the links are dead. The deduplication isn't great either.

Hi HN, I’m pleased to release my “surf engine” to the public for you to try. This is might be for you if you’ve grown frustrated with commercialised SERPs, and want to find the other websites are (still) out there. Kudos to Marginalia Search for showing that it’s possible to build a search engine as a hobbyist: https://search.marginalia.nu/ Feedback of all kinds very welcome! Ali

I am working on this project, http://epsilonwiki.free.fr/lambdaway/, and would be happy to get your opinion back. Thanks a lot. Alain Marty

This was more of a sandbox to play with Raphael and Flot than anything else but I think there are some interesting statistics in there. It'd be awesome to do this over time but I really don't have the spare time required.