Work · alternatives · 2026
24 alternatives to My side project that searches the web for technologies
Hello HN! I've been working on http://underthesite.com for the last month and now think it is ready for some full strength HN feedback. What do you guys think? It crawls up to 10 pages of a given site while you wait, looking for community-provided CSS / XPath selectors and regular expressions. Additionally, I'd like to appeal to you to submit matchers for technologies that you care about. Technologies are easy to add, so add your favorite jQuery plugins, analytics tools, client-side node.js wrappers, what have you. I'm going to be running a large crawl in the next few days and want to make…
Underthesite.com is a web crawler that searches up to 10 pages of a website to detect which technologies it uses, such as JavaScript frameworks, analytics tools, and jQuery plugins. It relies on community-submitted CSS… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. My side project that searches the web for technologies launched in 2011; newer entries below may have overtaken it.
- 1
Context.dev▲814Hello, My name is Yahia, I've been working on scraping products for a long time and maintain a couple of free sites in my spare time (E.g. knifegeek.io) What prompted this is i've rebuilt scraping infra at every company I've started and finally just made it a product. Pass a URL, get clean markdown, html, images, sitemap or pass a domain, get logos, colors, socials, industry data. Goal is to offer a better service than VC funded competitors at a fraction of the cost. Stealth is included and automatic at no additional cost (normally an upcharge by alternatives). Would love your honest thoughts.
Jul 2026 · context.dev · its alternatives →
- 2
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 3
Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
2022 · crawlee.dev · its alternatives →
- 4
CrawlRaven▲287SEO Hub for GSC + GA4 + a 200-point crawl
Jul 2026 · crawlraven.com · its alternatives →
- 5AM
Do you remember the internet of the early 2000s? Neat single function websites that let you be creative and customize your spaces and weren't setting out to be the next major conglomerate (or to be bought by them). I'm building a series of websites that have simple concepts but too many of the players have tried to make their product so big. I also used to live in a very rural area so my goal is to make websites that load fast even on very slow internet. I'm starting with Lynx.boo. A linktree style website that lets you fully customize your CSS (and adds a bunch of classes to your links to…
2024 · lynx.boo · its alternatives →
- 6AS
Hey all, Last time when we were on HackerNews [1], we received a lot of feedback, and we incorporated most of it. - We have changed our name from grep.help to usegrasp.com - A privacy policy page - Bulk import - Pricing page We are happy to introduce a new feature: a personalized answer search engine that provides direct citations to the content on the page. Demo: https://usegrasp.com/search?q=is+starship+fully+reusable%3F 1 - https://news.ycombinator.com/item?id=35510949
2023 · usegrasp.com · its alternatives →
- 7
- 8
I've been a bit obsessed with the idea of flipping through the internet a bit like you would a magazine, of undirected browsing as a discovery mechanism, and I think I'm approaching something that's beginning to feel pretty fun. The link at the top will return results out of a pool of approximately 10,000 domains, you can refresh to get new ones. You can also explore in a directed fashion by using the 'Similar Domains'-buttons. These are not random. A sampler, beyond the random sites offered with the head link https://search.marginalia.nu/explore/www.amiga-news.de…
2022 · search.marginalia.nu · its alternatives →
- 9DR
I'd like to invite everyone to try out DontBeEvil.rip, an experimental search engine for developers. tl;dr $ alias rip="curl -G -H 'Accept: text/plain' --url https://dontbeevil.rip/search --data-urlencode " $ rip 'q=Heartbleed bug' DontBeEvil.rip is a year long experiment to see if a small team can build a developer-focused search engine that is self-sustaining on $10 monthly subscriptions. It works by only indexing high-quality resources that are relevant to developers. You won't get useless listicles because we'll never crawl them. Relevant urls are harvested from HN,…
2022 · its alternatives →
- 10
Please try out this website analyzer and provide feedback on how to improve the output report so that you love the tool. In the first few sentences of the README you will also find a link to the GUI application if you don't want the CLI. To give you an idea of the report, I am sending a sample HTML report for Apple.com - https://crawler.siteone.io/html/2024-08-19/forever/v-bnb7tu5...
2024 · github.com · its alternatives →
- 11
- 12
- 13
- 14
Webthat▲76It assists people in learning about new websites and tools
2023 · webthat.io · its alternatives →
- 15
Showcase of web experiments written by creative coders
2015 · experiments.withgoogle.com · its alternatives →
- 16
http://www.hnshowcase.com Moses (nnythm) and I browse Hacker News daily. Show HN posts are some of our favorite parts of HN. We wanted to create a way to browse Show HN articles, even those that might not quite make it to the front page. We created http://www.hnshowcase.com last weekend to make discovering projects posted on HN easier. It searches all "Show HN" posts and generates a thumbnail view for each of them. You can sort by submission date, points, and number of comments, and navigate with left/right or j/k keys. We used the following technologies: HN Search API, Pyramid web…
2011 · hnshowcase.com · its alternatives →
- 17
- 18
- 19IS
2023 · v01.io · its alternatives →
- 20IB
Hey all! I wanted to share this project I've been working on that can maybe help you or your developer friends out. I built a RAG system for our product a while back and didn't realize how easy they were to get started. So I put together my learnings into this online course. It's not quite ready but if you sign up and mention HackerNews, I can get you early access. I'm looking to get feedback on the following: (1) materials — is it engaging & did you learn something? (2) UI/UX of the platform — did you have any issues that prevented you from starting or finishing the tutorial? (3)…
2024 · takehomes.com · its alternatives →
- 21IB
Hi HN, I built https://unbuilt.app to solve a problem I frequently faced as a developer: identifying the technology stack behind websites, especially those using newer frameworks and tools. While existing solutions rely on pre-saved data or signature databases, Unbuilt performs a fresh analysis by actually loading and examining the website code in real-time. This means it can detect cutting-edge technologies that often get missed by other analyzers. Technical details: - Uses Playwright to visit sites and analyze their resources - Queue-based architecture for handling concurrent…
2025 · unbuilt.app · its alternatives →
- 22DT
2017 · sitestacks.com · its alternatives →
- 23
We built a search engine that shows you the most engaging stories/topics being shared across Twitter, Facebook, Linkedin, and Google+. We crawled over 15 million articles the past 3 months, retrieved the total number of Facebook likes, tweets, Google+’s etc and built a search index around it. Here's what our infrastructure looks like: Rails/Redis: We use the Sidekiq gem as a message queue. We have hundreds of workers that do the crawling, data mining, and number crunching. ElasticSearch: We built the search index using ElasticSearch, with the data imported from our Postgres…
2013 · buzzsumo.com · its alternatives →
- 24
Stumble upon great links shared by curious readers. Discover worthwhile stories, explore unexpected corners of the web, and find something new. Join free.
2013 · postagon.com · its alternatives →
Also compare
- Context.dev alternatives
- Turn any website into a knowledge base for LLMs alternatives
- Crawlee – Web scraping and browser automation library for Node.js alternatives
- CrawlRaven alternatives
- A minimalist (brutalist?) website for sharing all your links alternatives
- A search engine for your personal network of high-quality websites alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →