Dev tools · alternatives · 2026
24 alternatives to An open source web crawler for the Mwmbl non-profit search engine
A browser extension that can be installed by volunteers to participate in mwmbl distributed crawling. - mwmbl/crawler-extension
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. An open source web crawler for the Mwmbl non-profit search engine launched in 2022; newer entries below may have overtaken it.
- 1
An open source, non-profit web search engine. Contribute to mwmbl/mwmbl development by creating an account on GitHub.
2021 · github.com · its alternatives →
- 2
- 3
- 4
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. - tikazyq/crawlab
2019 · github.com · its alternatives →
- 5
- 6
Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
2022 · crawlee.dev · its alternatives →
- 7
Simple Scraper▲556Turn any website into an API in just a few seconds.
2019 · simplescraper.io · its alternatives →
- 8
AnyPicker▲496Scrape web data without any code, just click what you see.
2019 · app.anypicker.com · its alternatives →
- 9
Distributed crawler powered by Headless Chrome. Contribute to yujiosaka/headless-chrome-crawler development by creating an account on GitHub.
2018 · github.com · its alternatives →
- 10
Crawler.sh▲349Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown
Mar 2026 · crawler.sh · its alternatives →
- 11
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 12
Browserhub▲121Easy to use no-code web scraping and data extraction tool
2023 · browserhub.io · its alternatives →
- 13
Your favorite SEO tools, placed for quick access.
2019 · chromewebstore.google.com · its alternatives →
- 14DR
I'd like to invite everyone to try out DontBeEvil.rip, an experimental search engine for developers. tl;dr $ alias rip="curl -G -H 'Accept: text/plain' --url https://dontbeevil.rip/search --data-urlencode " $ rip 'q=Heartbleed bug' DontBeEvil.rip is a year long experiment to see if a small team can build a developer-focused search engine that is self-sustaining on $10 monthly subscriptions. It works by only indexing high-quality resources that are relevant to developers. You won't get useless listicles because we'll never crawl them. Relevant urls are harvested from HN,…
2022 · its alternatives →
- 15
Two months ago, I started building this side-project in the morning, before my full-time job. A visual and easy-to-use web scraping app. Please, roast it a bit so I can work on improving it. Thanks.
2023 · mrscraper.com · its alternatives →
- 16SA
Sitebulb is the revolutionary website crawler for better SEO audits. Twice winner of Best Search Software Tool. Desktop & Cloud crawling without compromise!
2017 · sitebulb.com · its alternatives →
- 17
I’ve started building a distributed search engine for scholarly literature, which is completely contained within a browser extension: install it from the Chrome Web Store. It uses WebRTC and magic, and is currently, like, right now, used by 0 people. It’s you who can be number...
2014 · juretriglav.si · its alternatives →
- 18
Simple SEO Tool▲111Chrome Extension that simplifies SEO on-page analysis
2024 · seoextension.info · its alternatives →
- 19AM
2017 · mixnode.com · its alternatives →
- 20
- 21
- 22
- 23
Library.one▲111Link sharing platform for experts, contextual search engine
2022 · library.one · its alternatives →
- 24
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →