AI · alternatives · 2026
24 alternatives to Jevcrawl – A web crawler for AI agents with no LLM in the crawl loop
MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl. - RayenMlayeh/jevcrawl
Jevcrawl is a web crawler tool available as an MCP server and command-line interface designed to help AI agents extract information from websites efficiently. It performs web crawling without running a language model… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier.
- 1
Resolve dev tasks & bugs faster with Webvizio MCP
2025 · webvizio.com · its alternatives →
- 2
- 3
Hi HN! Excited to share our MCP Server at Hyperbrowser - something we’ve been working on for a few days. We think it’s a pretty neat way to connect LLMs and IDEs like Cursor / Windsurf to the internet. Our MCP server exposes seven tools for data collection and browsing: 1. `scrape_webpage` - Extract formatted (markdown, screenshot etc) content from any webpage 2. `crawl_webpages` - Navigate through multiple linked pages and extract LLM-friendly formatted content 3. `extract_structured_data` - Convert messy HTML into structured JSON 4. `search_with_bing` - Query the web and get results…
2025 · github.com · its alternatives →
- 4
Vectorize 2.0▲335Complete RAG agents (chatbot, MCP) with little or no code
2025 · platform.vectorize.io · its alternatives →
- 5
Browse.sh▲508Give your agents muscle memory for automating the web
Jun 2026 · browse.sh · its alternatives →
- 6
Browse AI▲548Train a robot to scrape any website in 2 mins with no-code
2021 · browse.ai · its alternatives →
- 7
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 8
Give your AI agent 31 web tools in one MCP server
12d ago · crawlforge.dev · its alternatives →
- 9
- 10DR
I'd like to invite everyone to try out DontBeEvil.rip, an experimental search engine for developers. tl;dr $ alias rip="curl -G -H 'Accept: text/plain' --url https://dontbeevil.rip/search --data-urlencode " $ rip 'q=Heartbleed bug' DontBeEvil.rip is a year long experiment to see if a small team can build a developer-focused search engine that is self-sustaining on $10 monthly subscriptions. It works by only indexing high-quality resources that are relevant to developers. You won't get useless listicles because we'll never crawl them. Relevant urls are harvested from HN,…
2022 · its alternatives →
- 11
Hi HN, I am Jiayuan, and I'm here to introduce a tool we've been building over the past few months: Devv (https://devv.ai). In simple terms, it is an AI-powered search engine specifically designed for developers. Now, you might ask, with so many AI search engines already available—Perplexity, You.com, Phind, and several open-source projects—why do we need another one? We all know that Generative Search Engines are built on RAG (Retrieval-Augmented Generation)[1] combined with Large Language Models (LLMs). Most of the products mentioned above use indexes from general search engines…
2024 · devv.ai · its alternatives →
- 12
- 13RE
Hey HN! We built a browser-based agent that runs inside an authenticated web app, watches how the app calls its own APIs, and automatically turns those into agent tools. You can think of it as an auto-generated MCP server that self-updates as the host app changes. The result is a skilled AI assistant that actually integrates deeply with any product (not just chat and RAG) with minimal effort. Check out these short demos below that show the agent in software you're probably familiar with: - Jira: https://demo.frigade.com/hn?skill=jira - Spotify:…
Jul 2026 · its alternatives →
- 14
Hey HN! We’ve been building an MCP server to help AI-assisted web app developers by using browser agents to test whether changes made by an AI inside an editor actually work. We've been testing it on scenarios like verifying new flows in a UI, or checking that sending a chat request triggers a response. The idea is to let your coding agent both code and evaluate if what it did was correct. Here’s a short demo with Cursor: https://www.youtube.com/watch?v=_AoQK-bwR0w When building apps, we found the hardest part of AI-assisted coding isn’t the coding—it’s tedious point-and-click…
2025 · github.com · its alternatives →
- 15
Kimi WebBridgefree tier, from $15/mo▲115A bridge connecting AI agents to the live web
May 2026 · kimi.ai · its alternatives →
- 16
Hi HN! Smooth CLI (https://www.smooth.sh) is a browser that agents like Claude Code can use to navigate the web reliably, quickly, and affordably. It lets agents specify tasks using natural language, hiding UI complexity, and allowing them to focus on higher-level intents to carry out complex web tasks. It can also use your IP address while running browsers in the cloud, which helps a lot with roadblocks like captchas (https://docs.smooth.sh/features/use-my-ip). Here’s a demo: https://www.youtube.com/watch?v=62jthcU705k Docs start at…
Feb 2026 · docs.smooth.sh · its alternatives →
- 17
A scrapy-based Hacker News crawler. Contribute to mvanveen/hncrawl development by creating an account on GitHub.
2012 · github.com · its alternatives →
- 18
Web Speed▲118Hey everyone, I've been working on a tool called Web Speed. It takes web pages full of HTML and parses them into an easily readable sitemap for an AI agent. By ensuring the AI doesn't have to analyze the full HTML from the page or screenshots of the page, it makes the agent a lot cheaper and faster. It's MCP-native, so any AI that supports MCP can run it and take control of your browser for you. There are both “normal” and post-auth versions live on GitHub. What I think is the coolest thing about the project is the global cache of sitemaps. When a user visits a site, it takes the sitemap and…
May 2026 · getwebspeed.io · its alternatives →
- 19
A lightweight, single-binary coding agent harness written in Go. Anthropic, OpenAI, Kimi, DeepSeek, Google Gemini, Ollama, managed llama.cpp models, five built-in tools, three run modes, extensions in any language, and a built-in Telegram bridge.
May 2026 · zot.sh · its alternatives →
- 20
Your AI agent is burning 6x more tokens than it needs to just to browse the web. We built OpenBrowser MCP to fix that. Most browser MCPs give the LLM dozens of tools: click, scroll, type, extract, navigate. Each call dumps the entire page accessibility tree into the context window. One Wikipedia page? 124K+ tokens. Every. Single. Call. OpenBrowser works differently. It exposes one tool. Your agent writes Python code, and OpenBrowser executes it in a persistent runtime with full browser access. The agent controls what comes back. No bloated page dumps. No wasted tokens. Just the data your…
Apr 2026 · openbrowser.me · its alternatives →
- 21OS
Large Language Models (LLMs) are powerful, but they’re limited by fixed context windows and outdated knowledge. What if your AI could access live search, structured data extraction, OCR, and more—all through a standardized interface? We built the JigsawStack MCP Server, an open-source implementation of the Model Context Protocol (MCP) that lets any AI model call external tools effortlessly. Here’s what it unlocks: - Web Search & Scraping: Fetch live information and extract structured data from web pages. - OCR & Structured Data Extraction: Process images, receipts, invoices, and handwritten…
2025 · its alternatives →
- 22
MCP360▲61Hey HN Community, I built MCP360 after spending weeks integrating APIs for an AI agent project. Each tool needed its own setup, auth, billing, and maintenance. When any APIs changed, my integrations broke. I got tired of it. MCP360 is a single gateway giving AI agents access to 100+ tools through one config block. Search engines, web scraping, SEO, e-commerce data, maps, domain tools, and more. Real example: Instead of managing Google Search, web scraping, SERP tracking, and keyword research as 4 separate subscriptions (4 bills, 4 auth systems, 4 points of failure), you connect once. Works…
2025 · mcp360.ai · its alternatives →
- 23
:racehorse:✈️ Pegasus is a scalable, modular, polite web-crawler for Clojure - shriphani/pegasus
2016 · github.com · its alternatives →
- 24
A collection of open-source TypeScript tools by @enmanuelmag. heimdall-mcp for MCP proxy telemetry. agent-harness-kit for multi-agent orchestration.
May 2026 · ahk.cardor.dev · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →