Webclaw
Turn any website into LLM-ready data
Webclaw launched on May 20, 2026 with 17 votes, #950 of 20,538 launches that month and more than 95% of that year's launches.
What it does
Webclaw turns websites into clean markdown, JSON, structured data, and LLM-ready content. Use it to scrape pages, crawl docs, extract fields, summarize, diff changes, and feed reliable web context into AI agents, RAG pipelines, CLI workflows, SDKs, and MCP clients. Designed for developers building with Claude Code, Cursor, LangChain, LlamaIndex, and custom agents.
Turn any website into LLM-ready markdown, JSON, or structured data. No browser, no Selenium. Handles bot protection. Returns static pages in around 118ms.
webclaw is a web scraping API that turns any URL into clean, LLM-ready markdown or JSON, with 90% fewer tokens than raw HTML. A drop-in Firecrawl replacement. Sign in and it runs for real — 3 free runs a day, no card. The hosted API is a paid plan from $19/mo; the open-source core is free to self-host. Webclaw is a Firecrawl alternative with a drop-in /v2 route and an open-source Rust core: swap one base URL, keep every call you already wrote, and ship product instead of scraping infra. Any of these 11 endpoints, in curl, TypeScript, Python, or Go — with the response it actually returns, rendered or raw. One API key, one credit pool, billed by what you use. Scrape . Turn any URL into clean,…from webclaw.io
Does a similar job
all alternatives →
LLM Scraper – turn any webpage into structured data2024 · github.com · ▲88Turn any webpage into structured data using LLMs. Contribute to mishushakov/llm-scraper development by creating an account on GitHub.
/agent by Firecrawl Dec 2025 · firecrawl.dev · ▲569While building mendable - we found that feeding LLMs well-structured markdown improved accuracy. We also found it surprisingly hard. We found some great tools online, but none reliably handled the entire process. We wanted an API that took a URL, crawled the pages in the URL, and gave us an easy-to-use, up-to-date markdown we could feed into our index. So, we released an open-source repo and an API that crawls and turns entire websites into a markdown with just a few lines of code The API handles: - Crawling without consistent sitemaps - Infra to handle running many crawling jobs - Proxying,…
I wrote an open-source browser alternative for Computer Use for any LLM2024 · github.com · ▲180Hey HN, I made Browser-Use, an open-source tool that lets (all Langchain supported) LLMs execute tasks directly in the browser just with function calling. It allows you to build agents that interact with web elements using natural language prompts. We created a layer that simplifies website interaction for LLMs by extracting xPaths and interactive elements like buttons and input fields (and other fancy things). This enables you to design custom web automation and scraping functions without manual inspection through DevTools. Hasn't this been done a lot of times? Good question, as a general…
Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 27d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 25d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 23d ago · openbot.run
Talanoa▲345Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 20d ago · talanoa.email
CoreSpeed▲332One MCP for everything your agents need: apps, memory, tools
Dev tools · 28d ago · corespeed.io
Source: Product Hunt launch ↗
Launched alongside, May 2026
the whole month →
Parallel agents, diff reviewer, and multi-model comparisons
Dev tools · May 2026 · kilo.ai
Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…
Life & fun · May 2026 · github.com
🌱 Private, quiet space for thinking. Simple app for .md files. - zakirullin/files.md
Dev tools · May 2026 · github.com