Trawl – Scrape any site with natural language fields, not CSS selectors
Every scraper I've written has the same failure mode: it works for three months, a site redesigns, and my CSS selectors silently return empty strings. The data is still right there on the page — a human can find it instantly — but the scraper is blind. Trawl fixes this by splitting the problem. You describe what you want: trawl "https://books.toscrape.com" --fields "title, price, rating, in_stock" The LLM (Claude) looks at one sample item and derives a full extraction strategy — CSS selectors, attribute mappings, type coercion, fallback selectors. That strategy gets cached. Every…
Trawl – Scrape any site with natural language fields, not CSS selectors launched on March 8, 2026 with 8 votes, #1,340 of 23,380 launches that month and more than 75% of that year's launches.
What it does
Contribute to akdavidsson/trawl development by creating an account on GitHub.
In the maker’s words, at launch
Every scraper I've written has the same failure mode: it works for three months, a site redesigns, and my CSS selectors silently return empty strings. The data is still right there on the page — a human can find it instantly — but the scraper is blind. Trawl fixes this by splitting the problem. You describe what you…
Does a similar job
all alternatives →
Robust LLM extractor for websites in TypeScriptMar 2026 · github.com · ▲72We've been building data pipelines that scrape websites and extract structured data for a while now. If you've done this, you know the drill: you write CSS selectors, the site changes its layout, everything breaks at 2am, and you spend your morning rewriting parsers. LLMs seemed like the obvious fix — just throw the HTML at GPT and ask for JSON. Except in practice, it's more painful than that: - Raw HTML is full of nav bars, footers, and tracking junk that eats your token budget. A typical product page is 80% noise. - LLMs return malformed JSON more often than you'd expect, especially with…
LLM Scraper – turn any webpage into structured data2024 · github.com · ▲88Turn any webpage into structured data using LLMs. Contribute to mishushakov/llm-scraper development by creating an account on GitHub.
Selector ForgeJun 2026 · selectorforge.ai · ▲133Hi HN, I'm Ahmad from the Intuned (https://intunedhq.com) team. Today, we're releasing and open-sourcing Selector Forge (https://selectorforge.ai/), a browser extension that generates reliable CSS/XPath selectors using AI. You can use it to create a selector for a single element or for an array of elements. The selectors it creates are meant to be "semantic" and more resilient to page changes than what Chrome DevTool’s “Copy Selector” (and other similar extensions) give you. Those tend to hand you something brittle like `#top > div.w-100.ph0-l.ph3.ph4-m > h1 >…
- IMI'm making an AI scraper called FetchFox2024 · fetchfoxai.com · ▲105
Hi! I'm Marcell, and I'm working on FetchFox (https://fetchfoxai.com). It's a Chrome extension that lets you use AI to scrape any website for any data. I'd love to get your feedback. Here's a quick demo showing how you can use it to scrape leads from an auto dealer directory. What's cool is that it scrapes non-uniform pages, which is quite hard to do with "traditional" scrapers: https://youtu.be/wPbyPSFsqzA A little background: I've written lots and lots of scrapers over the last 10+ years. They're fun to write when they work, but the internet has changed in ways…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, March 2026
the whole month →
Switch from ChatGPT to Claude with import memory feature
AI · Mar 2026 · claude.com
Littlebird▲709Littlebird remembers everything across your meetings, messages, docs, and apps, then takes action so you can recall any detail and never lose context.
AI · Mar 2026 · littlebird.ai
