wxpath – Declarative web crawling in XPath
wxpath is a declarative web crawler where web crawling and scraping are expressed directly in XPath. Instead of writing imperative crawl loops, you describe what to follow and what to extract in a single expression: import wxpath # Crawl, extract fields, build a Wikipedia knowledge graph path_expr = """ url('https://en.wikipedia.org/wiki/Expression_language') ///url(//main//a/@href[starts-with(., '/wiki/') and not(contains(., ':'))]) /map{ 'title': (//span[contains(@class,…
wxpath – Declarative web crawling in XPath launched on January 14, 2026 with 64 votes, #500 of 14,584 launches that month and more than 95% of that year's launches.
In plain words
wxpath is a declarative web crawler that lets users express web crawling and scraping using XPath syntax instead of writing traditional imperative loops. Users describe what links to follow and what data to extract in a single XPath expression, then iterate through results. It's designed for developers who need to scrape websites and build structured datasets from web content, particularly those already familiar with XPath query language.
written from the facts on this page · September 2026
From the sources
wxpath - declarative web crawling with XPath; a Web Query Language (WQL) - rodricios/wxpath
In the maker’s words, at launch
wxpath is a declarative web crawler where web crawling and scraping are expressed directly in XPath. Instead of writing imperative crawl loops, you describe what to follow and what to extract in a single expression: import wxpath # Crawl, extract fields, build a Wikipedia knowledge graph path_expr = """…
Does a similar job
all alternatives →
Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
Context.devJul 2026 · context.dev · ▲814Hello, My name is Yahia, I've been working on scraping products for a long time and maintain a couple of free sites in my spare time (E.g. knifegeek.io) What prompted this is i've rebuilt scraping infra at every company I've started and finally just made it a product. Pass a URL, get clean markdown, html, images, sitemap or pass a domain, get logos, colors, socials, industry data. Goal is to offer a better service than VC funded competitors at a fraction of the cost. Stealth is included and automatic at no additional cost (normally an upcharge by alternatives). Would love your honest thoughts.
Apify SDK – A scalable web crawling and scraping library for JavaScript2018 · github.com · ▲78Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf
More work this month
the category →
Endless lofi beats composed live in your browser, over pixel-art nights in Paris, Tokyo, New York, Hong Kong, Sydney, San Francisco and more. Free, no sign-up.
Work · 25d ago · loficities.com
Smooth Recorder▲257Mac screen recordings that look edited when you hit stop
Work · 19d ago · smoothrecorder.com
Work · 13d ago · readrare.com
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, January 2026
the whole month →- IN
Hey HN! I wanted to share something I built over the last few weeks: isometric.nyc is a massive isometric pixel art map of NYC, built with nano banana and coding agents. I didn't write a single line of code. Of course no-code doesn't mean no-engineering. This project took a lot more manual labor than I'd hoped! I wrote a deep dive on the workflow and some thoughts about the future of AI coding and creativity: http://cannoneyed.com/projects/isometric-nyc
AI · Jan 2026 · cannoneyed.com
Automatic AI-powered code reviews the moment you open a PR
Dev tools · Jan 2026 · kilo.ai
