Alternatives
Products that do what WhiskeySour – A 10x faster drop-in replacement for BeautifulSoup does
The Problem I’ve been using BeautifulSoup for sometime. It’s the standard for ease-of-use in Python scraping, but it almost always becomes the performance bottleneck when processing large-scale datasets. Parsing complex or massive HTML trees in Python typically suffers from high memory allocation costs and the overhead of the Python object model during tree traversal. In my production scraping workloads, the parser was consuming more CPU cycles than the network I/O. Lxml is fast but again uses up a lot of memory when processing large documents and has can cause trouble with malformed…
- 1
- 2
- 3SA
Alright so if you run a self-hosted blog, you've probably noticed AI companies scraping it for training data. And not just a little (RIP to your server bill). There isn't much you can do about it without cloudflare. These companies ignore robots.txt, and you're competing with teams with more resources than you. It's you vs the MJs of programming, you're not going to win. But there is a solution. Now I'm not going to say it's a great solution...but a solution is a solution. If your website contains content that will trigger their scraper's safeguards, it will get dropped from their data…
Dec 2025 · github.com
- 4IM
Hi! I'm Marcell, and I'm working on FetchFox (https://fetchfoxai.com). It's a Chrome extension that lets you use AI to scrape any website for any data. I'd love to get your feedback. Here's a quick demo showing how you can use it to scrape leads from an auto dealer directory. What's cool is that it scrapes non-uniform pages, which is quite hard to do with "traditional" scrapers: https://youtu.be/wPbyPSFsqzA A little background: I've written lots and lots of scrapers over the last 10+ years. They're fun to write when they work, but the internet has changed in ways…
2024 · fetchfoxai.com
- 5
- 6
- 7
- 8SA
2022 · shalerb.org
- 9WS
2018 · apify.com
- 10SA
2014 · github.com
- 11
- 12TT
We've been trying to evaluate web scraping companies, but when you look at their benchmarks, you can't verify anything, and they mostly exist to prove the company is successful. They put somewhere between 98% and 100% because they pick their own urls, define success their own way, and don't publish the harness. We also saw companies like scrapfly astroturf websites like scrapeway and call them independent. So, we built an open source benchmark that we want to represent the frontier of web data. We're trying to look across all major anti-bot providers and industries, to build a comprehensive…
Jul 2026 · github.com
- 13AA
2017 · choppingboard.recipes
- 14MA
Two months ago, I started building this side-project in the morning, before my full-time job. A visual and easy-to-use web scraping app. Please, roast it a bit so I can work on improving it. Thanks.
2023 · mrscraper.com
- 15FC
2017 · github.com
- 16IM
Hi HN! Ah yes, another web scraper. There are so many out there, so why make another one? Because I wanted one that's stupid simple and stupid fast. Unlike most web scrapers, Easy Scraper doesn’t make you build a new scraper for each site or individually select fields. You just open it and bam, your data's ready to go. My favorite use case for instantly extracting data anywhere is being able to easily talk to ChatGPT about custom datasets. For example, here's a 1-minute demo of me scraping my Twitter followers to find the ones that live in San Francisco:…
2024 · easyscraper.com
- 17
- 18LS
2024 · github.com
- 19FF
Hi HN! While working on a project that involves frequently parsing a lot of feeds, I needed a fast JavaScript-based parser to extract specific fields from feed namespaces. Existing Node packages were either too slow or merged all feed formats, losing namespace information. So I decided to write it myself and created this NPM package with a simple API. Feedsmith supports all feed formats and many popular namespaces, including: Podcast, Media, iTunes, Dublin Core, and more. It can also parse and generate OPML files. I am currently adding support for more namespaces and feed generation for RSS,…
2025 · github.com
- 20CC
2015 · cloudscrape.com
- 21GB
2017 · github.com
- 22
- 23
RAG-ready web scraping that cuts your LLM token costs
Apr 2026 · geekflare.com
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with a description →