Alternatives
Products that do what caniscrape does
Know before you scrape.
- 1SA
Alright so if you run a self-hosted blog, you've probably noticed AI companies scraping it for training data. And not just a little (RIP to your server bill). There isn't much you can do about it without cloudflare. These companies ignore robots.txt, and you're competing with teams with more resources than you. It's you vs the MJs of programming, you're not going to win. But there is a solution. Now I'm not going to say it's a great solution...but a solution is a solution. If your website contains content that will trigger their scraper's safeguards, it will get dropped from their data…
Dec 2025 · github.com
- 2
- 3TU
2021 · github.com
- 4
- 5
- 6
- 7
- 8MA
Two months ago, I started building this side-project in the morning, before my full-time job. A visual and easy-to-use web scraping app. Please, roast it a bit so I can work on improving it. Thanks.
2023 · mrscraper.com
- 9
- 10
- 11CP
Hi HN, I built CountermarkAI, a lightweight anti-scraping & bot-detection tool for content creators and website owners. It’s designed to help protect your work from unauthorized scraping and AI training, that repurposed your work without permission. How It Works: Use Hashtag – Creators add a unique hashtag to their content as a declaration of ownership. Protect Website – For those running your own sites, simply add a small snippet to your . The protect.js script works asynchronously by sending metadata from every page load back to our servers, logging requests, and flagging known AI-training…
2025 · countermarkai.com
- 12DA
2024 · github.com
- 13
- 14WV
2017 · wrapapi.com
- 15
- 16
- 17
- 18
- 19AE
2024 · github.com
- 20IA
IPDetective collects data from about 60+ different sources such as official cloud provider endpoints and public VPN/Proxy/Tor/Bot net lists. Then aggregates this data into a fast and easy to use API that can be integrated into applications or scripts easily. IPDetective started as a hobby project for my other hobby projects :) and I decided to wrap a simple website around and offer it as a service. Let me know what your thoughts, if you find value in this service or if you have any feature requests.
2022 · ipdetective.io
- 21CH
There is a growing number of companies offering anti-bot protection SaaS to protect websites from scraping by automated bots based on Puppeteer/Selenium. Most of them rely on browser properties such as headers, javascript properties (window., navigator.), behavior analysis, to build device/user fingerprints and match it against a database of "whitelisted" fingerprints (typical user behavior/settings/device props etc). For the past few months, together with two other devs I have worked on a customized Puppeteer/Playwright scraping backend. It's essentially a drop-in…
2021
- 22AO
This is a small PoC Python project for web server access logs analyzing to classify and dynamically block bad bots, such as L7 (application-level) DDoS bots, web scrappers and so on. We'll be happy to gather initial feedback on usability and features, especialy from people having good or bad experience wit bots. *Requirements* The analyzer relies on 3 Tempesta FW specific features which you still can get with other HTTP servers or accelerators: 1. JA5 client fingerprinting (https://tempesta-tech.com/knowledge-base/Traffic-Filtering-b...). This is a HTTP and TLS layers…
Oct 2025 · github.com
- 23
- 24RL
We've been building data pipelines that scrape websites and extract structured data for a while now. If you've done this, you know the drill: you write CSS selectors, the site changes its layout, everything breaks at 2am, and you spend your morning rewriting parsers. LLMs seemed like the obvious fix — just throw the HTML at GPT and ask for JSON. Except in practice, it's more painful than that: - Raw HTML is full of nav bars, footers, and tracking junk that eats your token budget. A typical product page is 80% noise. - LLMs return malformed JSON more often than you'd expect, especially with…
Mar 2026 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →