nowfound

Dev tools · May 21, 2026

ScrapePro — Python CLI for scraping

Scrape static HTML and JavaScript-heavy sites from the cmd

What it does

crapePro is a Python CLI tool for web scraping and data extraction. It handles both static HTML sites (blogs, news, e-commerce) and JavaScript-heavy pages (Twitter, YouTube, SPAs) using Playwright's headless browser. Key features: - CSS selectors, XPath, table extraction - Article text extraction - Metadata extraction (OpenGraph, JSON-LD) - Site crawling - Change detection - Export to JSON, CSV, XLSX, Markdown, SQLite

Does the same job

all alternatives →
  • Simple Scraper2019 · ▲556

    Turn any website into an API in just a few seconds.

  • ScrapeOwl2020 · ▲386

    Simple and powerful web scraping API

  • ScrapeNinja2023 · ▲249

    Swiss army knife for high-performance web scraping

  • CW
    Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

    Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

  • WS
    Web scraping page analyzer2018 · apify.com · ▲166
  • ScrapeIN'2022 · ▲128

    Effortless data extraction from any website

More dev tools this month

the category →
  • Dograh592

    The open source VAPI alternative

    Dev tools · 25d ago · dograh.com

  • Meridian530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 20d ago · meridiona.com

  • x1516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 11d ago · x1.new

  • The first open-source price index for GPU compute

    Dev tools · 10d ago · getcomputable.com

  • OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 2d ago · opentrailpaper.com

  • Open-source GTM skills for technical founders

    Dev tools · 29d ago · gtmcofounder.com

Launched alongside, May 2026

the whole month →
  • Brew 905

    Like Claude design for email marketing

    AI · May 2026 · brew.new

  • Parallel agents, diff reviewer, and multi-model comparisons

    Dev tools · May 2026 · kilo.ai

  • StoreClaw805

    Grow your store profits with agents that know how to sell

    AI · May 2026 · storeclaw.ai

  • Give your agent a real number and voice to make calls.

    AI · May 2026 · pollyreach.ai

  • NW

    Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…

    Life & fun · May 2026 · github.com

  • FM

    Dev tools · May 2026 · github.com