Web Crawler

What it does

Effortlessly uncover and gather precisely the data you need from your target websites. With Web Crawler, control the crawling method, scope, and tailor the end results to match your requirements.

• 
  Crawly2016 · ▲601

  Never write another web scraper

• 
  Crawlee2022 · ▲229

  Build reliable web scrapers and robots, fast!

• 
  Crawlr By Crawlr Labs2024 · ▲8

  Effortlessly scrape web data with Crawlr.

• 
  Crawler.shMar 2026 · crawler.sh · ▲352

  Free Local AEO & SEO Spider and a Markdown content extractor

• 
  SCRAPRMar 2026 · scraprbeta.vercel.app · ▲260

  The data layer for the agentic web

• 
  Crawlify2020 · ▲165

  AI powered data extraction APIs. Hassle-free data retrieval.

• TL
  The load-bearing vocabulary of Claude▲703

  Life & fun · 12d ago · louisabraham.github.io

• 
  Articos▲398

  Launch with confidence, not gut instinct

  Life & fun · 14d ago · articos.com

• 
  Nex▲357

  Claude Cowork for high-volume GTM workflows

  Life & fun · 6d ago · nex.ai

• CC
  Creatium Coach▲321

  Your multimedia mentor that takes you from mid to great

  Life & fun · 13d ago · producthunt.creatium.info

• 
  Notify.domains▲315

  Know the moment a domain opportunity appears

  Life & fun · 11d ago · notify.domains

• 
  Scroll through all 43252003274489856000 Rubik's Cube states▲295

  Scroll through all 43,252,003,274,489,856,000 reachable Rubik's Cube permutations.

  Life & fun · 29d ago · everycube.alen.is

• 
  Resend▲1,326

  Email for developers

  Dev tools · 2023 · resend.com

• 
  STORI AI▲1,320

  Your ideas become visually compelling branded social posts

  AI · 2023 · storiai.com

• 
  Kombai▲1,080

  A new AI model that you can prompt with UI designs

  AI · 2023 · kombai.com

• 
  User Persona Generator▲1,014

  Understand your audience without 50 interviews

  AI · 2023 · founderpal.ai

• 
  Lottielab▲871

  Create and ship lottie animations to sites and apps faster

  Dev tools · 2023 · lottielab.com

• LC
  LLMs can generate valid JSON 100% of the time▲854

  Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

  AI · 2023 · github.com