Crawlio

What it does

Crawlio is a powerful, affordable web scraping and crawling platform offering batch scraping, custom search & scrape tools, and fast data extraction — built for developers, analysts, and businesses.

• 
  Crawly2016 · crawly.diffbot.com · ▲606

  Never write another web scraper

• 
  Crawlee2022 · crawlee.dev · ▲229

  Build reliable web scrapers and robots, fast!

• 
  Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

  Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

• 
  Crawler.shMar 2026 · crawler.sh · ▲349

  Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown

• 
  Headless Chrome Crawler2018 · github.com · ▲172

  Distributed crawler powered by Headless Chrome. Contribute to yujiosaka/headless-chrome-crawler development by creating an account on GitHub.

• 
  Crawlr By Crawlr Labs2024 · ▲8

  Effortlessly scrape web data with Crawlr.

• 
  /dev/null▲490

  a social network for devs

  Dev tools · 4d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 28d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 26d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 24d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 21d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 29d ago · corespeed.io

• IM
  I'm an airline pilot – I built interactive graphs/globes of my flights▲1,539

  Hey HN! Pilots everywhere are required to keep a logbook of all their flying hours, aircraft, airports, and so on. Since I track everything digitally (some people still just use paper logbooks!), I put together some data visualizations and a few 3D globes to show my flying history. This globe is probably my favourite so far: https://jameshard.ing/pilot/globes/all If you’ve got ideas for other graphs or ways to show this kind of data, I’d love to hear them!

  Life & fun · 2025 · jameshard.ing

• 
  Chronicle: Cursor for Slides▲1,212

  Stunning presentations with AI. No design skills required.

  AI · 2025 · chroniclehq.com

• 
  Bubble for native mobile apps (beta)▲1,026

  Build native mobile apps for iOS and Android without code.

  Dev tools · 2025 · bble.io

• 
  Twenty▲989

  Build your Enterprise CRM with an AI-friendly SDK

  Dev tools · 2025 · twenty.com

• 
  Pally - AI Relationship Management▲949

  All your connections, across all your socials.

  AI · 2025 · pally.com

• 
  Workout.cool – Open-source fitness coaching platform▲827

  I was the main contributor to workout.lol, an open-source fitness app to easily build a workout routine. The project had traction (1.4k GitHub stars, 95 forks, ~20K visits/month), but was eventually sold due to video licensing hurdles. The new owner stopped maintaining it, and the repo went abandoned. Over the next 9 months, I sent 15 emails to try to save it : no replies. Feature requests & issues were ignored. The community was left with a "broken" tool let's say. I couldn't just let it die So I built the new version from scratch with the same open-source spirit, but a better…

  Dev tools · 2025 · github.com