Voyager – write a web crawler/scraper as a state machine in Rust

In plain words

Voyager is a web crawler and scraper tool written in Rust that uses a state machine approach. It's designed for developers who need to extract data from websites or perform large-scale web crawling tasks. The tool leverages Rust's performance and safety features to handle complex crawling workflows through a state machine pattern, making it suitable for building reliable web data extraction pipelines.

written from the facts on this page · September 2026

• 
  Warp, a Rust-based terminal2022 · warp.dev · ▲946

  Hi HN community, I’m Zach, founder and CEO of Warp, and am excited to show you Warp, a fast Rust-based terminal that’s easy to use and built for teams. As of today, Warp is in public beta and any Mac user can download it. It works with bash, zsh, and fish. The terminal’s teletype-like interface has made it hard for the CLI to thrive. After 20 years of programming, I still find it hard to copy a command’s output; I always forget how to use `tar`; and I always have to relearn how to move my cursor. To fix fundamental accessibility issues, I believe we need to start innovating on the terminal,…

• 
  Context.devJul 2026 · context.dev · ▲814

  Hello, My name is Yahia, I've been working on scraping products for a long time and maintain a couple of free sites in my spare time (E.g. knifegeek.io) What prompted this is i've rebuilt scraping infra at every company I've started and finally just made it a product. Pass a URL, get clean markdown, html, images, sitemap or pass a domain, get logos, colors, socials, industry data. Goal is to offer a better service than VC funded competitors at a fraction of the cost. Stealth is included and automatic at no additional cost (normally an upcharge by alternatives). Would love your honest thoughts.

• 
  Vector – A High-Performance Log and Metric Router Written in Rust2019 · github.com · ▲322

  A high-performance observability data pipeline. Contribute to vectordotdev/vector development by creating an account on GitHub.

• 
  Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

  Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

• 
  GraphQL Voyager – Represent Any GraphQL API as an Interactive Graph2017 · github.com · ▲163

  🛰️ Represent any GraphQL API as an interactive graph - APIs-guru/graphql-voyager

• 
  SCRAPRMar 2026 · scraprbeta.vercel.app · ▲260

  The data layer for the agentic web

• 
  /dev/null▲490

  a social network for devs

  Dev tools · 4d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 28d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 26d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 24d ago · openbot.run

• 
  Run full iOS 16.5 firmware on Android Devices▲349

  Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

  Dev tools · 12h ago · github.com

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 21d ago · talanoa.email

• 
  Spline▲1,191

  Design tool for 3D web experiences

  Work · 2020 · spline.design

• PP
  PSX Party – Online Multiplayer Playstation 1 Emulator Using WebRTC▲676

  Play classic 32-bit retro games online with friends! Free multiplayer emulator in your browser. No downloads required.

  Life & fun · 2020 · psxparty.kosmi.io

• A2
  After 2.5 years on my side project, it has hit £500/month revenue▲647

  It's been a long slow hog and I almost gave up a few times (more than a few) but when covid hit this year it gave me some time to really focus on my product. There were stupid user journey things that I knew needed fixed. There were some features I knew needed added. And I knew the pricing was wrong. I spent some hardcore time working on these things back in March / April and since then my MRR has continued to grow. My product is SongBox (https://songbox.rocks) - it's an alternative to things like bandcamp and soundcloud for creators who need to share audio files privately.…

  Commerce · 2020

• TW
  This website is valid JSON▲604

  Life & fun · 2020 · webdatarender.com

• 
  UserLeap▲590

  AI-powered, product research platform

  Growth · 2020 · sprig.com

• 
  Headlime 2.0▲568

  Professional marketing copy for anyone

  AI · 2020 · headlime.com