nowfound

Dev tools · September 19, 2018

PM

Puppet-master, simple and scalable (programmatic) website interaction

Did you ever need to interact with a website, not only using plain http but a real browser? Have you ever felt the pain using selenium or struggled reading data from a rendered SPA website? We did, and we suffered. During development of a SaaS platform we built puppet-master, a scalable and flexible way of interacting with websites using well known and plain EcmaScript 6, wrapped in a simple API and thus usable by most programming languages. You can find the docs at https://docs.puppet-master.io/ and any feedback is greatly appreciated!

Puppet-master, simple and scalable (programmatic) website interaction launched on September 19, 2018 with 5 votes, #1,209 of 2,635 launches that month and more than 50% of that year's launches.

Alternatives

Does a similar job

all alternatives →
  • Getting started with Puppeteer and Chrome Headless for Web Scraping2017 · github.com · ▲142

    Getting started with Puppeteer and Chrome Headless for Web Scraping - emadehsan/thal

  • Puppet Master2019 · ▲137

    Headless Chrome as a service

  • Puppeteer API2020 · ▲139

    Convert your website into an API

  • Web scraping that just works with OpenFaaS with Puppeteer2020 · openfaas.com · ▲145

    Learn how to scrape webpages using Puppeteer and Serverless Functions built with OpenFaaS.

  • Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

    Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

  • Owl BrowserJan 2026 · owlbrowser.net · ▲145

    I've been working on browser automation infrastructure for a while and kept hitting the same ceiling: Playwright and Puppeteer are great for scripting but fall apart when you need stealth at scale. Cloud-based solutions like Browserbase work but you're sending all your data to a third party and can't control the environment. So we built Owl Browser, a self-hosted Chromium-based engine that runs in a single Docker container. The core technical problem we tried to solve was fingerprint consistency. Most browser automation tools either ignore fingerprinting entirely or apply surface-level…

More dev tools this month

the category →
  • /dev/null▲490

    a social network for devs

    Dev tools · 4d ago · dev-null.sh

  • Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

    open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 29d ago · github.com

  • Reladraw – A diagram language where you decide where to place things▲411

    Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 27d ago · github.com

  • Run full iOS 16.5 firmware on Android Devices▲372

    Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

    Dev tools · 14h ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 24d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 21d ago · talanoa.email

Source: Show HN post ↗

Launched alongside, September 2018

the whole month →