nowfound

Life & fun · October 31, 2020

Web scraping that just works with OpenFaaS with Puppeteer

Learn how to scrape webpages using Puppeteer and Serverless Functions built with OpenFaaS.

Web scraping that just works with OpenFaaS with Puppeteer launched on October 31, 2020 with 145 votes, #232 of 4,018 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 5 years on.

Visit openfaas.com ↗Alternativestop 6% of October 2020

In plain words

This project integrates Puppeteer web scraping capabilities with OpenFaaS, a serverless framework. It enables developers to run automated browser-based scraping tasks in a serverless environment. The solution combines OpenFaaS's function-as-a-service infrastructure with Puppeteer's headless browser automation, making it suitable for developers who need scalable web scraping without managing server infrastructure.

written from the facts on this page · September 2026

From the sources

Learn how to scrape webpages using Puppeteer and Serverless Functions built with OpenFaaS. In this post I’ll introduce you Puppeteer and show you how to use it to automate and scrape websites using OpenFaaS functions. When testing an application, there are numerous options and these fall into two categories: rendered webpages, running with JavaScript and a real browser, and then text-based tests which can only parse static HTML. As you may imagine, loading a full web-browser in memory is a heavy-weight task. In a previous position I worked heavily with Selenium , which has language bindings for C#, Java, Python, Ruby and other languages. Whilst our team tried to implement most of our tests…from openfaas.com

Does a similar job

all alternatives →
  • Getting started with Puppeteer and Chrome Headless for Web Scraping2017 · github.com · ▲142

    Getting started with Puppeteer and Chrome Headless for Web Scraping - emadehsan/thal

  • OpenFaaS template for headless Chrome and Puppeteer2021 · github.com · ▲41

    OpenFaaS template for headless Chrome and Puppeteer - GitHub - alexellis/openfaas-puppeteer-template: OpenFaaS template for headless Chrome and Puppeteer

  • Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

    Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

  • Spider Free2019 · chromewebstore.google.com · ▲354

    Turn websites into organized data without code.

  • Headless Chrome Crawler2018 · github.com · ▲172

    Distributed crawler powered by Headless Chrome. Contribute to yujiosaka/headless-chrome-crawler development by creating an account on GitHub.

  • Crawlee2022 · crawlee.dev · ▲229

    Build reliable web scrapers and robots, fast!

More life & fun this month

the category →

Source: Show HN post ↗

Launched alongside, October 2020

the whole month →