nowfound

Dev tools · January 7, 2026

Crawlee Cloud

Hey HN, I built Crawlee Cloud, an open-source, self-hosted platform that lets you run Crawlee and Apify Actors on your own infrastructure. The problem: The Apify ecosystem (Crawlee, SDK, Actors) is fantastic for web scraping, but it's tied to their cloud. If you want to keep your data on-prem, run on your own servers, or save on costs at scale, you're stuck. The solution: Crawlee Cloud implements Apify's REST API so your existing Actors work without code changes. Just point APIFY_API_BASE_URL to your own server. What's included: SDK compatible: Datasets, Key-Value Stores, Request Queues all…

Crawlee Cloud launched on January 7, 2026 with 5 votes, #3,400 of 14,585 launches that month and more than 75% of that year's launches.

What it does

Run Crawlee and Apify scrapers on your own infrastructure. Open source, Docker-based, and fully compatible with the Apify SDK. Keep your data private, deploy anywhere.

Self-hosted, open-source platform for running Crawlee and Apify Actors on your own infrastructure. Deploy web scrapers with Playwright, Puppeteer, or Cheerio.

A self-hosted, open-source platform for Crawlee and Apify Actors. Keep your code. Choose your infrastructure. # 1. Boot the platform on your own box. $ docker compose up -d Creating crawlee-api ... done Creating crawlee-runner ... done Creating crawlee-postgres ... done # 2. Push your existing Apify Actor — no rewrite. $ crawlee-cloud push my-actor ✓ Build #42 ready # 3. Run it. $ crawlee-cloud run my-actor Run abc123 SUCCEEDED — 1,243 items in dataset Drop-in compatible Change one line. Keep everything else. Your existing Apify Actor — the one you already wrote, tested, and shipped — runs on Crawlee Cloud without a single line of application code changing. Point it at your own API and…from crawlee.cloud

In the maker’s words, at launch

Hey HN, I built Crawlee Cloud, an open-source, self-hosted platform that lets you run Crawlee and Apify Actors on your own infrastructure. The problem: The Apify ecosystem (Crawlee, SDK, Actors) is fantastic for web scraping, but it's tied to their cloud. If you want to keep your data on-prem, run on your own…

Does a similar job

all alternatives →
  • Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

    Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

  • Apify SDK – A scalable web crawling and scraping library for JavaScript2018 · github.com · ▲78

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf

  • Apify SDK for Python2023 · docs.apify.com · ▲104

    Build and manage web scraping Actors in the cloud

  • Apify2020 · apify.com · ▲271

    Thousands of tools to automate your business. Get real-time web data, track competitors, generate leads, and integrate your apps and AI agents.

  • Apifier – hosted web crawler for developers2015 · apifier.com · ▲101

    Thousands of tools to automate your business. Get real-time web data, track competitors, generate leads, and integrate your apps and AI agents.

  • Apifier2015 · apify.com · ▲223

    The web scraping and automation platform

More dev tools this month

the category →
  • /dev/null▲481

    a social network for devs

    Dev tools · 2d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 27d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 25d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 22d ago · openbot.run

  • Talanoa▲341

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 20d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 27d ago · corespeed.io

Source: Product Hunt launch ↗ · launch text quoted in part

Launched alongside, January 2026

the whole month →
  • IN

    Hey HN! I wanted to share something I built over the last few weeks: isometric.nyc is a massive isometric pixel art map of NYC, built with nano banana and coding agents. I didn't write a single line of code. Of course no-code doesn't mean no-engineering. This project took a lot more manual labor than I'd hoped! I wrote a deep dive on the workflow and some thoughts about the future of AI coding and creativity: http://cannoneyed.com/projects/isometric-nyc

    AI · Jan 2026 · cannoneyed.com

  • Cowork▲1,088

    Turn Claude into your digital coworker

    AI · Jan 2026 · claude.com

  • DataFast▲867

    Revenue-first analytics

    Growth · Jan 2026 · datafa.st

  • OpenClaw▲836

    The AI that actually does things

    AI · Jan 2026 · openclaw.ai

  • Automatic AI-powered code reviews the moment you open a PR

    Dev tools · Jan 2026 · kilo.ai

  • AI Content Maker, for Social Media Publishing

    AI · Jan 2026 · postsyncer.com