Run Python web scrapers in the cloud using new Apify SDK for Python
Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Bu
Run Python web scrapers in the cloud using new Apify SDK for Python launched on March 14, 2023 with 5 votes, #2,445 of 5,007 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 3 years on.
What it does
Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client. - apify/apify-sdk-python
Does a similar job
all alternatives →
Apify2020 · apify.com · ▲271Thousands of tools to automate your business. Get real-time web data, track competitors, generate leads, and integrate your apps and AI agents.
Apifier – hosted web crawler for developers2015 · apifier.com · ▲101Thousands of tools to automate your business. Get real-time web data, track competitors, generate leads, and integrate your apps and AI agents.
Apify SDK – A scalable web crawling and scraping library for JavaScript2018 · github.com · ▲78Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf
Crawlee CloudJan 2026 · crawlee.cloud · ▲5Hey HN, I built Crawlee Cloud, an open-source, self-hosted platform that lets you run Crawlee and Apify Actors on your own infrastructure. The problem: The Apify ecosystem (Crawlee, SDK, Actors) is fantastic for web scraping, but it's tied to their cloud. If you want to keep your data on-prem, run on your own servers, or save on costs at scale, you're stuck. The solution: Crawlee Cloud implements Apify's REST API so your existing Actors work without code changes. Just point APIFY_API_BASE_URL to your own server. What's included: SDK compatible: Datasets, Key-Value Stores, Request Queues all…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, March 2023
the whole month →
Typing Mind▲826Chat with AI using your API keys. Pay only for what you use. ChatGPT, Gemini, Claude, and other LLMs supported. The best chat LLM frontend UI for all AI models.
AI · 2023 · typingmind.com
Sequoia▲726Personalized men's sexual health with on-demand experts
Life & fun · 2023 · sequoia.health
- BI
I'm a big fan of the BBC podcast In Our Time -- and (like most people) I've been playing with the OpenAI APIs. In Our Time has almost 1,000 episodes on everything from Cleopatra to the evolution of teeth to plasma physics, all still available, so it's my starting point to learn about most topics. But it's not well organised. So here are the episodes sorted by library code. It's fun to explore. Web scraping is usually pretty tedious, but I found that I could send the minimised HTML to GPT-3 and get (almost) perfect JSON back: the prompt includes the Typescript definition. At the same time I…
AI · 2023 · genmon.github.io