Apify SDK for Python

What it does

Easily build, deploy, and manage Actor web scrapers directly from your Python code and rely on the Apify platform for data storage, infrastructure scaling, scheduling runs, and proxies.

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides everything you need to build an Actor and run it both locally and on the Apify platform . It handles the Actor lifecycle, storage access, platform events, Apify Proxy , pay-per-event charging, and more. Actors are serverless programs that can do almost anything. From simple scripts and web scrapers to complex automation workflows, AI agents, or even always-on services that expose HTTP endpoints. They can run either locally or on the Apify platform, where you can scale their execution, monitor runs, schedule tasks, integrate them with other services, or even publish and monetize them. If you're…from docs.apify.com

• 
  Apify2020 · apify.com · ▲271

  Thousands of tools to automate your business. Get real-time web data, track competitors, generate leads, and integrate your apps and AI agents.

• 
  Run Python web scrapers in the cloud using new Apify SDK for Python2023 · github.com · ▲5

  Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Bu

• 
  Apifier2015 · apify.com · ▲223

  The web scraping and automation platform

• 
  Apifier – hosted web crawler for developers2015 · apifier.com · ▲101

  Thousands of tools to automate your business. Get real-time web data, track competitors, generate leads, and integrate your apps and AI agents.

• 
  Crawlee CloudJan 2026 · crawlee.cloud · ▲5

  Hey HN, I built Crawlee Cloud, an open-source, self-hosted platform that lets you run Crawlee and Apify Actors on your own infrastructure. The problem: The Apify ecosystem (Crawlee, SDK, Actors) is fantastic for web scraping, but it's tied to their cloud. If you want to keep your data on-prem, run on your own servers, or save on costs at scale, you're stuck. The solution: Crawlee Cloud implements Apify's REST API so your existing Actors work without code changes. Just point APIFY_API_BASE_URL to your own server. What's included: SDK compatible: Datasets, Key-Value Stores, Request Queues all…

• 
  Apify SDK – A scalable web crawling and scraping library for JavaScript2018 · github.com · ▲78

  Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf

• 
  /dev/null▲481

  a social network for devs

  Dev tools · 2d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 25d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 22d ago · openbot.run

• 
  Talanoa▲341

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 20d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 28d ago · corespeed.io

• 
  GPT-4▲1,160

  More accurate, less cringe, smoother & useful daily chats!

  AI · 2023 · openai.com

• 
  Collato▲972

  One AI search to find anything instantly, across all apps

  AI · 2023

• 
  Typing Mind▲826

  Chat with AI using your API keys. Pay only for what you use. ChatGPT, Gemini, Claude, and other LLMs supported. The best chat LLM frontend UI for all AI models.

  AI · 2023 · typingmind.com

• 
  Arc for iOS▲825

  Meet the internet again

  Work · 2023 · apps.apple.com

• 
  Sequoia▲726

  Personalized men's sexual health with on-demand experts

  Life & fun · 2023 · sequoia.health

• BI
  BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT▲688

  I'm a big fan of the BBC podcast In Our Time -- and (like most people) I've been playing with the OpenAI APIs. In Our Time has almost 1,000 episodes on everything from Cleopatra to the evolution of teeth to plasma physics, all still available, so it's my starting point to learn about most topics. But it's not well organised. So here are the episodes sorted by library code. It's fun to explore. Web scraping is usually pretty tedious, but I found that I could send the minimised HTML to GPT-3 and get (almost) perfect JSON back: the prompt includes the Typescript definition. At the same time I…

  AI · 2023 · genmon.github.io