Apify SDK for Python

What it does

Easily build, deploy, and manage Actor web scrapers directly from your Python code and rely on the Apify platform for data storage, infrastructure scaling, scheduling runs, and proxies.

• 
  Apify2020 · ▲271

  Your one-stop shop for web scraping and web RPA solutions

• 
  Apifier2015 · ▲223

  The web scraping and automation platform

• RP
  Run Python web scrapers in the cloud using new Apify SDK for Python2023 · github.com · ▲5
• CW
  Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

  Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

• AS
  Apify SDK – A scalable web crawling and scraping library for JavaScript2018 · github.com · ▲78
• AT
  Apify – Turn any website into an API2017 · apify.com · ▲45

• 
  Dograh▲592

  The open source VAPI alternative

  Dev tools · 25d ago · dograh.com

• 
  Meridian▲530

  Don't let your work go unnoticed. Get promoted!

  Dev tools · 20d ago · meridiona.com

• 
  x1▲516

  Lovable for iPhone apps go from idea to App Store

  Dev tools · 11d ago · x1.new

• 
  The GTM Co-Founder▲402

  Open-source GTM skills for technical founders

  Dev tools · 29d ago · gtmcofounder.com

• 
  Nuphos▲380

  The AI-Native DevOps Workspace.

  Dev tools · 24d ago · nuphos.ai

• 
  Open-Source eInk Bike Computer▲375

  OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

  Dev tools · 1d ago · opentrailpaper.com

• 
  GPT-4▲1,161

  LLM that exhibits human-level performance

  AI · 2023 · openai.com

• 
  Collato▲972

  One AI search to find anything instantly, across all apps

  AI · 2023

• 
  Typing Mind▲827

  A better UI for ChatGPT

  AI · 2023 · typingmind.com

• 
  Arc for iOS▲825

  Meet the internet again

  Work · 2023 · apps.apple.com

• 
  Sequoia▲726

  Anonymous sexual health app for men

  Life & fun · 2023 · sequoia.health

• BI
  BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT▲688

  I'm a big fan of the BBC podcast In Our Time -- and (like most people) I've been playing with the OpenAI APIs. In Our Time has almost 1,000 episodes on everything from Cleopatra to the evolution of teeth to plasma physics, all still available, so it's my starting point to learn about most topics. But it's not well organised. So here are the episodes sorted by library code. It's fun to explore. Web scraping is usually pretty tedious, but I found that I could send the minimised HTML to GPT-3 and get (almost) perfect JSON back: the prompt includes the Typescript definition. At the same time I…

  AI · 2023 · genmon.github.io