Scrapingdog

What it does

We have launched our New Product for data Extraction. We build this product for everyone whether you are a developer or not. Features : Premium Proxies & Captcha Solving capabilities. Scraped data is stored in local storage. APIs, Tools & Extension

Scrapingdog is your all-in-one Web Scraping API, effortlessly managing proxies and headless browsers, allowing you to extract the data you need with ease.

Scrapingdog provides a powerful web scraping API along with dedicated APIs to extract data from search engines, social platforms, and e-commerce websites. We manage proxies, browsers, and blocking, so you can focus on building your product without worrying about the backend. Websites detect bots quickly, and suddenly your requests stop working. You keep getting blocked again and again, and it gets frustrating. 40M+ rotating proxies, browser rendering, and built-in anti-bot handling. Scrapingdog takes care of it automatically so your scraping never stops. Headless browsers crash. Proxy providers go down at any time. CAPTCHAs appear randomly. Your team ends up fixing scrapers instead of…from scrapingdog.com

• 
  Online Web Scraper2016 · datascraping.co · ▲260

  Cloud hosted data extraction tool

• 
  Simple Scraper2019 · simplescraper.io · ▲556

  Turn any website into an API in just a few seconds.

• 
  Web Scraper API2021 · datashake.com · ▲287

  Scrape the web at scale without getting blocked

• 
  ScrapeIN'2022 · soax.com · ▲128

  Effortless data extraction from any website

• 
  ScrapeAll2022 · ▲87

  Automated web data scraper

• 
  I made a Chrome extension that can scrape any website with one click2024 · easyscraper.com · ▲31

  Hi HN! Ah yes, another web scraper. There are so many out there, so why make another one? Because I wanted one that's stupid simple and stupid fast. Unlike most web scrapers, Easy Scraper doesn’t make you build a new scraper for each site or individually select fields. You just open it and bam, your data's ready to go. My favorite use case for instantly extracting data anywhere is being able to easily talk to ChatGPT about custom datasets. For example, here's a 1-minute demo of me scraping my Twitter followers to find the ones that live in San Francisco:…

• 
  /dev/null▲490

  a social network for devs

  Dev tools · 4d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 29d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Run full iOS 16.5 firmware on Android Devices▲372

  Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

  Dev tools · 15h ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 24d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 21d ago · talanoa.email

• 
  A basketball hoop to maximize shots that go in [video]▲971

  https://github.com/OlexG/finclaw ^ repo if anyone wants to contribute. I realized that sometimes I'm pretty good at making random guesses about the future. (I.E, I think OpenAI will beat Anthropic in the short term, etc...) However, I'm bad at converting these guesses into actual market plays I can profit from. As such, I wanted to make a tool that connects to the right APIs and launches a swarm of agent experts to generate related plays based on your prediction. The very first super shitty V0 MPV just has Polymarket/Kalshi bets, but I will be adding a more complex…

  AI · 2020 · youtube.com

• 
  CleanShot X▲951

  Mac-native app for screenshots, recordings and collaboration

  Dev tools · 2020 · cleanshot.com

• 
  How to say no.▲885

  Templates to help you say no in any situation

  Work · 2020 · starterstory.com

• 
  Avodocs 2.0▲878

  Free legal documents for startups

  Work · 2020

• 
  FalsiScan – Make it look like a PDF has been hand signed and scanned▲770

  For bureaucratic reasons, a colleague of mine had to print, sign, scan and send by email a high number of pages. To save trees, ink, time, and to...

  Life & fun · 2020 · gitlab.com

• 
  Good Books▲716

  Largest curated collection of 6,500+ book recommendations.

  Work · 2020 · goodbooks.io