Search Engine and Crawler in Python

In plain words

Search Engine and Crawler in Python is a developer tool that provides functionality for building search engines and web crawlers using Python. Launched in 2017, it offers the technical components needed to index and retrieve web content. The tool is designed for developers who need to implement search capabilities or crawl websites as part of their projects. It runs on the Python platform and is available at openstar.pw.

written from the facts on this page · September 2026

• 
  Crawly2016 · crawly.diffbot.com · ▲606

  Never write another web scraper

• 
  Crawlee2022 · crawlee.dev · ▲229

  Build reliable web scrapers and robots, fast!

• 
  A Python Spider System with Web UI2014 · github.com · ▲159

  A Powerful Spider(Web Crawler) System in Python. Contribute to binux/pyspider development by creating an account on GitHub.

• 
  Crawler.shMar 2026 · crawler.sh · ▲349

  Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown

• 
  Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language2019 · github.com · ▲116

  Distributed web crawler admin platform for spiders management regardless of languages and frameworks. - tikazyq/crawlab

• 
  Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282

  Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

• 
  /dev/null▲481

  a social network for devs

  Dev tools · 2d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 25d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 22d ago · openbot.run

• 
  Talanoa▲341

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 20d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 28d ago · corespeed.io

• 
  AutoDraw▲1,385

  Autocorrect for drawing, by Google

  AI · 2017 · autodraw.com

• 
  Stripe Atlas▲1,320

  The best way to start an internet business

  Commerce · 2017 · atlas.stripe.com

• 
  Sorting Two Metric Tons of Lego▲1,264

  Life & fun · 2017 · jacquesmattheij.com

• 
  The Boring Company▲1,057

  Elon Musk's new company, creating tunnels for traffic

  Growth · 2017 · boringcompany.com

• 
  Ask Product Hunt▲842

  A community-powered product search engine

  Life & fun · 2017

• 
  Lyrebird▲840

  Copy the voice of anyone, using a voice imitation algorithm

  AI · 2017 · descript.com