Supacrawler

What it does

Supacrawler is now open-source! We also released a new feature: Parse. What if you could ask ChatGPT to list all of the careers on openai.com/careers and receive everything back in a CSV? In JSON? Or any other website? That's exactly what it does. Try it!

• 
  Supacrawler2025 · ▲9

  Headless browser tool for scraping anything on the internet

• NE
  News Extract API – Pull structured data from online news articles2020 · ▲131

  Hey HN, It will be more of a "How I released my API without managing a website, servers, users, and payments. With 0$ up-front cost" Over the past year, I have come up with a plan of how I could release my own product without having to deal with managing users and/or dealing with payment processing. It is a 3 steps procedure: 1. Make an API that solves a problem 2. Deploy it with a serverless architecture 3. Distribute through an API Marketplace That took me about 2-3 days to develop an API using Flask, deploy it via Zappa on AWS, and release through RapidAPI. Source code of API:…

• 
  I Made an Open Source Platform for Structuring Any Unstructured Data2024 · github.com · ▲88

  Hey HN, I'm Adithya, a 20-year-old dev from India. I have been working with GenAI for the past year, and I've found it really painful to deal with the many different forms of data out there and get the best representation of it for my AI applications. That's why I built OmniParse—an open-source platform designed to handle any unstructured data and transform it into optimized, structured representations. Key Features: - Completely local processing—no external APIs - Supports ~20 file types - Converts documents, multimedia, and web pages to high-quality structured markdown - Table extraction,…

• 
  Open-source AI web parser lib & TUI2025 · github.com · ▲17

  Hey HN! I'm open-sourcing a little weekend side project. It's a terminal UI that generates parsers for webpages using AI, and a library that runs these parsers while you browse (it connects to Chrome over CDP). You can parse Twitter, LinkedIn, and HN posts and they get saved to a DuckDB database, so you can query them later. Contributions welcome! I wrote a bit more about it here: https://0thernet.substack.com/p/memo-2-selectron

• AO
  An open source, modern CSV importer tool in React2021 · czhu12.github.io · ▲15

  Machine Learning @ Airbnb

• 
  Superflows – open-source AI Copilot for SaaS products2023 · github.com · ▲37

  Henry, Matt and James here – we’re building an open source toolkit that makes it easy to integrate an LLM-powered copilot that talks to your API into software products. It works by calling API endpoints which you choose to expose to it. This lets the chatbot complete tasks within your software in response to natural language queries. It’s also open source, so you don’t have to send user data to another 3rd party. We support Llama 2, but we haven’t fine-tuned Llama 2 yet (coming soon) so highest accuracy is seen with GPT-4 or fine-tuned GPT-3.5 (much faster). We started working together 2…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 5d ago · beam.win

• 
  FastRouter.ai▲364

  Route requests to the right LLM for cost, latency & quality

  AI · 22d ago · fastrouter.ai

• 
  YouMind▲1,223

  The first AI creation studio where learning meets writing

  AI · 2025 · youmind.com

• 
  A store that generates products from anything you type in search▲1,184

  The site hit #1 on HN about a year ago. Got enough traffic that I turned it into a proper API. What's there: - REST API — 35k products, manually filterable by category, free key, 60 req/min - CLI — npx anycrap random -c food - faker.js plugin — bundled, no API call, works offline - HuggingFace dataset — full 35k rows for ML/training https://anycrap.shop/developers

  AI · 2025 · anycrap.shop

• 
  Term.everything – Run any GUI app in the terminal▲1,094

  I made a built-from scratch Wayland Compositor to display any GUI app* in the terminal! I think there is a lot of unexplored potential in custom Wayland compositors, a lot of really cool things you can embed existing applications into! So, I started with embedding apps into the terminal because that is the easiest input/output (output is just utf-8 and I use the great `chafa` library for that, and I just read from stdin for the input). If you have any other ideas for cool Wayland compositors, let me know. I purposedly wrote 80% the app in Typescript to appeal to the most developers and…

  Dev tools · 2025 · github.com

• IR
  I recreated Windows XP as my portfolio▲1,032

  Years ago I stumbled across a basic version of this concept and it stuck with me. I knew if I was ever going to take on such a project, it would need to be flawless, but without coding experience it was just another idea that would never happen. By the end of 2024, as AI coding tools exploded everywhere, I finally had a way to make it real. I started from zero knowledge and spent months collaborating with AI agents as a learning experience. Every pixel and every function went through me. The AI translated what I asked for into code, but every decision was human. I didn't use existing OS…

  AI · 2025 · mitchivin.com

• 
  Ada▲910

  Your own AI data analyst

  AI · 2025 · ada.im

• 
  VidAU - AI Video▲868

  Turn Product Images into Scroll-Stopping Video Ads

  Growth · 2025 · vidau.ai