Alternatives
Products that do what I built a tool that deconstructs websites to reveal their tech stack does
Hi HN, I built https://unbuilt.app to solve a problem I frequently faced as a developer: identifying the technology stack behind websites, especially those using newer frameworks and tools. While existing solutions rely on pre-saved data or signature databases, Unbuilt performs a fresh analysis by actually loading and examining the website code in real-time. This means it can detect cutting-edge technologies that often get missed by other analyzers. Technical details: - Uses Playwright to visit sites and analyze their resources - Queue-based architecture for handling concurrent…
- 1
- 2
- 3
- 4CA
Hey Hacker News! Launching gptengineer.app into beta today. It's like Claude Artifacts, but: - you can edit the code in your fav IDE (two-way github sync) - installs npm packages - automatically picks up build and runtime errors and fixes them - very fast, built with rust The full stack capabilities are built on supabase (prefer to not have to handle auth + user data at this point so this is owned by the user) The seed for this project was an open source experiment, posted about that previously here: https://news.ycombinator.com/item?id=36422730 Would love feedback if you give…
2024 · gptengineer.app
- 5IM
Yes, it's open source: https://github.com/lissy93/web-check :) Why I'm building this? There are a lot of tools out there for discovering meta and security data relating to a website, IP or server. But currently, there isn't anything that does everything, all in one place and without a paywall/ user sign up. It's still a WIP, and I'm working on a new version, with some more comprehensive checks, so any feedback would be much appreciated :)
2024 · v1.web-check.xyz
- 6TA
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io
- 7
- 8
- 9
- 10DR
I'd like to invite everyone to try out DontBeEvil.rip, an experimental search engine for developers. tl;dr $ alias rip="curl -G -H 'Accept: text/plain' --url https://dontbeevil.rip/search --data-urlencode " $ rip 'q=Heartbleed bug' DontBeEvil.rip is a year long experiment to see if a small team can build a developer-focused search engine that is self-sustaining on $10 monthly subscriptions. It works by only indexing high-quality resources that are relevant to developers. You won't get useless listicles because we'll never crawl them. Relevant urls are harvested from HN,…
2022
- 11
- 12
- 13CW
Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
2022 · crawlee.dev
- 14
- 15
- 16SD
2014 · stackshare.io
- 17
- 18SA
2017 · sitebulb.com
- 19SI
Hey all, I built StackScope, a crawler/catalogue that looks at new product launches and shows what they were built with. It watches launches from Product Hunt, Show HN, and PeerPush, then crawls the public site behind each one. The goal is to show what people actually launched with: hosting, frameworks, analytics, DNS, security headers, legal pages, AI-builder signals, and other public clues. I started building it because most stack-detection sites look at the web as a whole. I was more interested in the current indie launch scene: what people are choosing right now, at the point they…
Jun 2026 · stackscope.dev
- 20DT
2017 · sitestacks.com
- 21IC
I created this tool a few months ago to automate some of my tasks. I use it to collect prices and files and to get notified when something changes on certain websites. The task runner uses Playwright. I'm not sure if it can be useful to anybody else besides me :) Any feedback is welcome.
2022 · rocketride.io
- 22
- 23
- 24MS
Hello HN! I've been working on http://underthesite.com for the last month and now think it is ready for some full strength HN feedback. What do you guys think? It crawls up to 10 pages of a given site while you wait, looking for community-provided CSS / XPath selectors and regular expressions. Additionally, I'd like to appeal to you to submit matchers for technologies that you care about. Technologies are easy to add, so add your favorite jQuery plugins, analytics tools, client-side node.js wrappers, what have you. I'm going to be running a large crawl in the next few days and want to make…
2011
Ranked by how close each launch is in meaning, then by votes. Refine with a description →