Dev tools · alternatives · 2026
24 alternatives to I wrote a tiny Python-based HN crawler with scrapy
A scrapy-based Hacker News crawler. Contribute to mvanveen/hncrawl development by creating an account on GitHub.
HNCrawl is a Python-based crawler built with Scrapy that extracts data from Hacker News. It is designed for developers who need to programmatically collect and process Hacker News content. The tool is open source and… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. I wrote a tiny Python-based HN crawler with scrapy launched in 2012; newer entries below may have overtaken it.
- 1AD
We (Nick, Dens, Denzell, Fede, Drew, Aaryan, and Daniel) have been building HN Discovery, a discovery-focused search engine for Hacker News, in our spare time for the past 6 months and are excited to show it! It adds the following features relative to the existing keyword search interface and preserves the existing ones: - no-JS version (hnnojs.trieve.ai) - site:{required_site} and site:{negated-site} filters - public analytics - LLM generated query suggestions based on random stories - recommendations - dense vector semantic search - SPLADE fulltext search - RAG AI chat - order by…
2024 · hn.trieve.ai · its alternatives →
- 2WH
2015 · waybackhn.com · its alternatives →
- 3
- 4
Hi! I’m Julien and I built a recommendation engine for Hacker News. I feel like this website is a gold mine. Every day, I find some very interesting stories about a topic. And sometimes, I want to find other stories covering that same topic but I can’t. Hacker News has years of history of awesome discussion and ressources. Unfortunately, I think HN Algolia isn’t helpful in searching these old threads. As a student, I want to learn a lot from this website. This is why I created HN Recommend. Input a sentence or the URL of an article, and get the most popular and similar posts from Hacker…
2023 · hn-recommend.julienc.me · its alternatives →
- 5
I love HN but always felt the search with algolia is okay but does have some limitations. Since I work at Vectara I decided to try and create a better search for HN. It's based on data from roughly the last 6 months of HN stories and comments. Would love to hear feedback and how useful this is relative to the existing search.
2024 · hackernews.demo.vectara.com · its alternatives →
- 6
2017 · hackerhunt.co · its alternatives →
- 7
Hi HN! I'm Jonathan and I built Hacker Search (https://hackersearch.net), a semantic search engine for Hacker News. Type a keyword or a description of what you're interested in, and you'll get top links from HN surfaced to you along with brief summaries. Unlike HN's otherwise very valuable search feature, Hacker Search doesn't require you to get your keywords exactly right. That's achieved by leveraging OpenAI's latest embedding models alongside more traditional indexes extracted from the scraped and cleaned up contents of the links. I think there are many more interesting things…
2024 · hackersearch.net · its alternatives →
- 8
Accessible end-to-end deep dive of crawling, embedding, projecting, and semantic searching all of Hacker News for my Hackerverse project.
2024 · blog.wilsonl.in · its alternatives →
- 9
- 10
- 11HA
Hey there HN! I wanted to share a pet project of mine. I built HackYourNews [1] to scratch a personal itch: Knowing which stories to focus on while browsing aimlessly (though there is a certain joy in that, as well!) HackYourNews uses OpenAI's gpt-3.5-turbo to summarize the destination article as well as the comments section. Summarization of the article is always cached, while summaries of the comments are regenerated if the comments count is >10% (or >10 comments) different. While I styled the homepage to welcome HNers, my preferred view is the Mobile view, accessed from the navbar. This…
2023 · hackyournews.com · its alternatives →
- 12
Hi folks this is a project I worked on with some of my students when I was running an online JS programming course. Although the online course is no more, I finally got around to releasing Hacker Herald with a former instructor and student - thanks Arnav and Archis! To those wondering if there is a need for such a Hacker News front end, I would just point out that most newspaper websites are laid out like this - clearly some people like this kind of layout! Also for some stories a picture really does help - currently there is a HN story titled, "Portland airport grows with expansive mass…
2024 · hackerherald.com · its alternatives →
- 13
- 14
Web Extension: Easily find Hacker News discussions about the page you're currently browsing. - pinoceniccola/what-hn-says-webext
2020 · github.com · its alternatives →
- 15
A Hacker News lookalike written in Python/Django, powering https://news.python.sc - sebst/pythonic-news
2019 · github.com · its alternatives →
- 16
Hi folks, I've built an alternative Hacker News front page. It is inspired by and meant to be a replacement for hckrnews.com. I built this because HN is woefully underfeatured, but most sites that try to improve it seem to assume that the visual design is the problem. hcker.news tries to maintain HN's familiarity while adding useful enhancements. There are three primary views: - Timeline View: Browse top stories by votes or comments grouped by day, week, or month (e.g., top 20 per day, top 100 per week). - Aggregate View: See top stories by votes or comments over custom time ranges. - Front…
2025 · hcker.news · its alternatives →
- 17
Contribute to archivy/archivy-hn development by creating an account on GitHub.
2020 · github.com · its alternatives →
- 18
Hey HN! I'm excited to share a tool I've been working on - a native Hacker News reader built with Rust and egui. Here's a screenshot: https://github.com/haojiang99/hacker_news_reader/blob/main/s.... As a daily HN reader, I've always struggled with keeping track of interesting posts I want to read later. Browser tabs pile up, bookmarks get forgotten, and I lose track of what I've already read. I needed a way to: 1. Browse HN efficiently (across all sections - hot, new, show, ask, jobs, best) 2. Quickly mark posts as "todo" for later reading 3. Mark posts as…
2025 · github.com · its alternatives →
- 19
Public datsets made with https://getomni.ai/. Contribute to getomni-ai/datasets development by creating an account on GitHub.
2024 · github.com · its alternatives →
- 20
HN Deck: An alternate way to browse Hacker News
2020 · hndeck.sagunshrestha.com · its alternatives →
- 21
:boom: Progressive Hacker News client built with Angular - housseindjirdeh/angular2-hn
2016 · github.com · its alternatives →
- 22
A Powerful Spider(Web Crawler) System in Python. Contribute to binux/pyspider development by creating an account on GitHub.
2014 · github.com · its alternatives →
- 23
HN Summary is an open source bot which sumarizes top stories on Hacker News and publishes the summaries to a Telegram channel. Whenever a new story appears on the Hacker News API /topstories.json endpoint, this bot summarizes it (currently using OpenAI GPT-3 text-davinci-002) and sends the story title, summary, and url to the hn_summary channel on Telegram. The purpose of this project is to help build intuition on the capabilities of the current generation of large language models while making a broader swath of top Hacker News content more easily accessible. It could also serve as a…
2022 · github.com · its alternatives →
- 24IM
I noticed the who's hiring threads are very popular every month, so I decided to create a job board specifically for hacker news. You can tag jobs, search, view user's profiles and more. Tell me what you guys thing! Any feedback is appreciated.
2013 · hnjobs.org · its alternatives →
Also compare
- A discovery-focused search engine for Hacker News alternatives
- Wayback HN, a cross between the Wayback Machine and Hacker News alternatives
- Crawly alternatives
- My recommendation engine for Hacker News alternatives
- I made a search engine for Hacker News alternatives
- Hackerhunt – categorised curation of Show HN submissions alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →