Semantic clusters and embeddings for 500k Hacker News comments

In plain words

This project organizes 500,000 Hacker News comments into semantic clusters using embeddings, making large-scale discussion patterns searchable and explorable. It's designed for researchers, data analysts, and curious internet users who want to understand themes and topics across Hacker News conversations. The tool lets users navigate comment data through semantic relationships rather than traditional search, revealing how discussions naturally group together.

written from the facts on this page · September 2026

• 
  Exploring HN by mapping and analyzing 40M posts and comments for fun2024 · blog.wilsonl.in · ▲520

  Accessible end-to-end deep dive of crawling, embedding, projecting, and semantic searching all of Hacker News for my Hackerverse project.

• 
  40k HN comments mentioning books, extracted using deep learning2021 · hacker-recommended-books.vercel.app · ▲1,359

  Thinking, Fast and Slow - with 523 comments from the Hacker News community

• 
  I made Google Trends for Hacker News by indexing 18 years of commentsJun 2026 · hackernewstrends.com · ▲822

  Search 18 years of Hacker News and chart how any topic, tool, or person trended. Overlay terms to compare their rise and fall across 45M posts and comments.

• 4E
  40M embeddings to find who knows what on HN2024 · blog.wilsonl.in · ▲33
• HN
  Hacker News with categories and popularity2014 · newshack.io · ▲149

  Did you want to know topics of the news or popularity of posts? "Hacker News Hack" helps you to find news based on some categories and importance or popularity. It tagged news with 9 categories with a natural language processing technology and supervised learning for categorizing news. It also calculates a speed of number of comments in each posts as popularity based on term, that is 1 hour, 1 day, 1 week, 1 month, or 1 year.

• 
  Building a web search engine from scratch with 3B neural embeddings2025 · blog.wilsonl.in · ▲699

  End-to-end deep dive of the project, spanning a large GPU cluster, distributed RocksDB, and terabytes of sharded HNSW.

• 
  SimCity, but with Permits▲930

  A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.

  Life & fun · 2d ago · permit.petercai.com

• IV
  I've been paying for a rural Tanzanian's education for 10 years▲778

  Life & fun · 15d ago · tanzaniaeducationproject.org

• 
  Bigwords.page – Turn any screen into a sign. The URL is the app▲728

  Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.

  Life & fun · 16d ago · bigwords.page

• 
  Guitoro, a virtual guitar you strum with your keyboard▲573

  Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.

  Life & fun · 9d ago · guitoro.com

• 
  See *almost* any carriers phone settings▲432

  Carrier settings from iPhone, Pixel and Galaxy firmware, decoded and compared: APNs, VoLTE, 5G and Wi-Fi Calling per carrier, and what each build changed.

  Life & fun · 14d ago · carrierexplode.com

• 
  The whole Solar System and every tracked satellite, live in the browser▲407

  Life & fun · 23d ago · space.bl2.net

• 
  Pygma▲1,412

  AI copilot for Instagram

  AI · 2024 · pygma.me

• 
  Cello▲1,347

  Easiest way to add a referral program to your SaaS

  Growth · 2024 · cello.so

• 
  La Growth Machine▲1,216

  Create personalized, multi-channel conversations at scale

  AI · 2024 · lagrowthmachine.com

• 
  Superhuman 2.0▲1,142

  Revolutionary AI email, reimagined for teams

  AI · 2024 · superhuman.com

• 
  FlowMapp 3.0▲1,142

  Visual website planning in the most powerful way

  Work · 2024 · flowmapp.com

• 
  PyjamaHR▲1,132

  Hiring on autopilot. The AI applicant tracking system (ATS).

  Work · 2024 · pyjamahr.com