Infini-News – 1.36B news articles from Common Crawl, queryable in ms

What it does

CC-NEWS — ten years and 1.36 billion news articles — cleaned, enriched, and queryable in milliseconds with infini-gram-mini.

I do many things, and sometimes the thing I do is work with researcher and journalist friends on various projects. Some of those projects tend to involve news articles: analysis of news articles is vital to many things. From propaganda studies, to media analysis, or just to find cultural trends, news articles — especially in large quantities — are a good source of insight. I will say that I have, over the course of half a decade, written or helped to write scrapers for a variety of news websites. For example, I contributed various scrapers for Italian news sites to the fundus framework, a piece of software that I really like working with. Some months ago, though, I thought I'd…from cs2.uni-graz.at

In the maker’s words, at launch

Infini-News is ten years of CC-NEWS (the news subset of Common Crawl), cleaned, enriched and turned into a full-text index so you can count any keyword or phrase across 1.36B articles in sub-second time (ok, now maybe a few seconds, but circumstantial), without downloading anything. It's free and open on Hugging…

• 
  Real-time system that tracks how news spreads across 200k websitesNov 2025 · yandori.io · ▲256

  I built a system that monitors ~200,000 news RSS feeds in near real-time and clusters related articles to show how stories spread across the web. It uses Snowflake’s Arctic model for embeddings and HNSW for fast similarity search. Each “story cluster” shows who published first, how fast it propagated, and how the narrative evolved as more outlets picked it up. Would love feedback on the architecture, scaling approach, and any ways to make the clusters more accurate or useful. Live demo: https://yandori.io/news-flow/

• 
  Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5mMar 2026 · huggingface.co · ▲408

  We’re on a journey to advance and democratize artificial intelligence through open source and open science.

• 
  I made a search engine for Hacker News2024 · hackernews.demo.vectara.com · ▲211

  I love HN but always felt the search with algolia is okay but does have some limitations. Since I work at Vectara I decided to try and create a better search for HN. It's based on data from roughly the last 6 months of HN stories and comments. Would love to hear feedback and how useful this is relative to the existing search.

• 
  One Minute NewsFeb 2026 · oneminutenews.org · ▲171

  This is a minimalist news digest site that helps readers understand the biggest news happening around the world in one minute. We work on this as a side project. So why are we doing this? Welp, I myself am a clickbait hater. Sometimes I click into a news story on Facebook just to find out the content is nothing as the title suggests. Born from pure hatred, we have created One Minute News to make sure every headline literally says what the content is about. This helps readers save tons of time filtering out unimportant news just by scanning through the honest headlines. So far, here are the…

• 
  A news aggregator for the Python community written in Python/Django2019 · github.com · ▲106

  A Hacker News lookalike written in Python/Django, powering https://news.python.sc - sebst/pythonic-news

• 
  Hewizo2019 · hewizo.com · ▲89

  Convert news articles to audio in 30+ languages

• 
  Lofi Cities – Pixel-art city nights with browser-generated lofi▲319

  Endless lofi beats composed live in your browser, over pixel-art nights in Paris, Tokyo, New York, Hong Kong, Sydney, San Francisco and more. Free, no sign-up.

  Work · 27d ago · loficities.com

• 
  Smooth Recorder▲257

  Mac screen recordings that look edited when you hit stop

  Work · 21d ago · smoothrecorder.com

• 
  Figma Specs▲225

  A container for your context that lives on the Figma canvas

  Work · 5d ago · figma.com

• 
  The rarest tech books and docs you've probably never read▲190

  Work · 15d ago · readrare.com

• IR
  I replaced a $120k bowling center system with $1,600 in ESP32s▲2,935

  I might be the only SRE on Earth with his own bowling center. It's a more in-depth gig than you'd think. My family and I bought an abandoned 8-lane bowling center in the rural mid-west. In our small town there weren't many recreation options for families. You've heard of a food desert? This is an R&R desert. It had been abandoned for a good reason. The roof leaks, the electrical system was constantly surging, and my 70-year-old bowling equipment (still) doesn't work perfectly. The system that keeps your score is particularly interesting to me. It's the thing you watch during your game, but…

  Life & fun · Jul 2026

• 
  Elevators▲1,680

  How elevators push your buttons

  Life & fun · Jul 2026 · john.fun

• 
  18 Words▲1,160

  Play 18 Words, the free daily word puzzle. The official home is 18words.com. Tap Play now to open today

  Life & fun · Jul 2026 · 18words.com

• BA
  Bento - An entire PowerPoint in one HTML file (edit+view+data+collab)▲1,033

  Over the past few months, our team has been building more and more slidedecks using web frontend technologies with coding harnesses like Claude Code, but a common complaint is to make even small edits we need to edit the code either manually or via the harness. To avoid this loop, I ended up creating Bento, a single HTML file with everything you need in a slide tool including animations and shared editing. There's no install or cloud login, everything works offline. The default deck is around 560 KB and it doesn't need to fetch anything once you got it. Open it in a browser and then you can…

  Dev tools · Jul 2026 · bento.page

• 
  Getting GLM 5.2 running on my slow computer▲937

  A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context.…

  AI · Jul 2026 · github.com

• 
  OpenSEO▲928

  Hello! For the last 2 months, I've been building OpenSEO. It's a user friendly UI wrapping the DataForSEO API which has high quality SEO data for keywords, backlinks, AI SEO and competitor research. Instead of paying $100+ per month, you buy DataForSEO credits and pay only for usage. The coolest thing about the project so far has been hearing about what people are building on top of it. People are using coding agents to quickly integrate with Google Search Console, Google Ads and building their own AI SEO and reporting features. Many were already building their own custom solutions around…

  Dev tools · Jul 2026 · openseo.so