The Crawl Times – Newspaper-style front pages for tech news sites
I built a small experiment that crawls tech-news-adjacent sites (like HN) and generates a newspaper-style front page for each one. This was inspired by Cloudflare's recent (controversial?) release of their /crawl API. It runs periodic crawls, picks up the top stories, and lays them out in a classic broadsheet format: top story, trending section, briefs, etc. Basically a daily edition of your favorite tech site. Nothing serious, just a weeknight project to play with Cloudflare's /crawl API and a few of their other tech offerings (workers, D1, etc.). I'm not in any way sponsored by…
What it does
In the maker’s words, at launch
I built a small experiment that crawls tech-news-adjacent sites (like HN) and generates a newspaper-style front page for each one. This was inspired by Cloudflare's recent (controversial?) release of their /crawl API. It runs periodic crawls, picks up the top stories, and lays them out in a classic broadsheet format: top story, trending section, briefs, etc. Basically a daily edition of your favorite tech site. Nothing serious, just a weeknight project to play with Cloudflare's /crawl API and a few of their other tech offerings (workers, D1, etc.). I'm not in any way sponsored by CF, but if you're from CF and you're reading this I really dig your stack and you should give me credits to fund these dumb projects thank you very much. Home page: https://crawltimes.com/
Does a similar job
all alternatives →- IBI built a tech news aggregator that works the way my brain doesOct 2025 · deadstack.net · ▲188
An honest to god, non-algorithmic reverse chrono list of tech news that passes my signal-to-noise tests, updated hourly. A lightweight a page design as I've been able to keep; simple, clean, fast. No commercial features or aspirations - this is a passion project, something I've been fooling around with on and off for decades. There's a "Top" view too with an LLM edited front page & summary, and categorized views for a large number of topics - see the Directory. A few more buried features to explore, but the fundamental use case is pop in, scan, exit - fast and concise. Your feedback would be…
- TLTop Links from Hacker News, Reddit, Techmeme, PH on a Single Page2022 · alltoplinks.com · ▲131
Hi HN, this is something I created for my personal use and I have been using it daily for a long time now. It’s a page that shows top 25 links from the sources mentioned in the title. Updates every 10 minutes through a cron job and new links are always added to the top. Some more details: It’s using simple heuristics like minimum upvotes/comments to select the links. For techmeme, only the first headline on techmeme.com is considered a top link. For reddit, currently fetching content from only a select few subreddits. It’s just a simple page. No ad. No tracking. It’s the first tab I…
- RTReal-time system that tracks how news spreads across 200k websitesNov 2025 · yandori.io · ▲256
I built a system that monitors ~200,000 news RSS feeds in near real-time and clusters related articles to show how stories spread across the web. It uses Snowflake’s Arctic model for embeddings and HNSW for fast similarity search. Each “story cluster” shows who published first, how fast it propagated, and how the narrative evolved as more outlets picked it up. Would love feedback on the architecture, scaling approach, and any ways to make the clusters more accurate or useful. Live demo: https://yandori.io/news-flow/
- ABA bookmarklet to remove clickgates on New York Times, Medium, etc.2019 · ▲71
Recently i stumbled on too many clickgates on the Medium blog Towards Data science. Considering that most people publish to share knowledge on Medium and are driven into putting their content behind a paywall, without actually getting paid for it, including myself. I felt like Medium is running the academic publishing scheme. Get free content and get paid for it. So I decided to create a small script to bypass the paywall on Medium, it turns out it also works on other newssites. Heres the website: https://sugoidesune.github.io/readium/ For the curious I will explain the…
More dev tools this month
the category →
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 2d ago · opentrailpaper.com
Open-source GTM skills for technical founders
Dev tools · 30d ago · gtmcofounder.com
Launched alongside, March 2026
the whole month →
Switch from ChatGPT to Claude with import memory feature
AI · Mar 2026 · claude.com
