Python package to collect normalized news from almost any website

In plain words

This Python package extracts and normalizes news content from virtually any website, making it useful for developers building news aggregation tools, research applications, or content analysis systems. It handles the inconsistencies across different website structures to provide standardized output. The package is hosted on GitHub and available for developers who need to programmatically collect news data at scale from diverse sources.

written from the facts on this page · September 2026

• 
  Py package to collect normalized news from (almost) any website2020 · github.com · ▲26

  Programmatically collect normalized news from (almost) any website. - kotartemiy/newscatcher

• 
  A news aggregator for the Python community written in Python/Django2019 · github.com · ▲106

  A Hacker News lookalike written in Python/Django, powering https://news.python.sc - sebst/pythonic-news

• 
  Pygooglenews – Python library for advanced Google News data mining2020 · github.com · ▲165

  If Google News had a Python library. Contribute to kotartemiy/pygooglenews development by creating an account on GitHub.

• NE
  News Extract API – Pull structured data from online news articles2020 · ▲131

  Hey HN, It will be more of a "How I released my API without managing a website, servers, users, and payments. With 0$ up-front cost" Over the past year, I have come up with a plan of how I could release my own product without having to deal with managing users and/or dealing with payment processing. It is a 3 steps procedure: 1. Make an API that solves a problem 2. Deploy it with a serverless architecture 3. Distribute through an API Marketplace That took me about 2-3 days to develop an API using Flask, deploy it via Zappa on AWS, and release through RapidAPI. Source code of API:…

• 
  Real-time system that tracks how news spreads across 200k websitesNov 2025 · yandori.io · ▲256

  I built a system that monitors ~200,000 news RSS feeds in near real-time and clusters related articles to show how stories spread across the web. It uses Snowflake’s Arctic model for embeddings and HNSW for fast similarity search. Each “story cluster” shows who published first, how fast it propagated, and how the narrative evolved as more outlets picked it up. Would love feedback on the architecture, scaling approach, and any ways to make the clusters more accurate or useful. Live demo: https://yandori.io/news-flow/

• 
  NutgrafeJan 2026 · nutgrafe.com · ▲242

  The news, reduced to what matters.

• 
  /dev/null▲494

  a social network for devs

  Dev tools · 4d ago · dev-null.sh

• 
  Run full iOS 16.5 firmware on Android Devices▲478

  Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

  Dev tools · 24h ago · github.com

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 29d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 24d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 22d ago · talanoa.email

• 
  Blush▲1,462

  Illustrations for everyone

  Dev tools · 2020 · blush.design

• 
  SHA-256 Animation▲1,053

  Animation of the SHA-256 hash function in your terminal. - in3rsha/sha256-animation

  Dev tools · 2020 · github.com

• 
  This Word Does Not Exist▲956

  This Word Does Not Exist uses an artificial intelligence model named GPT-2 to invent new English words.

  AI · 2020 · thisworddoesnotexist.com

• P3
  Plotting 3 years of hourly data in 150ms▲785

  Life & fun · 2020 · leeoniya.github.io

• 
  Untools▲783

  Hand-picked tools for better thinking

  Work · 2020 · untools.co

• 
  Copytesting▲781

  Improve your website copy based on data from your audience

  Growth · 2020 · wynter.com