Python Stream Processing with Denormalized
tl;dr we’re releasing python bindings for writing stream processing jobs using the Denormalized Rust library. Hey HN, A few months ago we released Denormalized, our embeddable stream processing engine written in rust [0]. Today we’re excited to showcase python bindings for the library. Python is still very much the language of data and we wanted to make it easy for more engineers to write fast streaming jobs without having to learn Rust. Currently, you can use the library to write streaming aggregations, stream joins, and user defined aggregate functions (thought the API for this is quite…
Python Stream Processing with Denormalized launched on November 13, 2024 with 20 votes, #767 of 4,990 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
Python Stream Processing with Denormalized provides Python bindings for a Rust-based stream processing engine. It allows developers to write fast streaming jobs in Python without learning Rust, supporting streaming aggregations, stream joins, and user-defined aggregate functions. The library is available on PyPI and includes Docker examples for easy setup with Kafka integration, making it accessible for data engineers working with streaming data.
written from the facts on this page · September 2026
From the sources
Embeddable stream processing engine based on Apache DataFusion - denormalized/py-denormalized at main · probably-nothing-labs/denormalized
Denormalized is a single node stream processing engine written in Rust. This directory contains the bindings for building pipelines using python. This script will connect to the kafka instance running in docker and aggregate the metrics in realtime. There are several other examples in the examples folder that demonstrate other capabilities including stream joins and UDAFs. We use uv to manage python dependencies. uv sync to create/update the virtualfrom github.com
In the maker’s words, at launch
tl;dr we’re releasing python bindings for writing stream processing jobs using the Denormalized Rust library. Hey HN, A few months ago we released Denormalized, our embeddable stream processing engine written in rust [0]. Today we’re excited to showcase python bindings for the library. Python is still very much the…
Does a similar job
all alternatives →
Denormalized – Embeddable Stream Processing in Rust and DataFusion2024 · github.com · ▲125tl;dr we built an embeddable stream processing engine in Rust using apache DataFusion, check us out at https://github.com/probably-nothing-labs/denormalized Hey HN, We’d like to showcase a very early version of our embeddable stream processing engine called Denormalized. The rise of DuckDB has abundantly made it clear that even for many workloads of Terabyte scale, a single node system outshines the distributed query engines of previous generation such as Spark, Snowflake etc in terms of both performance and cost. Now a lot of workloads DuckDB is used for were normally…
Riko – A Python stream processing engine modeled after Yahoo! Pipes2016 · github.com · ▲283A Python stream processing engine modeled after Yahoo! Pipes - nerevu/riko
Minibatch – Python stream processing2020 · github.com · ▲50Python stream processing for humans. Contribute to omegaml/minibatch development by creating an account on GitHub.
A local Python prototyping tool for Jupyter and Streamlit2023 · github.com · ▲65Hey HN! I built a local Python prototyping tool that is finally the Python development environment I've always wanted. It has a Jupyter notebook for data crunching, a database of your choice (Python or MongoDB), and a Streamlit app for building a frontend visualization. You can edit the Streamlit backend via an embedded VSCode editor, or locally on your own IDE. The best part for me is that the database connectors within Jupyter and Streamlit are configured out-of-the-box, so you don't need to spend time thinking about how to tie all that together - you can just pick the database you want to…
A Python container for dataclasses with multi-indexing and vector opps2020 · github.com · ▲122A container for dataclasses with multi-indexing and bulk operations. - joshlk/dataclassframe
SwimOS Rust – A framework for real-time streaming data applications2024 · github.com · ▲71
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 27d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 25d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 22d ago · openbot.run
Talanoa▲340Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 20d ago · talanoa.email
CoreSpeed▲332One MCP for everything your agents need: apps, memory, tools
Dev tools · 27d ago · corespeed.io
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, November 2024
the whole month →
Lovable▲1,477Hey HN! Previous CERN physicist turned hacker here. We've developed a way to make AI coding actually work by systematically identifying and fixing places where LLMs typically fail in full-stack development. Today we're launching as Lovable (previously gptengineer.app) since it's such a big change. The problem? AI writing code typically make small mistakes and then get stuck. Those who tried know the frustration. We fixed most of this by mapping out where LLMs fail in full-stack dev and engineering around those pitfalls with prompt chains. Thanks to this, in all comparisons I found with: v0,…
AI · 2024 · lovable.dev
Postiz▲1,188Streamline your social media with Postiz. Schedule posts, analyze performance, and manage all accounts in one place.
Dev tools · 2024 · postiz.com
I wasn't quite sure if this qualified as "Show HN" given you can't really download it and try it out. However, dang said[0]: > If it's hardware or something that's not so easy to try out over the internet, find a different way to show how it actually works—a video, for example, or a detailed post with photos. Hopefully I did that? Additionally, I've put code and a detailed guide for the netboot computer management setup on GitHub: https://github.com/kentonv/lanparty Anyway, if this shouldn't have been Show HN, I apologize! [0]…
Dev tools · 2024 · lanparty.house
Raycast Notes▲1,058Unlock a new level productivity with AI, Cloud Sync and more
Work · 2024 · raycast.com
