All I wanted was to grok some real-time data
Hi HN, We are launching Denormalized (www.denormalized.io), a serverless real-time data platform built on Kafka and Pinot. We felt a bit burnt out by the sheer developer toil we faced when building application around the real-time data stack and set out to create a platform to allow small teams to be very productive with realtime data without having to glue together an elaborate system to serve real-time as well as time series queries. Here is our motivating post. Would appreciate any and all feedback.
All I wanted was to grok some real-time data launched on October 31, 2023 with 8 votes, #1,529 of 4,393 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.
What it does
and how I ended up with a street PhD in Distributed Systems
Midjourney Prompt: painting in the style of dutch golden age. people looking at reams of real time data at the 17th century stock market. Real-time databases and stream processing systems 1 have at-least been around for 2 decades in various forms. While stream processing has increasingly become important especially with the rise of the Kafka ecosystem, it has still remained somewhat of a niche topic. Only to be tackled once the low hanging fruit has already been taken care of by hammering near real-time ness from your existing data architecture. My personal journey with working with streaming data/real-time event processing started well over a decade ago when I worked in the bowels of a…from teamdenormalized.substack.com
Does a similar job
all alternatives →
Denormalized – Embeddable Stream Processing in Rust and DataFusion2024 · github.com · ▲125tl;dr we built an embeddable stream processing engine in Rust using apache DataFusion, check us out at https://github.com/probably-nothing-labs/denormalized Hey HN, We’d like to showcase a very early version of our embeddable stream processing engine called Denormalized. The rise of DuckDB has abundantly made it clear that even for many workloads of Terabyte scale, a single node system outshines the distributed query engines of previous generation such as Spark, Snowflake etc in terms of both performance and cost. Now a lot of workloads DuckDB is used for were normally…
- AL
The Changelog - #181: RethinkDB, Databases, and the Realtime Web With Slava Akhmechet2015 · changelog.com · ▲60Slava Akhmechet schools us on RethinkDB and the realtime web
AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds2024 · github.com · ▲58Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability. - AutoMQ/automq
Python Stream Processing with Denormalized2024 · github.com · ▲20tl;dr we’re releasing python bindings for writing stream processing jobs using the Denormalized Rust library. Hey HN, A few months ago we released Denormalized, our embeddable stream processing engine written in rust [0]. Today we’re excited to showcase python bindings for the library. Python is still very much the language of data and we wanted to make it easy for more engineers to write fast streaming jobs without having to learn Rust. Currently, you can use the library to write streaming aggregations, stream joins, and user defined aggregate functions (thought the API for this is quite…
More dev tools this month
the category →
Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.
Dev tools · 18h ago · github.com
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 29d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 27d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 24d ago · openbot.run
Talanoa▲346Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 22d ago · talanoa.email
Source: Show HN post ↗
Launched alongside, October 2023
the whole month →
Nudge 2.0▲1,051In-app experiences to activate, retain, & understand users
Growth · 2023 · nudgenow.com
Unlock AI magic for elevated customer engagement, fast
AI · 2023 · tiledesk.com
Effortlessly discover API behaviour with a Chrome extension that automatically generates OpenAPI specifications in real time for any app or website.
Dev tools · 2023 · github.com