Jet – in-memory, fault-tolerant, distributed stream processing

In plain words

Jet is a distributed stream processing platform designed for handling large-scale data flows with fault tolerance and in-memory processing capabilities. It is intended for developers and organizations that need to process continuous data streams reliably across multiple machines. The platform emphasizes fault-tolerant architecture and in-memory computation, allowing it to maintain performance while ensuring data integrity even when system failures occur.

written from the facts on this page · September 2026

• 
  DuckDB for Kafka Stream ProcessingDec 2025 · sql-flow.com · ▲77

  Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://sql-flow.com/docs/category/tutorials/ https://github.com/turbolytics/sql-flow We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or…

• 
  Riko – A Python stream processing engine modeled after Yahoo! Pipes2016 · github.com · ▲283

  A Python stream processing engine modeled after Yahoo! Pipes - nerevu/riko

• JC
  Jet – Codeship’s CI Platform for Docker2016 · codeship.com · ▲15
• 
  Goka – distributed stream processing library for Kafka written in Go2017 · github.com · ▲105

  Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go. - lovoo/goka

• 
  PDD – Probabilistic De-Duplication of Streams with Bloom Filters2016 · github.com · ▲86

  Advanced Bloom Filter Based Algorithms for Efficient Approximate Data De-Duplication in Streams - jparkie/PDD

• 
  Denormalized – Embeddable Stream Processing in Rust and DataFusion2024 · github.com · ▲125

  tl;dr we built an embeddable stream processing engine in Rust using apache DataFusion, check us out at https://github.com/probably-nothing-labs/denormalized Hey HN, We’d like to showcase a very early version of our embeddable stream processing engine called Denormalized. The rise of DuckDB has abundantly made it clear that even for many workloads of Terabyte scale, a single node system outshines the distributed query engines of previous generation such as Spark, Snowflake etc in terms of both performance and cost. Now a lot of workloads DuckDB is used for were normally…

Questions this answers

• jetsmmpanel

• 
  /dev/null▲482

  a social network for devs

  Dev tools · 3d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 25d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 23d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 20d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 28d ago · corespeed.io

• 
  Trends.vc▲1,292

  Discover new markets and ideas

  Work · 2020 · join.trends.vc

• IB
  I built an After Effects for dummies▲868

  IRAMATOGEL menghadirkan layanan permainan slot dan toto togel dalam satu platform. Pemain bisa memilih game slot yang sedang ramai, melihat data result terbaru, serta mengikuti pasaran togel yang tersedia. Fokus utamanya adalah akses yang lancar, proses transaksi yang ringkas, dan dukungan layanan y

  Life & fun · 2020 · storycreatorapp.com

• 
  Fluent▲821

  Learn a new language by browsing the web

  Life & fun · 2020 · fluent.co

• 
  Waitlist API▲807

  Quick and easy waitlist with built in referral.

  Dev tools · 2020 · getwaitlist.com

• 
  Circle▲753

  The modern community platform for creators

  Growth · 2020 · circle.so

• 
  Story Creator▲713

  Simple online video editing for digital creators

  Growth · 2020