nowfound

Life & fun · May 15, 2024

Lua for row-level transformations during Postgres CDC

Earlier this week, we launched PeerDB Streams, our latest product offering for real-time replication from Postgres to queues and message brokers such as Kafka, Redpanda, Google PubSub, Azure Event Hubs, and others. Today, we are announcing one of the...

Lua for row-level transformations during Postgres CDC launched on May 15, 2024 with 5 votes, #1,921 of 4,539 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 2 years on.

What it does

Earlier this week, we launched PeerDB Streams , our latest product offering for real-time replication from Postgres to queues and message brokers such as Kafka , Redpanda , Google PubSub , Azure Event Hubs , and others. Today, we are announcing one of the flagship features of this offering — support for row-level transformations as part of Postgres Change Data Capture (CDC). You can write simple Lua scripts to define a transformation and add it as part of the replication (MIRROR). With this feature, users will be able to seamlessly perform in-flight row-level transformations to Postgres data before it is streamed to the target. In this blog, we will cover various use cases that require…from blog.peerdb.io

Does a similar job

all alternatives →
  • PS
    Peerdb Streams – Simple, native Postgres change data capture2024 · ▲177

    Hello HN, I am Sai Srirampur, one of the Co-founders of PeerDB. (https://github.com/PeerDB-io/peerdb). We spent the past 7 months building a solid experience to replicate data from Postgres to data warehouses. Now we're expanding to queues. PeerDB Streams provides a simple and native way to replicate changes as they happen in Postgres to Queues (Kafka, Redpanda, Google PubSub, etc). We use Postgres logical decoding to enable Change Data Capture (CDC). Blog post here: https://blog.peerdb.io/peerdb-streams-simple-native-postgres.... 10-min quickstart here:…

  • Pg_replicate – Build Postgres replication applications in Rust2024 · github.com · ▲216

    A high-performance Postgres replication engine written in Rust. Embed it in your Rust application or run it as a standalone binary. - supabase/etl

  • PeerDB2023 · peerdb.io · ▲110

    Fast, native ETL for Postgres

  • MD
    Multiplayer Demo Built with Elixir2022 · multiplayer.dev · ▲221

    Hey HN, I’m an engineer at Supabase [0] and one of the creators of this demo. My team and I have been working hard to bring developers the next version of Supabase Realtime. The current version of Realtime [1] is a Change Data Capture (CDC) server for a PostgreSQL database that broadcasts changes via WebSockets to authorized subscribers. It’s written in Elixir/Phoenix. The server utilizes PostgreSQL’s logical replication functionality, which writes database changes to Write-Ahead Logging (WAL) segment files, and a replication slot, responsible for managing and retaining WAL files.…

  • Streambed – Stream Postgres to Iceberg on S3, Supports Postgres WireMay 2026 · github.com · ▲129

    Stream Postgres to Apache Iceberg on S3 via logical replication, queryable over the Postgres wire protocol. - GitHub - viggy28/streambed: Stream Postgres to Apache Iceberg on S3 via logical replication, queryable over the Postgres wire protocol.

  • Deepstream.io – open-source real-time server with pub/sub and data sync2016 · deepstream.io · ▲301

    A realtime server for the modern web

More life & fun this month

the category →

Source: Show HN post ↗

Launched alongside, May 2024

the whole month →
  • Voicenotes▲1,485

    AI note-taker that's truly intelligent

    AI · 2024 · voicenotes.com

  • Wegic▲1,179

    The first AI web designer & developer by your side

    Dev tools · 2024 · wegic.ai

  • Insighto▲1,108

    Ship features users want

    Growth · 2024 · insigh.to

  • Ivee▲1,087

    The B2B influencer marketing platform

    Growth · 2024

  • Waxwing▲1,035

    AI copilot for every marketing task

    AI · 2024

  • AI powered zero-waste meal planner

    AI · 2024 · ohapotato.app