pg-cdc
PostgreSQL CDC to Iceberg & S3 in one binary
What it does
pg-cdc is an open-source PostgreSQL Change Data Capture engine that streams WAL changes directly to Apache Iceberg and Parquet on Amazon S3. Unlike traditional CDC pipelines, it runs as a single binary—no Kafka, Spark, or JVM required. The output is immediately queryable with Athena, DuckDB, Spark, Trino, and other Iceberg-compatible engines, making operational PostgreSQL data ready for analytics and AI workloads.
Does the same job
all alternatives →- PCPgstream – CDC tool for PostgreSQL with DDL support2024 · xata.io · ▲8
Hi HN, pgstream is an open source CLI tool and Go library for Postgres logical replication events. We have some bigger plans with it, but as of now its main "differentiator" is that it includes not only data changes but also DDL changes in the same ordered and consistent stream. We have developed this because in the Xata platform we handle automatic replication from Postgres to Elasticsearch/OpenSearch. Initially schema changes were problematic because they required us intercepting them at the API layer and then apply them to the search engine. But if the replication is slightly delayed…
- GFGraphQL for Postgres2015 · github.com · ▲195
- DGDbdot – Golang tool to help generate Postgres schema diagrams2019 · github.com · ▲119
- OSOpen-source schema based Change-Data-Capture utility for Postgres2025 · github.com · ▲5
I am currently working on a Node.js utility for a schema-based approach on CDC for Postgres. It is a lightweight utility that you can plug on top of your existing WAL events service (eg. Debezium, WAL-listener...) and allows you to define schemas to listen to. Instead of listening to raw individual table-level events, you can aggregate those events into high-level schema events automatically. Conceptually, it is like having WAL events but on an SQL view, any modification to a table the view is based on would trigger a high-level event on the view itself. This has many real-world applications…
- JFJson2graphql – From a JSON file to Postgres-backed realtime GraphQL2019 · github.com · ▲120
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, August 2026
the whole month →- TL
Life & fun · 10d ago · louisabraham.github.io
- SA
Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…
Life & fun · Aug 2026 · toneyalexander.github.io
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com