Pgstream – CDC tool for PostgreSQL with DDL support
Hi HN, pgstream is an open source CLI tool and Go library for Postgres logical replication events. We have some bigger plans with it, but as of now its main "differentiator" is that it includes not only data changes but also DDL changes in the same ordered and consistent stream. We have developed this because in the Xata platform we handle automatic replication from Postgres to Elasticsearch/OpenSearch. Initially schema changes were problematic because they required us intercepting them at the API layer and then apply them to the search engine. But if the replication is slightly delayed…
What it does
In the maker’s words, at launch
Hi HN, pgstream is an open source CLI tool and Go library for Postgres logical replication events. We have some bigger plans with it, but as of now its main "differentiator" is that it includes not only data changes but also DDL changes in the same ordered and consistent stream. We have developed this because in the Xata platform we handle automatic replication from Postgres to Elasticsearch/OpenSearch. Initially schema changes were problematic because they required us intercepting them at the API layer and then apply them to the search engine. But if the replication is slightly delayed or faster than the update, you can get replication errors. Having a single consistent stream with both makes consumer a lot more reliable in the face of schema changes. The way it works is that pgstream installs event triggers for DDL changes and maintains a "shadow" representation of the schema in a separate table. The changes to this table are included in the replication stream. Besides the Elasticsearch/OpenSearch output, pgstream also comes with a simple "webhook" output which is a simple way to get webhooks for any changes that happen in Postgres (data & schema). GitHub repo: https://github.com/xataio/pgstream
Does the same job
all alternatives →- DGDbdot – Golang tool to help generate Postgres schema diagrams2019 · github.com · ▲119
- PA
- PPPgCat, Postgres pooler with sharding, load balancing and failover2022 · github.com · ▲233
- GFGraphQL for Postgres2015 · github.com · ▲195
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, July 2024
the whole month →
- IC
Many years ago, I made VJ softwares (to mix live visuals in clubs) for unexpected platforms like the Game Boy Advance, the Playstation 2 and the Raspberry Pi. This year, I’m back with a new web-app: Pikimov. Inspired by Photopea (a free Photoshop clone), I created this web-based motion design & video editor as an alternative to After Effects, to fill empty void. It's free, without signup, without cloud uploads (your files stay on your machine), and your projects are not used for AI models training.
AI · 2024 · pikimov.com
