Open-Source C++ Apache Iceberg Client with Write Support
Existing OSS C++ projects like ClickHouse and DuckDB support reading from Iceberg tables. Writing requires Spark, PyIceberg, or managed services. In this PR https://github.com/timeplus-io/proton/pull/928, we are open-sourcing a C++ implementation of Iceberg integration. It's an MVP, focusing on REST catalog and S3 read/write(S3 table support coming soon). You can use Timeplus to continuously read data from MSK and stream writes to S3 in the Iceberg format. No JVM. No Python. Just a low-overhead, high-throughput C++ engine. Docker/K8s are optional. Demo…
What it does
In the maker’s words, at launch
Existing OSS C++ projects like ClickHouse and DuckDB support reading from Iceberg tables. Writing requires Spark, PyIceberg, or managed services. In this PR https://github.com/timeplus-io/proton/pull/928, we are open-sourcing a C++ implementation of Iceberg integration. It's an MVP, focusing on REST catalog and S3 read/write(S3 table support coming soon). You can use Timeplus to continuously read data from MSK and stream writes to S3 in the Iceberg format. No JVM. No Python. Just a low-overhead, high-throughput C++ engine. Docker/K8s are optional. Demo video: https://www.youtube.com/watch?v=2m6ehwmzOnc Help us improve the code to add more integrations and features. Happy to contribute this to the Iceberg community. Or just roast the code. We’ll buy the virtual coffee.
Does the same job
all alternatives →- SLSwiftLake – Lightweight SQL Engine for Iceberg TablesSep 2025 · github.com · ▲6
At Arcesium, we needed a way to run SQL-driven CRUD operations, manage slowly-changing dimensions, and handle schema evolution on our cloud data lakes—without the overhead of spinning up distributed clusters or relying on vendor-managed query services. That’s why we built SwiftLake, a lightweight open-source library that brings Apache Iceberg and DuckDB together: - Lightweight & cluster-free: Runs as a single Java service with embedded DuckDB—no distributed infra required. - Full CRUD and SCD1/SCD2 support: Reads, inserts/appends, updates, deletes, and merges with ACID guarantees.…
- 7F7x faster Iceberg ingestion, how we redesigned OLake's writerDec 2025 · olake.io · ▲5
OLake is our open-source tool for ingesting Database & Kafka data into Apache Iceberg. We recently redesigned the write pipeline and saw ~7x throughput improvements. Sharing the architecture decisions, trade-offs, and benchmarks.
- IJIceberg-JS, a TypeScript Client for the Apache Iceberg REST CatalogDec 2025 · github.com · ▲5
This is a small, framework-agnostic JavaScript/TypeScript client for the Apache Iceberg REST Catalog. It is good for managing the catalog (eg: managing tables), and it's MIT licensed. The goals: - Generic: Works with any Iceberg REST Catalog implementation, not tied to any specific vendor - Minimal: Thin HTTP wrapper over the official REST API, no engine-specific logic - Type-safe: First-class TypeScript support with strongly-typed request/response models - Fetch-based: Uses native fetch API with support for custom implementations - Universal: Targets Node 20+ and modern browsers…
- LCLightweight C++23 S3 client with no extra deps (just curl and OpenSSL)Jun 2026 · github.com · ▲5
Attached is my attempt at making a small toy S3 client without any other dependency besides libcurl and OpenSSL. Was tested mainly on MinIO (RIP) locally, so I would expect some bugs when using it against AWS, although I was able to play with it on some open access buckets Be aware that I am not a C++ programmer and this project was indeed done to learn a bit of C++ myself :') Feedback on any of the code, either on gtest, or the benchmarking section or the core itself is welcome!
- DDDux, distributed DuckDB-backed dataframes on the BeamMar 2026 · github.com · ▲7
Hey all! I wrote Explorer[1] a good few years ago now with the dream of fast dataframes with a dplyr-like API in a really powerful, ergonomic language (Elixir). It's proved pretty successful. Explorer is used in production at my company, and it's my go-to for quick data analysis. But maintaining it became a true albatross. Polars is an amazing project, but the development process is fast and a lot is very focused on the Python lib. We found that trying to maintain Explorer against Polars was a maintenance nightmare and eventually hit points where we had to give up features and found it…
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, March 2025
the whole month →
Mimic Human Research & Save Findings in AI Knowledge Base
AI · 2025 · sider.ai
