nowfound

Dev tools · March 20, 2025

Open-Source C++ Apache Iceberg Client with Write Support

Existing OSS C++ projects like ClickHouse and DuckDB support reading from Iceberg tables. Writing requires Spark, PyIceberg, or managed services. In this PR https://github.com/timeplus-io/proton/pull/928, we are open-sourcing a C++ implementation of Iceberg integration. It's an MVP, focusing on REST catalog and S3 read/write(S3 table support coming soon). You can use Timeplus to continuously read data from MSK and stream writes to S3 in the Iceberg format. No JVM. No Python. Just a low-overhead, high-throughput C++ engine. Docker/K8s are optional. Demo…

Open-Source C++ Apache Iceberg Client with Write Support launched on March 20, 2025 with 8 votes, #3,486 of 7,215 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

What it does

The Fastest Unified Streaming SQL Engine in a Single C++ Binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute real-time context from streams, logs, metrics, events, and CDC. - Add Apache Iceberg Streaming Writes and Batch Reads (MVP) by zliang-min · Pull Request #928 · timeplus-io/proton

This PR introduces MVP-level support for streaming writes and batch reads with Apache Iceberg tables, fully implemented in C++ (no JNI). While existing C++ projects like ClickHouse and DuckDB focus on read-only Iceberg integration, this implementation adds native write capabilities, enabling end-to-end data pipelines directly from SQL. -- Connect to a Iceberg database managed by AWS Glue, using AK/SK/IAM from the host CREATE DATABASE demo SETTINGS type = ' iceberg ' , warehouse = ' (aws-12-id) ' , catalog_type = ' rest ' , catalog_uri = ' https://glue.us-west-2.amazonaws.com/iceberg ' , storage_endpoint = ' https://bucket.s3.us-west-2.amazonaws.com ' , rest_catalog_sigv4_enabled = true,…from github.com

In the maker’s words, at launch

Existing OSS C++ projects like ClickHouse and DuckDB support reading from Iceberg tables. Writing requires Spark, PyIceberg, or managed services. In this PR https://github.com/timeplus-io/proton/pull/928, we are open-sourcing a C++ implementation of Iceberg integration. It's an MVP…

Does a similar job

all alternatives →
  • C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords2025 · github.com · ▲50

    In 2023, AWS announced[1] IAM authentication for MSK Kafka clusters with support for "all programming languages"… except C++. While Java[2], Python[3], Go[4], and others got official SDKs, C++ developers/vendors were stuck hardcoding SCRAM-SHA credentials in code/configs or relying on heavier Java-based tools like Kafka Connect or Apache Flink. Later, community projects added Rust[5] and Ruby[6] support. Why no C++? Rust might be the new favorite, but C++ is still king for high-performance data systems: minimal dependencies, lean resource use, and raw speed. At Timeplus, we needed…

  • Timeplus Proton 3.0 – First vectorized streaming SQL engineOct 2025 · github.com · ▲11

    Two years after open sourcing Proton, we're releasing v3.0 which brings enterprise-grade streaming capabilities to the open source version: full connectivity, processing, and routing in a single binary with zero dependencies. Key features: First vectorized streaming SQL engine in modern C++ with JIT compilation High-throughput, low-latency, high-cardinality processing End-to-end streaming: ETL, joins, aggregation, alerts, and tasks Native connectors: Kafka, Redpanda, Pulsar, ClickHouse, Splunk, Elastic, MongoDB, S3, Iceberg Native Python UDF/UDAF support to support your AI/ML work…

  • Open-source, browser-local data exploration using DuckDB-WASM and PRQL2024 · github.com · ▲227

    Hey HN! We’ve built Pretzel, an open-source data exploration and visualization tool that runs fully in the browser and can handle large files (200 MB CSV on my 8gb MacBook air is snappy). It’s also reactive - so if, for example, you change a filter, all the data transform blocks after it re-evaluate automatically. You can try it here: https://pretzelai.github.io/ (static hosted webpage) or see a demo video here: https://www.youtube.com/watch?v=73wNEun_L7w You can play with the demo CSV that’s pre-loaded (GitHub data of text-editor adjacent projects) or upload…

  • Open-source serverless security lake powered by Rust + Apache Iceberg2022 · github.com · ▲63

    Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS - matanolabs/matano

  • Streambed – Stream Postgres to Iceberg on S3, Supports Postgres WireMay 2026 · github.com · ▲129

    Stream Postgres to Apache Iceberg on S3 via logical replication, queryable over the Postgres wire protocol. - GitHub - viggy28/streambed: Stream Postgres to Apache Iceberg on S3 via logical replication, queryable over the Postgres wire protocol.

  • OpenObserve – Elasticsearch/Datadog alternative2023 · github.com · ▲198

    Hello folks, We are launching OpenObserve. An open source Elasticsearch/Splunk/Datadog alternative written in rust and vue that is super easy to get started with and has 140x lower storage cost compared to elasticsearch. It offers logs, metrics, traces, dashboards, alerts, functions (run aws lambda like functions during ingestion and query to enrich, redact, transform, normalize and whatever else you want to do. Think redacting email IDs from logs, adding geolocation based on IP address, etc). You can do all of this from the UI, no messing up with configuration files. OpenObserve…

More dev tools this month

the category →
  • /dev/null▲486

    a social network for devs

    Dev tools · 3d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 28d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 26d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 23d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 21d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 28d ago · corespeed.io

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, March 2025

the whole month →
  • Mimic Human Research & Save Findings in AI Knowledge Base

    AI · 2025 · sider.ai

  • Turn your ideas into products that sell

    AI · 2025 · atoms.dev

  • Aha▲1,152

    The world's first AI influencer marketing team

    AI · 2025 · ahacreator.com

  • Fluently▲976

    Start speaking English as well as your native language

    AI · 2025 · getfluently.app

  • Conversational AI surveys, interviews, user tests, polls

    AI · 2025 · theysaid.io

  • Record your screen, share instantly, look like a PRO

    Growth · 2025 · supercut.ai