Alternatives
Products that do what Open-Source C++ Apache Iceberg Client with Write Support does
Existing OSS C++ projects like ClickHouse and DuckDB support reading from Iceberg tables. Writing requires Spark, PyIceberg, or managed services. In this PR https://github.com/timeplus-io/proton/pull/928, we are open-sourcing a C++ implementation of Iceberg integration. It's an MVP, focusing on REST catalog and S3 read/write(S3 table support coming soon). You can use Timeplus to continuously read data from MSK and stream writes to S3 in the Iceberg format. No JVM. No Python. Just a low-overhead, high-throughput C++ engine. Docker/K8s are optional. Demo…
- 1SL
At Arcesium, we needed a way to run SQL-driven CRUD operations, manage slowly-changing dimensions, and handle schema evolution on our cloud data lakes—without the overhead of spinning up distributed clusters or relying on vendor-managed query services. That’s why we built SwiftLake, a lightweight open-source library that brings Apache Iceberg and DuckDB together: - Lightweight & cluster-free: Runs as a single Java service with embedded DuckDB—no distributed infra required. - Full CRUD and SCD1/SCD2 support: Reads, inserts/appends, updates, deletes, and merges with ACID guarantees.…
Sep 2025 · github.com
- 2
- 37F
OLake is our open-source tool for ingesting Database & Kafka data into Apache Iceberg. We recently redesigned the write pipeline and saw ~7x throughput improvements. Sharing the architecture decisions, trade-offs, and benchmarks.
Dec 2025 · olake.io
- 4IJ
This is a small, framework-agnostic JavaScript/TypeScript client for the Apache Iceberg REST Catalog. It is good for managing the catalog (eg: managing tables), and it's MIT licensed. The goals: - Generic: Works with any Iceberg REST Catalog implementation, not tied to any specific vendor - Minimal: Thin HTTP wrapper over the official REST API, no engine-specific logic - Type-safe: First-class TypeScript support with strongly-typed request/response models - Fetch-based: Uses native fetch API with support for custom implementations - Universal: Targets Node 20+ and modern browsers…
Dec 2025 · github.com
- 5LC
Attached is my attempt at making a small toy S3 client without any other dependency besides libcurl and OpenSSL. Was tested mainly on MinIO (RIP) locally, so I would expect some bugs when using it against AWS, although I was able to play with it on some open access buckets Be aware that I am not a C++ programmer and this project was indeed done to learn a bit of C++ myself :') Feedback on any of the code, either on gtest, or the benchmarking section or the core itself is welcome!
Jun 2026 · github.com
- 6DD
Hey all! I wrote Explorer[1] a good few years ago now with the dream of fast dataframes with a dplyr-like API in a really powerful, ergonomic language (Elixir). It's proved pretty successful. Explorer is used in production at my company, and it's my go-to for quick data analysis. But maintaining it became a true albatross. Polars is an amazing project, but the development process is fast and a lot is very focused on the Python lib. We found that trying to maintain Explorer against Polars was a maintenance nightmare and eventually hit points where we had to give up features and found it…
Mar 2026 · github.com
- 7A1
AutoMQ is a fully open-source, next-generation Kafka built on top of S3. Version 1.5.0 is a very important release. In March of this year, Confluent officially launched the commercial capability of Tableflow. Now, with the AutoMQ open-source software, you can also experience this killer feature. Simply put, for Kafka streaming data, AutoMQ can automatically store it in S3 in Iceberg Table format, so you no longer need to manage Flink Jobs and Spark Jobs yourself to perform ETL operations and convert Kafka data into table format. We believe this will be the new paradigm for Kafka stream data…
2025 · github.com
- 8HP
I built this because I was tired of scrolling through hundreds of lines of AWS CLI JSON output just to find instance status. hawk brings pandas-like operations (select, group_by, aggregations) to CLI with unified syntax across JSON/YAML/CSV. Key features: - Instant data structure overview with `| info` - Same query syntax for all formats - Built in Rust for speed and single-binary distribution Would love feedback from the community!
2025 · github.com
- 9DR
We’ve built SQLRooms, an open-source framework for creating single-node data analytics apps powered by DuckDB. It lets you build fully client-side, data-centric apps using React and DuckDB running in the browser (via WebAssembly) or in Electron. No server or backend is required — apps can work offline, preserve data privacy, and run queries on large datasets with sub-second performance. Features: - Query large datasets in browser with DuckDB (WASM) - Modular design for building composable data UIs (query editors, dashboards, notebooks, etc.) - Data privacy-preserving AI assistant that can…
2025 · sqlrooms.org
- 10FO
Hey HN, I’m Roi, one of the co-creators of FalkorDB. We’re a growing team working on a graph database designed for production workloads and GraphRAG systems. The new release (v4.10.0) is out, and I wanted to share some of the updates and ask for feedback from folks who care about performance, memory efficiency in graph-heavy systems. FalkorDB is an open-source property graph database that supports OpenCypher (with our own extensions) and is used under the hood for retrieval-augmented generation setups where accuracy matters. The big problem we’re working on is scaling graph databases without…
2025
- 11RL
Repere lets you drop CSV/JSON/Parquet/XLSX files into your browser and immediately query them with full DuckDB SQL. Nothing gets uploaded, everything runs locally via DuckDB WASM. Unlike Excel and Google Sheet it can handles millions of rows easily. Features: - Filter, sort, join, pivot across multiple files Every transformation becomes a node in a visual pipeline (DAG) - Full undo/redo, real-time recomputation - Export results or replay pipelines on new files with the same schema - Works offline - Sparklines, themes and charts
Jan 2026 · repere.ai
- 12CL
Hi everyone. I've recently released control-components, a C++ library I've been using for most of my embedded projects. It is written in C++17 (with some features from C++20) and uses STL and FreeRTOS under the hood. It contains a lot of building blocks that is commonly used in embedded and IoT projects: finite state machines (FSM), various counters, synchronisation primitives, system loops, sensors, schedulers, HTTP, WiFi, Web GUI, and much more. It also provides GitHub CI workflows for build automation (ccache, various checks). In general, it's a good starting point for an ESP32 project.…
2025 · github.com
- 13MO
Hey hacker news! I built Melchi, an open-source tool that handles Snowflake to DuckDB replication with proper CDC support. I'd love your feedback on the approach and potential use cases. *Why I built it:* When I worked at Redshift I saw two common scenarios that were painfully difficult to solve: Teams needed to query and join data from other organizations' Snowflake instances with their own data stored in different warehouse types, or they wanted to experiment with different warehouse technologies but the overhead of building and maintaining data pipelines was too high. With DuckDB's…
2024 · github.com
- 14PR
Hi HN! We built PondPilot – a fully client-side data exploration tool powered by DuckDB. It’s open-source and built for speed, privacy, and simplicity. Try it: https://app.pondpilot.io GitHub: https://github.com/pondpilot/pondpilot You can: - Run fast SQL queries directly in your browser - Explore CSV, Parquet, JSON, or .duckdb files without uploading - Keep your data 100% local (it never leaves your device) - Install as a PWA and work offline - Use it read-only, with real-time updates when files change It’s designed as a lightweight alternative to notebooks or…
2025 · app.pondpilot.io
- 15VS
Hi HN, I wanted to share an exciting new open-source project: "VulcanSQL"! If you're interested in seamlessly transitioning your operational and analytical use cases from data warehouses and databases to the edge API server, this open-source data API framework might be just what you're looking for. VulcanSQL (https://vulcansql.com/) is suitable for following use cases: * Customer-facing analytics - expose analytics in your SaaS product for customers to understand how the product is performing for them via customer dashboards, insights, and reports. * Data Sharing - sharing…
2023 · vulcansql.com
- 16RF
Project Page: https://rotel.dev Github: https://github.com/streamfold/rotel Hi HN, Ray and Mike here! We’re building Rotel, a new high performance, resource efficient approach to OpenTelemetry collection. Rotel is open source (Apache License 2.0) and runs as a standalone process and collects telemetry from external processes or other collection agents. It consumes 75% less memory and 50% less CPU in benchmarks https://streamfold.github.io/rotel-otel-loadtests/benchmarks, so it is particularly well-suited for environments where resource…
2025 · rotel.dev
- 17B5
I built a message broker that speaks the Kafka wire protocol, so any Kafka client (librdkafka, kafka-python, kcat, etc.) works without code changes. The entire binary is 52KB. No JVM, no ZooKeeper, no third-party libraries — just C++20 with kqueue/epoll. Starts in <10ms, uses 0% CPU when idle. I built this because running Kafka locally for development is painful — gigabytes of RAM, slow startup, ZooKeeper/KRaft configuration. I just wanted something that accepts produce requests and gets out of the way. Technical details: - Single-threaded event loop (kqueue on macOS, epoll on…
Feb 2026 · github.com
- 18FA
I was working on optimising Subversion. One of its bottleneck is computing file hashes. First thing I tried was to use OpenSSL for that. It significantly improved its performance. It made it 8x faster in some cases. However, it was not optimal to use it: - OpenSSL is heavy and bloated. It's like a whole operating system on its own. - Since OpenSSL 3.0, low-level digest APIs are deprecated, and instead they recommend to use EVP which might be slow in some cases. So I decided to create a new library for computing cryptographic digests. It basically takes OpenSSL's implementations, but with an…
Feb 2026 · github.com
- 19RC
2017 · github.com
- 20ON
ABOUT ONEUPTIME: OneUptime (https://github.com/oneuptime/oneuptime) is the open-source alternative to DataDog + StausPage.io + UptimeRobot + Loggly + PagerDuty. It's 100% free and you can self-host it on your VM / server. OneUptime has Uptime Monitoring, Logs Management, Status Pages, Tracing, On Call Software, Incident Management and more all under one platform. Updates: Several new monitor options launched - You can now monitor your SSL Certificates and Servers (Processes running, Mem, CPU, Disk, etc) Evaluate monitor metrics over time. You can set up alerts for…
2024
- 21RF
Hey HN, I built rawkit.dev, a collection of browser-based developer utilities. No ads, no signups, no tracking. Everything processes client-side — your data never touches a server. The tools: - JSONForge: JSON editor with tree/graph views, diff, transform, JQ-style queries, format conversion - SQLSandbox: SQLite via WASM — import CSVs, write SQL, join across files - Regexplorer: Regex builder with live matching, plain English mode,nmulti-language export - SiftLog: Log file viewer with auto-detection, severity filtering, regex search, timeline - Tabulate: CSV/TSV viewer with…
Feb 2026 · rawkit.dev
- 22SK
2020 · github.com
- 23PT
The idea is simple: AI agents need real-time data to be useful. But streaming real-time data into your data warehouse means you need the data warehouse to be up 24/7. This is expensive and wasteful. What if you could spin up an ephemeral data warehouse only when your agent needs it, and get real-time data at the same time? The solution: Polynya replicates your data into Iceberg, and gives your agent an ephemeral ClickHouse instance on demand. Polynya also provides persistent workspaces — collections of views that survive across sessions. So from your agent's point of view, it's a…
Apr 2026 · polynya.dev
- 24DY
Hey HN! I'm open-sourcing DataKit today. GitHub: https://github.com/datakitpage/datakit Live demo: https://datakit.page DataKit is a browser-based data analysis platform that processes multi-gigabyte files (CSV, Parquet, JSON, Excel) entirely client-side using DuckDB-WASM. Your data never leaves your browser. What it does: • Process large files (tested up to 20GB) without any server • Full SQL interface powered by DuckDB compiled to WebAssembly • Python notebooks via Pyodide for data science workflows • Connect to remote sources (PostgreSQL, MotherDuck, S3) with…
Dec 2025 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →