Alternatives
Products that do what Melchi – Open-Source Snowflake to DuckDB Replication with CDC Support does
Hey hacker news! I built Melchi, an open-source tool that handles Snowflake to DuckDB replication with proper CDC support. I'd love your feedback on the approach and potential use cases. *Why I built it:* When I worked at Redshift I saw two common scenarios that were painfully difficult to solve: Teams needed to query and join data from other organizations' Snowflake instances with their own data stored in different warehouse types, or they wanted to experiment with different warehouse technologies but the overhead of building and maintaining data pipelines was too high. With DuckDB's…
- 1SE
Hi HN! I built a Snowflake emulator for local development and testing. Testing Snowflake code locally is frustrating – you need a real account (expensive) or mock everything (tedious). I wanted something that just works with the standard [gosnowflake](https://github.com/snowflakedb/gosnowflake) driver or REST API. snowflake-emulator fixes this by: - Using DuckDB as the storage engine - Auto-translating Snowflake SQL (IFF→IF, NVL→COALESCE, DATEADD, etc.) - Supporting gosnowflake driver protocol – no code changes needed - Providing REST API v2 – use from any language…
Jan 2026 · github.com
- 2
- 3DA
Dear HN, I am Riwaj, the cofounder of dstack.ai (https://github.com/dstackai). A few months ago, we built an online service that allows users to publish data visualizations from Python or R. The idea was to build a tool that did not require additional programming or front-end development for publishing data visualizations. Such a code can be invoked from either Jupyter notebook, RMarkdown, Python, or R scripts. Once the data is pushed, it can be accessed via a browser. Open-sourcing dstack: During our customer discovery phase, we realized that dstack.ai should integrate a lot…
2020
- 4SV
I've already posted yesterday, but I'd really love to get comments, any kind of questions, suggestions and help would be greatly appreciated as it's an Open Source project of mine (and was for others during my studies at the University of Konstanz 6 years ago). Since then I spent countless ours to bring forth the idea of a versioned storage system, especially well suited for analytical tasks for timd-varying data. Especially I'd love to discuss what documentation you need, which next steps are necessary (JSON, Cloud...), API additions or changes... I've updated the README quiet a bit, such…
2018
- 5OD
Hello Hacker News! We are Rick & Yannick from Orchest (https://www.orchest.io - https://github.com/orchest/orchest). We're building a visual pipeline tool for data scientists. The tool can be considered to be high-code because you write your own Python/R notebooks and scripts, but we manage the underlying infrastructure to make it 'just work™'. You can think of it as a simplified version of Kubeflow. We created Orchest to free data scientists from the tedious engineering related tasks of their job. Similar to how companies like Netflix, Uber and Booking.com…
2020
- 6DR
We’ve built SQLRooms, an open-source framework for creating single-node data analytics apps powered by DuckDB. It lets you build fully client-side, data-centric apps using React and DuckDB running in the browser (via WebAssembly) or in Electron. No server or backend is required — apps can work offline, preserve data privacy, and run queries on large datasets with sub-second performance. Features: - Query large datasets in browser with DuckDB (WASM) - Modular design for building composable data UIs (query editors, dashboards, notebooks, etc.) - Data privacy-preserving AI assistant that can…
2025 · sqlrooms.org
- 7CE
Hello Hacker News! We're a team of YC founders (Meldium W13, Draft S11, TapEngage S11) launching something new (https://www.getcensus.com). How many times has your business team asked you to generate yet another CSV file, write a ”quick report” in SQL, or send some custom data to a terrible API (looking at you Marketo)? We’ve built a product that connects directly to your data warehouse and syncs into apps like Salesforce, Customer.io and even Google Sheets. In fact, your business teams won’t even need to rely on engineering to manage all these pipelines. The tech stack for…
2020
- 8
- 9MD
Last year I decided to start a fun side project - a love child of VS Code and NoSQLBooster. I wanted a GUI that looks modern and snappy, minimal, not like 2003 MS Excel with dozens of buttons and dropdowns everywhere. I also wanted it to have a smart autocomplete that actually knows a schema, not just keys of the current collection, but their types and enum values. I wanted to type find({status: "}) and see "pending", "active", "cancelled" in the autocomplete suggestions. As a tech stack, I chose Tauri for the shell, Bun for the sidecar running the MongoDB driver and a tRPC server, and…
May 2026 · monghoul.com
- 10AO
Hi HF, I'm Terrell, and we built an open-source app that lets developers create their own Operator with a Next.js/React front-end and a flask back-end. The purpose is to simplify spinning up virtual desktops (Xfce, VNC) and automate desktop-based interactions using computer use models like OpenAI’s There are already various cool tools out there that allow you to build your own operator-like experience but they usually only automate web browser actions, or aren’t open sourced/cost a lot to get started. Spongecake allows you to automate desktop-based interactions, and is fully open…
2025 · github.com
- 11SL
At Arcesium, we needed a way to run SQL-driven CRUD operations, manage slowly-changing dimensions, and handle schema evolution on our cloud data lakes—without the overhead of spinning up distributed clusters or relying on vendor-managed query services. That’s why we built SwiftLake, a lightweight open-source library that brings Apache Iceberg and DuckDB together: - Lightweight & cluster-free: Runs as a single Java service with embedded DuckDB—no distributed infra required. - Full CRUD and SCD1/SCD2 support: Reads, inserts/appends, updates, deletes, and merges with ACID guarantees.…
Sep 2025 · github.com
- 12GB
Hey HN Community, I recently found myself knee-deep in a fascinating challenge that I think you'll find intriguing. I'm a backend developer with a penchant for Node.js and SQL, and I've been wrestling with a problem that's both technically intricate and surprisingly common in the world of open-source development. The issue at hand? Duplicate GitHub issues. They're like weeds in a garden – you turn your back for a second, and suddenly they're everywhere, choking out the valuable discussions and dragging down productivity. So, I set out to build a bot. Not just any bot, mind you, but a Probot…
2024 · github.com
- 13WT
We just launched a small project I'm really proud of — a turbo Database MCP server! https://centralmind.ai - Connect your database to Cursor or Windsurf in just a few clicks. - Chat with PostgreSQL, MSSQL, ClickHouse, Elasticsearch, and more. - Query huge Parquet files instantly with DuckDB in-memory mode. - No downloads, no setup headaches. Short video: https://youtu.be/BboQtxen9tA Built on top of our open-source MCP Database Gateway: https://github.com/centralmind/gateway Note: You’ll need to provide connection strings to your databases. For…
2025 · centralmind.ai
- 14HT
Hi HN - For the past four months I've been working (part-time, this is OSS after all) on Harlequin, a SQL IDE for DuckDB that runs in your terminal. I built this because I work in Data, and I found myself often reaching for the DuckDB CLI to quickly query CSV or Parquet data, but then hitting a wall when using the DuckDB CLI as my queries got more complex and my result sets got larger. Harlequin is a drop-in replacement for the DuckDB CLI that runs in any terminal (even over SSH), but adds a browsable data catalog, full-powered text editor (with multiple buffer support), and a scrollable…
2023 · github.com
- 15CD
Hi everyone, I'm a PhD student in databases at CMU. Over the past few months, I've been interning at Columnar and building a community extension for DuckDB that lets you query Snowflake, Databricks, BigQuery, PostgreSQL, MySQL, and any other system with an ADBC (Arrow Database Connectivity) driver. The extension supports querying ADBC databases directly through a read_adbc table function. It also supports using ATTACH to connect to an ADBC database and then running SELECT, INSERT, COPY, and CTAS statements as if the database were local to DuckDB. You can install it from DuckDB by running:…
Jul 2026 · github.com
- 16PF
Hi there Hacker News, I've started a side project http://datasourcehub.com which aims to be a platform for data scientists. The project is still in the idea phase so the UI/UX and functionality are all subject to change. Feel free to play around, below is a guest login, and make sure files are content type of 'text/csv'. All data is subject to deletion, it's just a sandbox right now! By reaching out to the Hacker News community I hope to reach expert data scientists and get their feedback. Below are some questions I'd like to answer and some proposed directions that this…
2013
- 17PZ
Hi everyone! So a couple of weeks ago I was building a chrome extension for crawling data and uploading it somewhere online for further exploration. I found myself struggling a lot with this as I found every solution I tried hard to implement (Firebase, Mongo Atlas, EC2). I mean I only needed a simple endpoint in which I was able to set and get JSON data with some key. In the end I made a small CRUD using Mongo, Sinatra, Puma, and Nginx. Then Chrome complained that my endpoint (raw IP) was not HTTPS so I bought a cheap domain and configured an SSL certificate into my server. I found this to…
2020
- 18FO
Hey HN, I’m Roi, one of the co-creators of FalkorDB. We’re a growing team working on a graph database designed for production workloads and GraphRAG systems. The new release (v4.10.0) is out, and I wanted to share some of the updates and ask for feedback from folks who care about performance, memory efficiency in graph-heavy systems. FalkorDB is an open-source property graph database that supports OpenCypher (with our own extensions) and is used under the hood for retrieval-augmented generation setups where accuracy matters. The big problem we’re working on is scaling graph databases without…
2025
- 19DQ
What started as a Claude Code experiment turned into a browser-native SQL workbench I now use daily. Runs DuckDB WASM entirely in your browser. No backend, no installation, no signup. - Query local files (CSV, Parquet, Excel) – data never leaves your machine - Handles 100M+ rows, 50GB+ files in a browser tab - Full UI: Monaco editor, schema explorer, spreadsheet-style results grid - Share SQL via URL – anyone can run your query instantly - BigQuery connector built-in (Snowflake coming) v0.2 – actively developing. Feedback welcome. GitHub (MIT):…
Dec 2025 · sql.dbxlite.com
- 20IM
Hi there! I've been working with data in one form or another, professionally, for about 5 years. I've been thinking about my own personal data and how it's used for at least twice that long. I've been sort of building something in my head for a while that solves my own problem and, in the beginning of this year, I found the opportunity to spend some time building it out. I'll leave the detailed explanation to the blog post but, in short, I built what amounts to an API crawler combined with a data processor to help you download your personal data from 3rd party services and work with it using…
2024 · joshcanhelp.com
- 21SS
I'm a couple years late to the party but DuckDB is blowing my mind. I couldn't find an good embedded DuckDB stream processing solution so I hacked my own, calling it SQLFlow: https://github.com/turbolytics/sql-flow SQLFlow enables writing stream transformations in pure sql, executed using DuckDB. The goal was to create a lightweight, performant stream processing engine using pure SQL transformations, DuckDB didn't disappoint! I'd love your feedback, feature requests, impressions, or just comments. I'd love to turn this into a stable, usable project that people are…
2023 · github.com
- 22DD
Hey all! I wrote Explorer[1] a good few years ago now with the dream of fast dataframes with a dplyr-like API in a really powerful, ergonomic language (Elixir). It's proved pretty successful. Explorer is used in production at my company, and it's my go-to for quick data analysis. But maintaining it became a true albatross. Polars is an amazing project, but the development process is fast and a lot is very focused on the Python lib. We found that trying to maintain Explorer against Polars was a maintenance nightmare and eventually hit points where we had to give up features and found it…
Mar 2026 · github.com
- 23IM
Heya HN, after spending +1 year building an ML-driven analytics product (that didn't pan out unfortunately), I've pivoted to solving a problem my team and I found while building the previous product … why the hell is it so hard to move a model from a Jupyter notebook, to a development server, then to a production pipeline!? To solve this my team and I started the open source KitOps project under the Apache 2 license. KitOps includes the Kit CLI that uses a Kitfile manifest to create ModelKits: 1. The kit CLI packages your model, datasets, code, and configuration into an OCI compliant…
2024 · kitops.ml
- 24TO
2024 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →