Dev tools · alternatives · 2026
24 alternatives to Lightweight data analytics using SQLite, Bash and DuckDB
Over the last 12 months, in parallel to using Google BigQuery, I have built my own processing pipeline using SQLite and DuckDB. What amazes me is that it works surprisingly well and costs much less than using BigQuery. Roughly speaking, here's what I do: A SQLite database receives IoT sensor data via a very simple PHP function. I currently use the FlightPHP framework for this. The data is written to a table within the SQLite database (WAL mode activated) and states are updated by the machines using triggers. Example of a trigger CREATE TRIGGER message_added AFTER INSERT ON messages BEGIN…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Lightweight data analytics using SQLite, Bash and DuckDB launched in 2023; newer entries below may have overtaken it.
- 1SO
SQL OnLine - SQLite, DuckDB, PGLite, MariaDB / MySQL, PostgreSQL, MS SQL Server. AI error analysis, User-friendly interface for Data Science. No registration for start, No DownLoad, No Install. | sql compiler, federated queries, temporal query federation, BI Analytics
2025 · sqliteonline.com · its alternatives →
- 2DU
I built Duck-UI, a web-based SQL editor that runs DuckDB entirely in your browser via WebAssembly. No backend required. The Problem: Every time I needed to query csv, parquet, or even to play with SQL, I had to either: (a) spin up a Jupyter notebook (b) use the CLI (c) upload to a hosted service. Friction at every step (TOO MUCH to load a csv or even to test some sql (study)... The Solution: DuckDB's WASM runtime lets us run SQL analysis client-side. Load CSV/JSON/Parquet files from disk or URL, write SQL, get results instantly. Data stays on your machine. What It Does: SQL editor…
2025 · demo.duckui.com · its alternatives →
- 3
Bunny Database▲244The content delivery platform that truly hops.
Feb 2026 · bunny.net · its alternatives →
- 4
Hi! I wanted to share an open source API-compatible replacement for SQS. It's written in Go, distributes as a single binary, and uses SQLite for underlying storage. I wrote this because I wanted a queue with all the bells and whistles - searching, scheduling into the future, observability, and rate limiting - all the things that many modern task queue systems have. But I didn't want to rewrite my app, which was already using SQS. And I was frustrated that many of the best solutions out there (BullMQ, Oban, Sidekiq) were language-specific. So I made an SQS-compatible replacement. All you have…
2024 · github.com · its alternatives →
- 5
DuckDB for streaming data. Contribute to turbolytics/sql-flow development by creating an account on GitHub.
2024 · github.com · its alternatives →
- 6
I wrote a relational database management system (RDBMS) (sqlite clone) from scratch in pure Python.
2023 · github.com · its alternatives →
- 7
- 8
Hi HN, Today we’re launching PowerSync, a Postgres<>SQLite bi-directional sync engine that enables an offline-first app architecture. It currently supports Flutter, React Native and web (JavaScript) using Wasm SQLite in the browser, with more client SDKs on the way. Conrad and I (Ralf) have been working on our sync engine since 2009, originally as part of a full-stack app platform. That version of the system is still used in production worldwide and we’ve learnt a lot from its use cases and scaling. About a year ago we started on spinning off PowerSync as a standalone product that is…
2023 · powersync.com · its alternatives →
- 9
Manipulate your SQLite database like a giant Javascript object. Built with o1.
2024 · gist.github.com · its alternatives →
- 10
Hi, I'm Philip Moore - the founder of GizmoData, and creator of GizmoSQL - an Apache Arrow Flight SQL Server - with DuckDB (or SQLite) back-end execution engines. GizmoSQL is a composable SQL server with Arrow Flight SQL, DuckDB, and SQLite - with the intention of making it easy to run DuckDB (or SQLite) as a server - usable by multiple people from a client (remote) computer. It also adds security (authentication) and encryption of traffic with TLS. To run GizmoSQL - see the steps in the README.md - where you can see how easy it is to run the server as well as how to connect via ADBC and…
2025 · github.com · its alternatives →
- 11
A truly Open Source MongoDB alternative. Contribute to FerretDB/FerretDB development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 12
https://github.com/ncruces/go-sqlite3 was doing poorly on this benchmark that was posted yesterday to HackerNews [1]. With the help of some pprof, I was able to trace it to a serious performance regression introduced two weeks ago, and come up with the fix (happy to field questions, if you're interested in the nitty gritty). It's not the fastest driver around, but it's no longer the slowest: comfortably middle of the pack. It's based on a WASM build of SQLite, and thanks to https://wazero.io doesn't need CGO. [1]:…
2023 · github.com · its alternatives →
- 13SQ
Part of the workflow for building my website is the generation of a table in tab-separated column format (.tsv). The source data is found in four other .tsv files. I use an SQLite query to perform a 4-way join and write out the new table. For convenience, I wrote a script that encapsulates the query inside a Bash function. The example below illustrates this technique. repertoire() { pushd $CMM_SOURCES/_data sqlite3 <<EOS .headers on .mode tabs .import category.tsv category .import composition.tsv composition .import concert.tsv concert .import program.tsv program .once repertoire.tsv…
2021 · its alternatives →
- 14HA
Hi all, we recently open sourced the first version of Hashquery, a Python library which lets you model analytics, DRY up common logic, and execute it against a database or warehouse. We were originally rendering SQL directly for all our queries, but that spiraled out of control with more complex analysis; the SQL needed to be changed sporadically for each new database dialect (BigQuery, Redshift, Aethena, Postgres, etc etc) and the SQL fragments were very challenging to reuse (and so fragments were copy-pasted all over). ~~~ Advantages we think it has over writing SQL by hand: - Queries are…
2024 · hashquery.dev · its alternatives →
- 15
Create custom SQLite functions in JavaScript. Extend your database with scalars, aggregates, window functions, and collations directly in JavaScript. - sqliteai/sqlite-js
2025 · github.com · its alternatives →
- 16
We’ve built SQLRooms, an open-source framework for creating single-node data analytics apps powered by DuckDB. It lets you build fully client-side, data-centric apps using React and DuckDB running in the browser (via WebAssembly) or in Electron. No server or backend is required — apps can work offline, preserve data privacy, and run queries on large datasets with sub-second performance. Features: - Query large datasets in browser with DuckDB (WASM) - Modular design for building composable data UIs (query editors, dashboards, notebooks, etc.) - Data privacy-preserving AI assistant that can…
2025 · sqlrooms.org · its alternatives →
- 17
Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://sql-flow.com/docs/category/tutorials/ https://github.com/turbolytics/sql-flow We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or…
Dec 2025 · sql-flow.com · its alternatives →
- 18
Hello HN! I'm building mvsqlite, a distributed variant of SQLite with MVCC transactions, that runs on FoundationDB. It is a drop-in replacement that just needs an `LD_PRELOAD` for existing applications using SQLite. I made this because Blueboat (https://github.com/losfair/blueboat) needs a native SQL interface to persistent data. Apparently, just providing a transactional key-value store isn’t enough - it is more easy and efficient to build complex business logic on an SQL database, and it seems necessary to bring a self-hostable distributed SQL DB onto the platform.…
2022 · github.com · its alternatives →
- 19GA
I wanted to build a persistent message queue based on SQLite, because that's what I'm using for my main state anyway. This gives me ACID across state and messaging, which is nice! I've been inspired by the terminology of AWS SQS for this, but it's obviously much simpler. Maybe you can use it too. :)
2024 · goqite.com · its alternatives →
- 20
Hi HN, We have been building SyncLite, an open-source platform to simplify offline-first application development. If your application uses SQLite or DuckDB, SyncLite lets it continue using the local database as usual while synchronization happens in the background. For SQL-based applications, SyncLite records transactions into transactionally consistent .sqlog files using SQLite as an open replication format. A background consolidator replays those transactions, derives row-level CDC and schema changes, and applies them transactionally to destination databases like PostgreSQL. The same…
2024 · github.com · its alternatives →
- 21
Hey there! I’ve been working on DB Pilot for the last couple of months, and I recently added an AI assistant powered by GPT 3.5 to help you write SQL queries tailored to your DB schema. Simply ask what data you are looking for - GPT will figure out which tables to use, how to join them, and then write a query for you. The AI assistant knows which tables and columns exist in your database, meaning it can write queries specific to your schema. Besides that, it doesn't have access to any actual data from your database though, meaning your data doesn't get exposed to OpenAI.
2023 · dbpilot.io · its alternatives →
- 22
Free browser-based SQL editor powered by DuckDB. Query and visualize CSV, JSON, Parquet and Arrow files locally or from remote URLs. No installation required.
2024 · sql-workbench.com · its alternatives →
- 23
I'm a couple years late to the party but DuckDB is blowing my mind. I couldn't find an good embedded DuckDB stream processing solution so I hacked my own, calling it SQLFlow: https://github.com/turbolytics/sql-flow SQLFlow enables writing stream transformations in pure sql, executed using DuckDB. The goal was to create a lightweight, performant stream processing engine using pure SQL transformations, DuckDB didn't disappoint! I'd love your feedback, feature requests, impressions, or just comments. I'd love to turn this into a stable, usable project that people are…
2023 · github.com · its alternatives →
- 24
Hi everyone! I wanted to share my analytics app with you. This project came from requirements to track certain very frequent events. I found that the cost to do it on a regular analytics product was much more than i was willing to pay. Secondly, I also wanted to use as few resources as possible. So I thought it may be a good idea to create something that may be useful for myself (and hopefully others). I have been able to track a great number of events with this using ~20 MB of storage and memory which is incredible. I have been really impressed by golang as a language and as an ecosystem…
2025 · github.com · its alternatives →
Also compare
- SQLite Online – 11 years of solo development, 11K daily users alternatives
- Duck-UI – Browser-Based SQL IDE for DuckDB alternatives
- Bunny Database alternatives
- Drop-in SQS replacement based on SQLite alternatives
- Execute SQL against Bluesky firehose alternatives
- I wrote a RDBMS (SQLite clone) from scratch in pure Python alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →