TonboLite – Scale SQLite with S3, Minimize ETL
Hi! I am Tzu and the team from Tonbo here. TonboLite: https://github.com/tonbo-io/tonbolite is a SQLite extension based on Tonbo: https://github.com/tonbo-io/tonbo. It enables SQLite to create tables suitable for analytical processing on target platforms like WebAssembly in browser and efficiently write data. The data in the tables is organized as tiered Apache Parquet format files, stored on demand either on local disks (using OPFS as native I/O) or object storage services (such as S3). You can use it by creating virtual tables in regular SQLite.…
What it does
In the maker’s words, at launch
Hi! I am Tzu and the team from Tonbo here. TonboLite: https://github.com/tonbo-io/tonbolite is a SQLite extension based on Tonbo: https://github.com/tonbo-io/tonbo. It enables SQLite to create tables suitable for analytical processing on target platforms like WebAssembly in browser and efficiently write data. The data in the tables is organized as tiered Apache Parquet format files, stored on demand either on local disks (using OPFS as native I/O) or object storage services (such as S3). You can use it by creating virtual tables in regular SQLite. TonboLite started with the exploration of Tonbo application. The goal of Tonbo is to write data for analytical processing (like log processing, metrics monitoring, or text search) to unlimited remote storage in SQLite or PostgreSQL. We tried SQLite as it is the most popular transactional database for the edge. One of the most requested improvements for SQLite is better support for append-only writes (e.g., logs, time-series data), which are common in analytical data. Append-only writes present two main challenges for SQLite: 1. SQLite3 uses B-Trees as its storage structure. B-Trees perform well for random access but are not optimized for write efficiency in append-only scenarios like log-structured databases. 2. Append-only data often involves large write volumes, making it difficult to store extensive historical data in a single-machine environment long-term. However, Tonbo is well-suited to address these two issues: 1. Tonbo organizes Parquet files into an LSM Tree, a database structure highly optimized for concurrent append-only writes. 2. Tonbo supports gradually writing historical files in the background to horizontally scalable storage services (such as S3). This project is still in the very early stages. If you are interested in the project's goals and future developments, welcome to join the discussion: https://discord.gg/j27XVFVmJM. We are happy to answer any questions you may have.
Does the same job
all alternatives →- SQSQLite query inside a Bash function2021 · ▲134
Part of the workflow for building my website is the generation of a table in tab-separated column format (.tsv). The source data is found in four other .tsv files. I use an SQLite query to perform a 4-way join and write out the new table. For convenience, I wrote a script that encapsulates the query inside a Bash function. The example below illustrates this technique. repertoire() { pushd $CMM_SOURCES/_data sqlite3 <<EOS .headers on .mode tabs .import category.tsv category .import composition.tsv composition .import concert.tsv concert .import program.tsv program .once repertoire.tsv…
- SWSqliteweb – Web-Based SQLite database browser (written in Go)2014 · github.com · ▲7
- BEBSON Extension for SQLite2024 · github.com · ▲8
sqlite is, well, everywhere. It's a little shy on high-fidelity types, though, esp no dates and penny-precise numbers. And carrying rich shapes in JSON doesn't really help because JSON lacks those too. BSON supports these types but more importantly is a data carrier external to the database; you can fluidly move BSON in and out of sqlite without creating your own binary representations; just use the BSON SDK for your environment. Upwards of 20 languages are supported. The BSON extension is designed to exploit sqlite built-in JSON functions as desired.
- IMI made a tool to help manage SQLite databases on a VPS2024 · litequeen.com · ▲6
Hey everyone! It’s a single executable that you can run on your server using Docker, Systemd, or any other tool you prefer. It provides a simple user-friendly interface to manage all your SQLite databases. Inspired by PhpLiteAdmin, it features a snappy UI and offers power-user functionalities, ability to chat with your database using natural language via OpenAI api, and other features. It’s free to use, with an option for a one-time payment to unlock all features. You can find the demo at https://demo.litequeen.com/ It's early and there's much to add. Some features I think…
- TTThe TypeScript Semantic Layer for ClickHouseJun 2026 · github.com · ▲8
I've built a type-safe semantic layer in code, for ClickHouse. If you're building analytics off ClickHouse in TypeScript, I would love your feedback. With hypequery there is no platform to adopt, no YAML sprawl. It runs where your app runs. Key features: - Define metrics once, reuse them everywhere: Declare dimensions and measures in one place and then pull from the same source of truth. - Compiles to ClickHouse SQL: No service, no proxy, no extra runtime to deploy. It's a library that generates SQL and runs where your app runs. - Multi-tenancy & Authentication ready: Cross-tenant queries…
- SSSQLite-s3vfs – Read and write SQLite databases on S32021 · github.com · ▲5
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, January 2025
the whole month →- IM
Hello! I'm Byran. I spent the past ~6 months engineering a laptop from scratch. It's fully open-source on GH at: https://github.com/Hello9999901/laptop
Dev tools · 2025 · byran.ee
- TITetris in a PDF▲1,289
I realized that the PDF engines of modern desktop browsers (PDFium and PDF.js) support JavaScript with enough I/O primitives to make a basic game like Tetris. It was a bit tricky to find a union of features that work in both engines, but in the end it turns out that showing/hiding annotation "fields" works well to make monochrome pixels, and keyboard input can be achieved by typing in a text input box. All in all it's quite janky but a nice reminder of how general purpose PDF scripting can be. The linked PDF is all ASCII so you can just open it in a text editor, or have a look at…
Life & fun · 2025 · th0mas.nl
Create lifelike, personalized AI avatars from text prompts
AI · 2025 · jogg.ai
