ETL at Trino speeds and a step-by-step tutorial on running benchmarks
After six months of challenging work on Project Tardigrade, we are ready to launch. With the project we improved the user experience of running resource intensive queries that are common in the Extract, Transform, Load (ETL) and batch processing space. It required some significant and fascinating en
ETL at Trino speeds and a step-by-step tutorial on running benchmarks launched on May 5, 2022 with 13 votes, #912 of 2,942 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 4 years on.
In plain words
Trino is a distributed SQL query engine designed for fast data processing at scale. It enables users to query data across multiple sources simultaneously, making it suitable for organizations handling large datasets and complex analytics workloads. The platform is distinguished by its ability to perform ETL operations at high speeds, alongside a comprehensive tutorial for running performance benchmarks to evaluate system capabilities.
written from the facts on this page · September 2026
From the sources
After six months of challenging work on Project Tardigrade, we are ready to launch. With the project we improved the user experience of running resource intensive queries that are common in the Extract, Transform, Load (ETL) and batch processing space. It required some significant and fascinating engineering to get us to the current status. The latest Trino release includes all the work from Proje
Does a similar job
all alternatives →
Spice.ai – materialize, accelerate, and query SQL data from any source2024 · github.com · ▲177Hi HN, We're Luke and Phillip, and we're building Spice.ai OSS - a lightweight, portable runtime, built in Rust and powered by Apache DataFusion to locally materialize, accelerate, and query data tables sourced from any database, data warehouse or data lake. Phillip and I first introduced Spice on Show HN in September 2021. Since then, we’ve been schooled and humbled in every way building 100TB+ data and ML systems for the https://spice.ai cloud platform. Along with our customers, we struggled with getting fast, low-latency, high-concurrency SQL query within a budget, accessing and…
- EAEno – A lightning fast, user-friendly YAML/TOML alternative2018 · ▲102
eno [1] - A modern plaintext language w/ libraries [2] for JavaScript, Python, Ruby & soon more! We migrated a big relational research database to a file-based solution - requirements were: - Super fast and easy editability for users - Highest performance for parsing/validating >10K documents on every user change. Our trials with YAML/TOML showed us that we wanted something both faster [3][4] and easier [4], something tailored for file-based content management ... and after months of research & development it's now publicly available (under MIT license) for everyone! Last but…
Turbolite – a SQLite VFS serving sub-250ms cold JOIN queries from S3Mar 2026 · github.com · ▲185I built a SQLite VFS in Rust that serves cold queries directly from S3 with sub-second performance, and often much faster. It’s called turbolite. It is experimental, buggy, and may corrupt data. I would not trust it with anything important yet. I wanted to explore whether object storage has gotten fast enough to support embedded databases over cloud storage. Filesystems reward tiny random reads and in-place mutation. S3 rewards fewer requests, bigger transfers, immutable objects, and aggressively parallel operations where bandwidth is often the real constraint. This was explicitly inspired…
PostgreSQL performance and cost across 23 EC2 instance typesJul 2026 · postgres.saneengineer.com · ▲97Hey! I'm Andrei. I got frustrated by how people tend to build overcomplicated backend systems, being "motivated" by big tech case studies and popular books. So, I started exploring lean architecture, and building my digital garden of ideas, approaches and data that align with this direction. Here I want to present one of the tools – Sizing tool for PostgreSQL. I've benchmarked PostgreSQL on different EC2 instances and disks, with different initial data sets to see performance that these instances can give you. And I've built a tool to visualize this data, which I welcome you to explore. So,…
More work this month
the category →
Endless lofi beats composed live in your browser, over pixel-art nights in Paris, Tokyo, New York, Hong Kong, Sydney, San Francisco and more. Free, no sign-up.
Work · 26d ago · loficities.com
Smooth Recorder▲257Mac screen recordings that look edited when you hit stop
Work · 20d ago · smoothrecorder.com
Work · 14d ago · readrare.com
Source: Show HN post ↗
Launched alongside, May 2022
the whole month →
Peerlist▲1,049A professional network w/ robust work profiles at its core
Life & fun · 2022 · peerlist.io
Switchboard▲768Hey HN this is Daniel, I'm excited to share Airtop with the community! Airtop enables AI agents to seamlessly browse and automate any website — even ones with complex authentication like MFA or OAuth. Whether you need to scrape, interact with dynamic content, or automate tasks across multiple browsers, Airtop's cloud-based infrastructure makes it scalable and accessible. Why Airtop? — AI-Driven Web Automation: Automate interactions with any site through natural language commands even if they include human-in-the-loop scenarios. — Authentication Ready: Airtop handles websites requiring…
Work · 2022 · airtop.ai
Automagically reverse-engineer REST APIs via capturing traffic - alufers/mitmproxy2swagger
Growth · 2022 · github.com
