Dev tools · September 27, 2023
Rust based log analytics with Parquet on S3
For write once, read many, immutable data types, Parquet on S3 is one of the most economical and scale approach. Every organisation I have talked to, in the last few years has attempted some form of Parquet on S3 implementation. However, these initiatives face challenges in standardising the approach for both ingesting and querying the data. Data quality, data governance and access control - everything becomes a challenge. We at Parseable are taking the Parquet on S3 approach and making it into an Enterprise grade product. Integrate easily with existing log agents and libraries. Built-in…
Rust based log analytics with Parquet on S3 launched on September 27, 2023 with 13 votes, #1,460 of 4,228 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 3 years on.
In plain words
Parseable is a Rust-based log analytics platform that stores data in Parquet format on S3 for cost-effective, scalable log management. It integrates with existing log agents and libraries while providing enterprise features including role-based access control, OIDC integration, SQL querying, and a built-in console for data analysis. The platform addresses standardization challenges around data ingestion, quality, governance, and access control that organizations typically face with Parquet-on-S3 implementations.
written from the facts on this page · September 2026
From the sources
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression. - parseablehq/parseable
In the maker’s words, at launch
For write once, read many, immutable data types, Parquet on S3 is one of the most economical and scale approach. Every organisation I have talked to, in the last few years has attempted some form of Parquet on S3 implementation. However, these initiatives face challenges in standardising the approach for both…
Does a similar job
all alternatives →
Columnar store for fast, lightweight logging2023 · github.com · ▲15Founder here, Parseable is a lightweight log ingestion and query engine written in Rust. Parseable can ingest data from existing logging agents (FluentBit, LogStash, Vector, syslog-ng and more) using HTTP + JSON output. Ingested logs are stored as semi-indexed Parquet files (on disk or S3). You can query the data with builtin query engine using SQL or use a query engines of choice like Spark, Presto, Trino and so on. We also developed a Grafana data source plugin that lets you visualise log data via Grafana. Sample dashboard link in readme. As log data grew, our industry has responded with…
Parseable Log Storage2022 · parseable.com · ▲79Over the past few months, we've been building Prism; a fast, developer-first observability UI that's deeply integrated with our open-source database, Parseable. Prism is designed for engineers who debug distributed systems, sometimes at odd hours, and need answers right now, without having to deal with five different tools. Backstory: We spoke to dozens of observability practitioners in large enterprises. Across the board, we heard two things: (1)The RoI on observability tools is hard to justify. (2)OSS leads to tool sprawl, metrics in Grafana, logs in ELK, traces… somewhere. We wanted a…
Rust, Apache Arrow, Parquet based cloud native log storage platform2022 · github.com · ▲5Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression. - parseablehq/parseable
Simple, scalable, index-free, log storage and search platform2022 · github.com · ▲13Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression. - parseablehq/parseable
Parqeye – A CLI tool to visualize and inspect Parquet filesNov 2025 · github.com · ▲167I built a Rust-based CLI/terminal UI for inspecting Parquet files—data, metadata, and row-group-level structure—right from the terminal. If someone sent me a Parquet file, I used to open DuckDB or Polars just to see what was inside. Now I can do it with one command. Repo: https://github.com/kaushiksrini/parqeye
Turbolite – a SQLite VFS serving sub-250ms cold JOIN queries from S3Mar 2026 · github.com · ▲185I built a SQLite VFS in Rust that serves cold queries directly from S3 with sub-second performance, and often much faster. It’s called turbolite. It is experimental, buggy, and may corrupt data. I would not trust it with anything important yet. I wanted to explore whether object storage has gotten fast enough to support embedded databases over cloud storage. Filesystems reward tiny random reads and in-place mutation. S3 rewards fewer requests, bigger transfers, immutable objects, and aggressively parallel operations where bandwidth is often the real constraint. This was explicitly inspired…
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 27d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 25d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 22d ago · openbot.run
Talanoa▲340Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 20d ago · talanoa.email
CoreSpeed▲332One MCP for everything your agents need: apps, memory, tools
Dev tools · 27d ago · corespeed.io
Source: Show HN post ↗ · launch text quoted in part
