Dev tools · alternatives · 2026

24 alternatives to Rust based log analytics with Parquet on S3

For write once, read many, immutable data types, Parquet on S3 is one of the most economical and scale approach. Every organisation I have talked to, in the last few years has attempted some form of Parquet on S3 implementation. However, these initiatives face challenges in standardising the approach for both ingesting and querying the data. Data quality, data governance and access control - everything becomes a challenge. We at Parseable are taking the Parquet on S3 approach and making it into an Enterprise grade product. Integrate easily with existing log agents and libraries. Built-in…

Parseable is a Rust-based log analytics platform that stores data in Parquet format on S3 for cost-effective, scalable log management. It integrates with existing log agents and libraries while providing enterprise… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier. Rust based log analytics with Parquet on S3 launched in 2023; newer entries below may have overtaken it.

1
Columnar store for fast, lightweight logging▲15
Founder here, Parseable is a lightweight log ingestion and query engine written in Rust. Parseable can ingest data from existing logging agents (FluentBit, LogStash, Vector, syslog-ng and more) using HTTP + JSON output. Ingested logs are stored as semi-indexed Parquet files (on disk or S3). You can query the data with builtin query engine using SQL or use a query engines of choice like Spark, Presto, Trino and so on. We also developed a Grafana data source plugin that lets you visualise log data via Grafana. Sample dashboard link in readme. As log data grew, our industry has responded with…
2023 · github.com · its alternatives →
2
Parseable Log Storage▲79
Over the past few months, we've been building Prism; a fast, developer-first observability UI that's deeply integrated with our open-source database, Parseable. Prism is designed for engineers who debug distributed systems, sometimes at odd hours, and need answers right now, without having to deal with five different tools. Backstory: We spoke to dozens of observability practitioners in large enterprises. Across the board, we heard two things: (1)The RoI on observability tools is hard to justify. (2)OSS leads to tool sprawl, metrics in Grafana, logs in ELK, traces… somewhere. We wanted a…
2022 · parseable.com · its alternatives →
3
Rust, Apache Arrow, Parquet based cloud native log storage platform▲5
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression. - parseablehq/parseable
2022 · github.com · its alternatives →
4
Simple, scalable, index-free, log storage and search platform▲13
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression. - parseablehq/parseable
2022 · github.com · its alternatives →
5
Parqeye – A CLI tool to visualize and inspect Parquet files▲167
I built a Rust-based CLI/terminal UI for inspecting Parquet files—data, metadata, and row-group-level structure—right from the terminal. If someone sent me a Parquet file, I used to open DuckDB or Polars just to see what was inside. Now I can do it with one command. Repo: https://github.com/kaushiksrini/parqeye
Nov 2025 · github.com · its alternatives →
6
Turbolite – a SQLite VFS serving sub-250ms cold JOIN queries from S3▲185
I built a SQLite VFS in Rust that serves cold queries directly from S3 with sub-second performance, and often much faster. It’s called turbolite. It is experimental, buggy, and may corrupt data. I would not trust it with anything important yet. I wanted to explore whether object storage has gotten fast enough to support embedded databases over cloud storage. Filesystems reward tiny random reads and in-place mutation. S3 rewards fewer requests, bigger transfers, immutable objects, and aggressively parallel operations where bandwidth is often the real constraint. This was explicitly inspired…
Mar 2026 · github.com · its alternatives →
7PD
PicoMQ – Durable Streams over HTTP, on object storagefree▲159
PicoMQ is a Rust server for Durable Streams, built on Object Store. Cheap, URL-addressable, granular streams (create/append/read/long-poll/SSE), with Pico Protocol or Durable Streams Protocol as the facade. S3Stream is the stream storage primitive, used in AutoMQ, shipped as a Rust library. Coordination is a command log in Postgres.
Aug 2026 · picomq.com · its alternatives →
8
Quak Query▲10
Quick and dirty duckdb in the browser, parquet!
2025 · quak.dev · its alternatives →
9
Walrus – a Kafka alternative written in Rust▲160
🦭 Distributed log streaming engine built from first principles - nubskr/walrus
Dec 2025 · github.com · its alternatives →
10
OpenObserve – Elasticsearch/Datadog alternative▲198
Hello folks, We are launching OpenObserve. An open source Elasticsearch/Splunk/Datadog alternative written in rust and vue that is super easy to get started with and has 140x lower storage cost compared to elasticsearch. It offers logs, metrics, traces, dashboards, alerts, functions (run aws lambda like functions during ingestion and query to enrich, redact, transform, normalize and whatever else you want to do. Think redacting email IDs from logs, adding geolocation based on IP address, etc). You can do all of this from the UI, no messing up with configuration files. OpenObserve…
2023 · github.com · its alternatives →
11
Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB▲116
🗄️ A simple CLI for converting WARC to Parquet. Contribute to maxcountryman/warc-parquet development by creating an account on GitHub.
2022 · github.com · its alternatives →
12
S3 compatible store with 1M IOPS(4K-R,p99~5ms), BYOC in 5min with rust▲23
Ultra-high performance distributed storage system in the AI era. Powered by Fractal ART engine, Rust-native, io_uring, with multi-protocol (S3 object storage, POSIX FS, ...) - fractalbits-labs/fractalbits
Dec 2025 · github.com · its alternatives →
13
Lance – Alternative to Parquet for ML data▲85
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming.. - lance-format/lance
2023 · github.com · its alternatives →
14
Hyperparam: OSS tools for exploring datasets locally in the browser▲77
For the last year I’ve been developing Hyperparam — a collection of small, fast, dependency-free open-source libraries designed for data scientists and ML engineers to actually look at their data. - Hyparquet: Read any Parquet file in browser/node.js - Icebird: Explore Iceberg tables without needing Spark/Presto - HighTable: Virtual scrolling of millions of rows - Hyparquet-Writer: Export Parquet easily from JS - Hyllama: Read llama.cpp .gguf LLM metadata efficiently CLI for viewing local files: npx hyperparam dataset.parquet Example dataset on Hugging Face Space:…
2025 · hyperparam.app · its alternatives →
15
CallFS – S3-style object store in one Go binary (MIT)▲66
We started CallFS after yet another late-night “why did the uploads vanish?” incident. Our small team had stitched together rsync, a fragile NFS mount, and an S3 bucket—none of it observable, all of it waiting to bite us. So we wrote a single-process file service in Go that: • Speaks the S3 API (so existing tooling works). • Stores hot data on local disks for speed; cold data can sit in any S3-compatible bucket. • Exposes Prometheus metrics and JSON logs by default, because “what happened?” shouldn’t be guesswork. • Ships as a ~25 MB static binary—no external deps, MIT license. Today it’s…
2025 · github.com · its alternatives →
16
Open-source serverless security lake powered by Rust + Apache Iceberg▲63
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS - matanolabs/matano
2022 · github.com · its alternatives →
17
Parqv – Interactive TUI Parquet Visualizer▲18
Interactive Python TUI for visualizing and analyzing files with multiple formats - sanspareilsmyn/parqv
2025 · github.com · its alternatives →
18PV
ParqDB – Vector search in the browser from Parquet over HTTP"▲26
Search a 100,000-article ParqDB index directly in the browser with MiniLM, HTTP Range, Parquet, and WebAssembly.
Aug 2026 · search.parqdb.io · its alternatives →
19
IceGate – Observability data lake engine▲15
Today we're (@sprosvirnin and I) launching the first open-source release of IceGate - a Rust-native engine that stores logs (metrics and traces coming soon) in Apache Iceberg tables on your own object storage. Observability costs are out of control. Teams pay per GB ingested, get locked into proprietary formats, and can't use their own data outside the vendor's UI. We built the first observability data lake engine to fix this. This is our first release under Apache 2.0. We're building in the open and looking for contributors and early adopters who want observability without the markup. Star…
Apr 2026 · github.com · its alternatives →
20BD
Buquet – Durable queues and workflows using only S3▲8
buquet (bucket queue) is a queue and workflow orchestration tool using only S3-compatible* object storage. S3 is the control plane making it much simpler than alternatives. This does come with tradeoffs (see docs), but I do believe there is a niche it can serve well. https://horv.co/buquet.html https://github.com/h0rv/buquet * see https://github.com/h0rv/buquet/blob/main/docs/guides/s3-comp...
Feb 2026 · horv.co · its alternatives →
21DJ
Dassana. JSON-native,schema-less logging solution built atop ClickHouse▲25
Hello HN, I’m Gaurav. Founder & CEO of Dassana. We are coming out of stealth today and would like to invite the community to give us a try. https://lake.dassana.io/ First, a bit of a backstory. I grew up with grep to search log files. The kind of person whose grep was aliased to grep -i. Then came along Splunk. It was a game-changer. For every single start-up I started (there are a few) I used Splunk and quite often we will run out of our ingestion quota. SumoLogic wasn’t cheaper either so we looked into DataDog. It was good until we started running issues with aggregate…
2022 · its alternatives →
22
Dendrite, a golang log parser▲32
Dendrite adds all your logs to a single structured log stream, so you can search, graph, and analyze easier. - omc/dendrite
2013 · github.com · its alternatives →
23
Hyparquet 1.0 – Apache Parquet Parser for the Browser▲6
I started 6 months ago when I wanted to look inside datasets from Hugging Face. I was not satisfied with existing libraries. So, naturally, I built my own library from scratch. Parquet is a very complicated format. It has 22 data types, 9 encodings, 8 compression codecs. Previous parquet js libraries went abandoned due to the complexity. However, I can confidently say that Hyparquet is now the most conformant parquet parser in existence. It can open more files than PyArrow and DuckDB. I dare you to find a file that Hyparquet can’t open! In addition to supporting all the parquet files,…
2024 · github.com · its alternatives →
24
Fast Parquet Viewer▲3
A fast, lightweight desktop viewer for .parquet files
Mar 2026 · jaungiers.github.io · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →