nowfound

Life & fun · June 25, 2024

Hyparquet 1.0 – Apache Parquet Parser for the Browser

I started 6 months ago when I wanted to look inside datasets from Hugging Face. I was not satisfied with existing libraries. So, naturally, I built my own library from scratch. Parquet is a very complicated format. It has 22 data types, 9 encodings, 8 compression codecs. Previous parquet js libraries went abandoned due to the complexity. However, I can confidently say that Hyparquet is now the most conformant parquet parser in existence. It can open more files than PyArrow and DuckDB. I dare you to find a file that Hyparquet can’t open! In addition to supporting all the parquet files,…

Hyparquet 1.0 – Apache Parquet Parser for the Browser launched on June 25, 2024 with 6 votes, #1,458 of 4,672 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 2 years on.

Visit github.com ↗Alternatives

What it does

parquet file parser for javascript. Contribute to hyparam/hyparquet development by creating an account on GitHub.

In the maker’s words, at launch

I started 6 months ago when I wanted to look inside datasets from Hugging Face. I was not satisfied with existing libraries. So, naturally, I built my own library from scratch. Parquet is a very complicated format. It has 22 data types, 9 encodings, 8 compression codecs. Previous parquet js libraries went abandoned…

Does a similar job

all alternatives →
  • Hyperparam: OSS tools for exploring datasets locally in the browser2025 · hyperparam.app · ▲77

    For the last year I’ve been developing Hyperparam — a collection of small, fast, dependency-free open-source libraries designed for data scientists and ML engineers to actually look at their data. - Hyparquet: Read any Parquet file in browser/node.js - Icebird: Explore Iceberg tables without needing Spark/Presto - HighTable: Virtual scrolling of millions of rows - Hyparquet-Writer: Export Parquet easily from JS - Hyllama: Read llama.cpp .gguf LLM metadata efficiently CLI for viewing local files: npx hyperparam dataset.parquet Example dataset on Hugging Face Space:…

  • Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5mMar 2026 · huggingface.co · ▲408

    We’re on a journey to advance and democratize artificial intelligence through open source and open science.

  • Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB2022 · github.com · ▲116

    🗄️ A simple CLI for converting WARC to Parquet. Contribute to maxcountryman/warc-parquet development by creating an account on GitHub.

  • Parqeye – A CLI tool to visualize and inspect Parquet filesNov 2025 · github.com · ▲167

    I built a Rust-based CLI/terminal UI for inspecting Parquet files—data, metadata, and row-group-level structure—right from the terminal. If someone sent me a Parquet file, I used to open DuckDB or Polars just to see what was inside. Now I can do it with one command. Repo: https://github.com/kaushiksrini/parqeye

  • Lance – Alternative to Parquet for ML data2023 · github.com · ▲85

    Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming.. - lance-format/lance

  • Open-source, browser-local data exploration using DuckDB-WASM and PRQL2024 · github.com · ▲227

    Hey HN! We’ve built Pretzel, an open-source data exploration and visualization tool that runs fully in the browser and can handle large files (200 MB CSV on my 8gb MacBook air is snappy). It’s also reactive - so if, for example, you change a filter, all the data transform blocks after it re-evaluate automatically. You can try it here: https://pretzelai.github.io/ (static hosted webpage) or see a demo video here: https://www.youtube.com/watch?v=73wNEun_L7w You can play with the demo CSV that’s pre-loaded (GitHub data of text-editor adjacent projects) or upload…

More life & fun this month

the category →

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, June 2024

the whole month →
  • Pygma▲1,412

    AI copilot for Instagram

    AI · 2024 · pygma.me

  • Cello▲1,347

    Easiest way to add a referral program to your SaaS

    Growth · 2024 · cello.so

  • La Growth Machine▲1,216

    Create personalized, multi-channel conversations at scale

    AI · 2024 · lagrowthmachine.com

  • Superhuman 2.0▲1,142

    Revolutionary AI email, reimagined for teams

    AI · 2024 · superhuman.com

  • FlowMapp 3.0▲1,142

    Visual website planning in the most powerful way

    Work · 2024 · flowmapp.com

  • PyjamaHR▲1,132

    Hiring on autopilot. The AI applicant tracking system (ATS).

    Work · 2024 · pyjamahr.com