nowfound

Dev tools · alternatives · 2026

24 alternatives to Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB

🗄️ A simple CLI for converting WARC to Parquet. Contribute to maxcountryman/warc-parquet development by creating an account on GitHub.

This tool converts WARC (Web Archive) files into Parquet format, enabling efficient querying with DuckDB. It's designed for researchers, data analysts, and web archivists who need to extract and analyze data from large… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB launched in 2022; newer entries below may have overtaken it.

  1. 1

    WarcDB: Web crawl data as SQLite databases. Contribute to Florents-Tselai/WarcDB development by creating an account on GitHub.

    2022 · github.com · its alternatives →

  2. 2

    I built a Rust-based CLI/terminal UI for inspecting Parquet files—data, metadata, and row-group-level structure—right from the terminal. If someone sent me a Parquet file, I used to open DuckDB or Polars just to see what was inside. Now I can do it with one command. Repo: https://github.com/kaushiksrini/parqeye

    Nov 2025 · github.com · its alternatives →

  3. 3

    Hey HN! We’ve built Pretzel, an open-source data exploration and visualization tool that runs fully in the browser and can handle large files (200 MB CSV on my 8gb MacBook air is snappy). It’s also reactive - so if, for example, you change a filter, all the data transform blocks after it re-evaluate automatically. You can try it here: https://pretzelai.github.io/ (static hosted webpage) or see a demo video here: https://www.youtube.com/watch?v=73wNEun_L7w You can play with the demo CSV that’s pre-loaded (GitHub data of text-editor adjacent projects) or upload…

    2024 · github.com · its alternatives →

  4. 4DU

    I built Duck-UI, a web-based SQL editor that runs DuckDB entirely in your browser via WebAssembly. No backend required. The Problem: Every time I needed to query csv, parquet, or even to play with SQL, I had to either: (a) spin up a Jupyter notebook (b) use the CLI (c) upload to a hosted service. Friction at every step (TOO MUCH to load a csv or even to test some sql (study)... The Solution: DuckDB's WASM runtime lets us run SQL analysis client-side. Load CSV/JSON/Parquet files from disk or URL, write SQL, get results instantly. Data stays on your machine. What It Does: SQL editor…

    2025 · demo.duckui.com · its alternatives →

  5. 5

    Quick and dirty duckdb in the browser, parquet!

    2025 · quak.dev · its alternatives →

  6. 6

    Convert webpages into Excel data in seconds

    2018 · chromewebstore.google.com · its alternatives →

  7. 7

    Add content from a web page to an Airtable database

    2020 · airtable.com · its alternatives →

  8. 8

    For the last year I’ve been developing Hyperparam — a collection of small, fast, dependency-free open-source libraries designed for data scientists and ML engineers to actually look at their data. - Hyparquet: Read any Parquet file in browser/node.js - Icebird: Explore Iceberg tables without needing Spark/Presto - HighTable: Virtual scrolling of millions of rows - Hyparquet-Writer: Export Parquet easily from JS - Hyllama: Read llama.cpp .gguf LLM metadata efficiently CLI for viewing local files: npx hyperparam dataset.parquet Example dataset on Hugging Face Space:…

    2025 · hyperparam.app · its alternatives →

  9. 9

    Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming.. - lance-format/lance

    2023 · github.com · its alternatives →

  10. 10PV

    Search a 100,000-article ParqDB index directly in the browser with MiniLM, HTTP Range, Parquet, and WebAssembly.

    Aug 2026 · search.parqdb.io · its alternatives →

  11. 11PA
  12. 12

    Free browser-based SQL editor powered by DuckDB. Query and visualize CSV, JSON, Parquet and Arrow files locally or from remote URLs. No installation required.

    2024 · sql-workbench.com · its alternatives →

  13. 13

    Hi folks. I've been doing some experiments on how LLMs could get more handy in the day to day of working with files (CSV, Parquet, etc). Earlier last year, I built https://datakit.page and evolved it over and over into an all in-browser experience with help of duckdb-wasm. Got loads of feedbacks and I think it turned into a good shape with being an adhoc local data studio, but I kept hearing two main things/issues: Why can't the AI also change cells in the file we give to it? Why can't we modify this grid ourselves? So besides the whole READ and text-to-SQL flows, what seemed…

    Feb 2026 · opensheet.app · its alternatives →

  14. 14

    Turn any webpage into structured data using LLMs. Contribute to mishushakov/llm-scraper development by creating an account on GitHub.

    2024 · github.com · its alternatives →

  15. 15
    DuckDisk▲104

    Table-first storage analysis for Mac, cloud, and SSH

    Aug 2026 · github.com · its alternatives →

  16. 16CQ

    Import CSVs, write SQL, and instantly share it with anyone. Runs 100% in-browser, so you're in control of your data.

    2022 · csvfiddle.io · its alternatives →

  17. 17

    View, query and convert Parquet files in your browser

    Jul 2026 · parquetkit.com · its alternatives →

  18. 18

    Interactive Python TUI for visualizing and analyzing files with multiple formats - sanspareilsmyn/parqv

    2025 · github.com · its alternatives →

  19. 19

    Rank a list of documents according to their relevance to a query primarily and your custom instructions secondarily. We evaluated the model on instructions for recency, document type, source, and metadata, and it can generalize to other instructions as well. The reranker supports multilinguality. Th

    2025 · docs.contextual.ai · its alternatives →

  20. 20

    Read Web ARChive (WARC) files in PHP. Contribute to Mixnode/mixnode-warcreader-php development by creating an account on GitHub.

    2017 · github.com · its alternatives →

  21. 21

    I started 6 months ago when I wanted to look inside datasets from Hugging Face. I was not satisfied with existing libraries. So, naturally, I built my own library from scratch. Parquet is a very complicated format. It has 22 data types, 9 encodings, 8 compression codecs. Previous parquet js libraries went abandoned due to the complexity. However, I can confidently say that Hyparquet is now the most conformant parquet parser in existence. It can open more files than PyArrow and DuckDB. I dare you to find a file that Hyparquet can’t open! In addition to supporting all the parquet files,…

    2024 · github.com · its alternatives →

  22. 22

    For write once, read many, immutable data types, Parquet on S3 is one of the most economical and scale approach. Every organisation I have talked to, in the last few years has attempted some form of Parquet on S3 implementation. However, these initiatives face challenges in standardising the approach for both ingesting and querying the data. Data quality, data governance and access control - everything becomes a challenge. We at Parseable are taking the Parquet on S3 approach and making it into an Enterprise grade product. Integrate easily with existing log agents and libraries. Built-in…

    2023 · github.com · its alternatives →

  23. 23

    Instantly open & analyze parquet files online with AI

    2024 · tablab.app · its alternatives →

  24. 24

    What started as a Claude Code experiment turned into a browser-native SQL workbench I now use daily. Runs DuckDB WASM entirely in your browser. No backend, no installation, no signup. - Query local files (CSV, Parquet, Excel) – data never leaves your machine - Handles 100M+ rows, 50GB+ files in a browser tab - Full UI: Monaco editor, schema explorer, spreadsheet-style results grid - Share SQL via URL – anyone can run your query instantly - BigQuery connector built-in (Snowflake coming) v0.2 – actively developing. Feedback welcome. GitHub (MIT):…

    Dec 2025 · sql.dbxlite.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →