Lance – Alternative to Parquet for ML data

In plain words

Lance is a data format designed as an alternative to Parquet for machine learning workflows. It provides columnar storage optimized for ML applications, offering features like fast random access and efficient vector search capabilities. Lance targets data engineers and ML practitioners who need better performance characteristics than traditional formats when working with large-scale datasets. The project is open source and available on GitHub.

written from the facts on this page · September 2026

• 
  Lance – Deep Learning with DuckDB and Arrow2022 · github.com · ▲65

  Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming.. - lance-format/lance

• 
  Artifacts by DataboxJul 2026 · databox.com · ▲409

  Ask your AI Analyst and get back a ready-to-share report

• 
  Vortex – a high-performance columnar file format2024 · github.com · ▲249

  An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation. - vortex-data/vortex

• 
  Lance – image/video generation and understanding in one modelMay 2026 · github.com · ▲64

  The model has 3B active parameters. We put the code, homepage, paper and model links here: - Code: https://github.com/bytedance/Lance - Homepage: https://lance-project.github.io/ - Paper: https://arxiv.org/abs/2605.18678 - Model: https://huggingface.co/bytedance-research/Lance p.s. Lance is a research project, not a polished product. The model was trained using fewer than 128 GPUs.

• 
  Hyperparam: OSS tools for exploring datasets locally in the browser2025 · hyperparam.app · ▲77

  For the last year I’ve been developing Hyperparam — a collection of small, fast, dependency-free open-source libraries designed for data scientists and ML engineers to actually look at their data. - Hyparquet: Read any Parquet file in browser/node.js - Icebird: Explore Iceberg tables without needing Spark/Presto - HighTable: Virtual scrolling of millions of rows - Hyparquet-Writer: Export Parquet easily from JS - Hyllama: Read llama.cpp .gguf LLM metadata efficiently CLI for viewing local files: npx hyperparam dataset.parquet Example dataset on Hugging Face Space:…

• 
  Spice.ai – materialize, accelerate, and query SQL data from any source2024 · github.com · ▲177

  Hi HN, We're Luke and Phillip, and we're building Spice.ai OSS - a lightweight, portable runtime, built in Rust and powered by Apache DataFusion to locally materialize, accelerate, and query data tables sourced from any database, data warehouse or data lake. Phillip and I first introduced Spice on Show HN in September 2021. Since then, we’ve been schooled and humbled in every way building 100TB+ data and ML systems for the https://spice.ai cloud platform. Along with our customers, we struggled with getting fast, low-latency, high-concurrency SQL query within a budget, accessing and…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Beam.win▲377

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  Sidekick▲1,341

  An AI-powered accessibility assistant in Stark

  AI · 2023 · getstark.co

• 
  Boring Report, a news app that uses AI to desensationalize the news▲1,166

  In today's world, catchy headlines and articles often distract readers from the facts and relevant information. By utilizing OpenAI's language models, Boring Report processes sensationalist news articles, transforms them into the content you see, and helps readers focus on the essential details. We recently updated our iOS app experience, so any and all feedback would be appreciated. App Link: https://apps.apple.com/us/app/boring-report-news-by-ai/id644...

  AI · 2023 · boringreport.org

• 
  Dora AI (Alpha)▲1,136

  Generating powerful websites, one prompt at a time

  AI · 2023

• 
  AudioPen▲888

  The easiest way to convert messy thoughts into clear text

  AI · 2023 · audiopen.ai

• 
  Momentum Page▲834

  Launch your website in seconds, get users in minutes

  Dev tools · 2023 · page.mmntm.build

• 
  Moda▲791

  An e-commerce growth marketing platform

  Growth · 2023