Lance – Deep Learning with DuckDB and Arrow

In plain words

Lance is an open-source data management system built on DuckDB and Apache Arrow that enables efficient storage and querying of large datasets. It's designed for developers and data scientists who need fast access to structured data with minimal overhead. Lance stands out for its columnar storage format and integration with popular data processing tools, making it particularly useful for machine learning workflows and analytical applications.

written from the facts on this page · September 2026

• 
  Lance – Alternative to Parquet for ML data2023 · github.com · ▲85

  Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming.. - lance-format/lance

• 
  Vortex – a high-performance columnar file format2024 · github.com · ▲249

  An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation. - vortex-data/vortex

• 
  HelixDB – Open-source vector-graph database for AI applications (Rust)2025 · github.com · ▲237

  Hey HN, we want to share HelixDB (https://github.com/HelixDB/helix-db/), a project a college friend and I are working on. It’s a new database that natively intertwines graph and vector types, without sacrificing performance. It’s written in Rust and our initial focus is on supporting RAG. Here’s a video runthrough: https://screen.studio/share/szgQu3yq. Why a hybrid? Vector databases are useful for similarity queries, while graph databases are useful for relationship queries. Each stores data in a way that’s best for its main type of query (e.g.…

• 
  Lance – image/video generation and understanding in one modelMay 2026 · github.com · ▲64

  The model has 3B active parameters. We put the code, homepage, paper and model links here: - Code: https://github.com/bytedance/Lance - Homepage: https://lance-project.github.io/ - Paper: https://arxiv.org/abs/2605.18678 - Model: https://huggingface.co/bytedance-research/Lance p.s. Lance is a research project, not a polished product. The model was trained using fewer than 128 GPUs.

• 
  LanceDB is an embedded vector database with a native JavaScript API2023 · github.com · ▲10

  Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less. - lancedb/lancedb

• 
  Artifacts by DataboxJul 2026 · databox.com · ▲409

  Ask your AI Analyst and get back a ready-to-share report

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• I3
  I 3D scanned the interior of the Great Pyramid at Giza▲1,752

  Hey HN, I 3d scanned the interior of the Great Pyramid / Khufu's pyramid for the Giza Project this summer and just finished the guided version to share. Would love feedback and/or problems you encounter. I used both a Leica BLK 360 and Matterport Pro 2 to do the scanning and the Matterport SDK for the web viewer. Matterport's web display with Three.js has been the most accessible to a wide audience in the past (previous iterations are in Unity and Unreal, but difficult to download over slower connections). I've been interviewing social studies teachers around the 6th grade level to…

  Dev tools · 2022 · giza.mused.org

• 
  Clay▲819

  Discover, organize, and deepen relationships

  Work · 2022 · me.sh

• 
  Restfox – Open source lightweight alternative to Postman▲758

  Last time I posted this it didn't garner much interest. There have been lots of improvements and fixes since the last release. Quick list of features: - Workspaces - Tabs - Nested Folders - Lots of context menus - Response history - Plugins - Runs fully in the browser and runs offline if necessary - Chrome and Firefox extension to bypass CORS restrictions - Desktop builds for all platforms - GraphQL support - Import collections exported from Postman and Insomnia - Simple user friendly interface I built this because I love Insomnia but wanted a portable version that I could run in the…

  Dev tools · 2022 · restfox.dev

• 
  Sponsor This Newsletter▲707

  100+ newsletters ready to promote your product

  Growth · 2022

• 
  Micro SaaS HQ▲672

  Profitable Micro SaaS ideas, supportive community

  Life & fun · 2022 · microsaashq.com

• 
  America – Road Trip Simulator▲663

  APIs are a little like the open road—always waiting, full of opportunity, but hardly utilized. So here’s America, composed of several APIs that paint a vivid, real-time picture of a good old-fashioned road trip. Get local classifieds and photos. Tune into local radio stations. Talk wit other drivers. And more. Exploring the country by car was an invaluable experience for me during my time in the states. I’ve since moved to Barcelona, and find myself missing the territory. This is my attempt at recreating the magic.

  Life & fun · 2022 · 4m3ric4.com