I built a local data lake for AI powered data engineering and analytics
I got tired of the overhead required to run even a simple data analysis - cloud setup, ETL pipelines, orchestration, cost monitoring - so I built a fully local data-stack/IDE where I can write SQL/Py, run it, see results, and iterate quickly and interactively. You get data lake like catalog, zero-ETL, lineage, versioning, and analytics running entirely on your machine. You can import from a database, webpage, CSV, etc. and query in natural language or do your own work in SQL/Pyspark. Connect to local models like Gemma or cloud LLMs like Claude for querying and analysis. You…
I built a local data lake for AI powered data engineering and analytics launched on April 8, 2026 with 14 votes, #1,096 of 21,248 launches that month and more than 90% of that year's launches.
In plain words
This is a local data stack and IDE that runs entirely on a user's machine for data analysis and engineering. It lets users import data from databases, webpages, and CSVs, then query and analyze using SQL, Python, or natural language. The software includes data cataloging, versioning, and lineage tracking without requiring cloud setup or ETL pipeline configuration. Users can connect to local AI models like Gemma or cloud-based LLMs like Claude for querying assistance. The software is free and requires no cloud account or local LLM setup.
written from the facts on this page · September 2026
From the sources
A collaborative AI workspace, built on your company context. Build and orchestrate agents right alongside your team
JavaScript must be enabled in order to use Notion. Please enable JavaScript tofrom stream-sock-3f5.notion.site
In the maker’s words, at launch
I got tired of the overhead required to run even a simple data analysis - cloud setup, ETL pipelines, orchestration, cost monitoring - so I built a fully local data-stack/IDE where I can write SQL/Py, run it, see results, and iterate quickly and interactively. You get data lake like catalog, zero-ETL…
Does a similar job
all alternatives →
Use Claude Code to Query 600 GB Indexes over Hacker News, ArXiv, etc.Dec 2025 · exopriors.com · ▲397Paste in my prompt to Claude Code with an embedded API key for accessing my public readonly SQL+vector database, and you have a state-of-the-art research tool over Hacker News, arXiv, LessWrong, and dozens of other high-quality public commons sites. Claude whips up the monster SQL queries that safely run on my machine, to answer your most nuanced questions. There's also an Alerts functionality, where you can just ask Claude to submit a SQL query as an alert, and you'll be emailed when the ultra nuanced criteria is met (and the output changes). Like I want to know when somebody posts about…
Spice.ai – materialize, accelerate, and query SQL data from any source2024 · github.com · ▲177Hi HN, We're Luke and Phillip, and we're building Spice.ai OSS - a lightweight, portable runtime, built in Rust and powered by Apache DataFusion to locally materialize, accelerate, and query data tables sourced from any database, data warehouse or data lake. Phillip and I first introduced Spice on Show HN in September 2021. Since then, we’ve been schooled and humbled in every way building 100TB+ data and ML systems for the https://spice.ai cloud platform. Along with our customers, we struggled with getting fast, low-latency, high-concurrency SQL query within a budget, accessing and…
MovingLake AI Data Insights2023 · movinglake.com · ▲96Ask questions about your data in plain english
I scrape Steam data every month and it's yours to download for free2025 · gginsights.io · ▲161Yeah, there's AI, but I added it because I found it easier to find answers I'm looking for. For the data scientists, you can download the CSV and go crazy. Would love to know what discoveries or learnings can be found from it. To download the raw scraped data you need to become a paid member but you don't really need it unless you're wanting to finesse a table of data for a particular need. The cost is mostly just an incentive to help me pay the bills for running the website. The bunch of available CSV files contain large amounts of data which has everything from tags, genres, pricing,…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, April 2026
the whole month →
- AG
Thought the resources for GPU arch were lacking, so here we are
Life & fun · Apr 2026 · jaso1024.com
Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.
AI · Apr 2026 · github.com
I made a laptop stand out of solid concrete, in the style of brutalist architecture, with themes of urbex and urban decay
Life & fun · Apr 2026 · sam-burns.com
With social media and now AI, its important to keep the indie web alive. There are many people who write frequently. Blogosphere tries to highlight them by fetching the recent posts from personal blogs across many categories. There are two versions: Minimal (HN-inspired, fast, static): https://text.blogosphere.app/ Non-minimal: https://blogosphere.app/ If you don't find your blog (or your favorite ones), please add them. I will review and approve it.
AI · Apr 2026 · text.blogosphere.app