Open-Source Codebase Index with Tree-sitter
Hi HN, I made a data lineage tool for AI data pipeline, as a companion to open source ETL framework cocoindex. After months in private beta (and lots of love from early users), we’re excited to officially launch it today. It offers: - Before/after of the data are available at every transformation node - Every output field can be traced back to the exact set of input fields and operations that created it - Lineage is first-class - Zero pipeline data retention, connecting seamlessly to on-prem CocoIndex server This tool is free, and you can get start by running cocoindex server -ci…
Open-Source Codebase Index with Tree-sitter launched on March 28, 2025 with 6 votes and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
What it does
Indexing codebase for RAG with CocoIndex and Tree-sitter in real-time: chunking, embedding, semantic search, and build vector index for efficient retrieval.
A newer version of this guide is available: Index Your Codebase for AI Agents with CocoIndex V1 . This page stays up for anyone still using it, but new readers should start there. Indexing codebase for RAG with CocoIndex and Tree-sitter in real-time: chunking, embedding, semantic search, and build vector index for efficient retrieval. In this blog, we will show you how to index a codebase for RAG with CocoIndex . CocoIndex provides built-in support for codebase chunking, with native Tree-sitter support and real-time update. Because we use incremental processing (only reprocessing what has changed) under the hood, the index is updated in near real-time. It can be real-time if we integrate…from cocoindex.io
In the maker’s words, at launch
Hi HN, I made a data lineage tool for AI data pipeline, as a companion to open source ETL framework cocoindex. After months in private beta (and lots of love from early users), we’re excited to officially launch it today. It offers: - Before/after of the data are available at every transformation node - Every…
Does a similar job
all alternatives →
CocoIndex – Open-Source Data framework for AI, built for data freshness2025 · github.com · ▲14Hi HN, I’ve been working on CocoIndex, an open-source Data ETL framework to transform data for AI, optimized for data freshness. You can start a CocoIndex project with `pip install cocoindex` and declare a data flow that can build ETL like LEGO - build a RAG pipeline for vector embeddings, knowledge graphs, or extract, transform data with LLMs. It is a data processing framework beyond text. When you run the data flow either with live mode or batch mode, it will process the data incrementally with minimal recomputation and make it super fast to update the target stores on source changes. Get…
I ported Tree-sitter to GoFeb 2026 · github.com · ▲222This started as a hard requirement for my TUI-based editor application, it ended up going in a few different directions. A suite of tools that help with semantic code entities: https://github.com/odvcencio/gts-suite A next-gen version control system called Got: https://github.com/odvcencio/got I think this has some pretty big potential! I think there's many classes of application (particularly legacy architecture) that can benefit from these kinds of analysis tooling. My next post will be about composing all these together, an exciting project I call…
Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
CodeRLM – Tree-sitter-backed code indexing for LLM agentsFeb 2026 · github.com · ▲81I've been building a tool that changes how LLM coding agents explore codebases, and I wanted to share it along with some early observations. Typically claude code globs directories, greps for patterns, and reads files with minimal guidance. It works in kind of the same way you'd learn to navigate a city by walking every street. You'll eventually build a mental map, but claude never does - at least not any that persists across different contexts. The Recursive Language Models paper from Zhang, Kraska, and Khattab at MIT CSAIL introduced a cleaner framing. Instead of cramming everything into…
HelixDB – Open-source vector-graph database for AI applications (Rust)2025 · github.com · ▲237Hey HN, we want to share HelixDB (https://github.com/HelixDB/helix-db/), a project a college friend and I are working on. It’s a new database that natively intertwines graph and vector types, without sacrificing performance. It’s written in Rust and our initial focus is on supporting RAG. Here’s a video runthrough: https://screen.studio/share/szgQu3yq. Why a hybrid? Vector databases are useful for similarity queries, while graph databases are useful for relationship queries. Each stores data in a way that’s best for its main type of query (e.g.…
- AGA GPU-accelerated binary vector index2025 · rlafuente.com · ▲65
This is a vector index I built that supports insertion and k-nearest neighbors (k-NN) querying, optimized for GPUs. It operates entirely in CUDA and can process queries on half a billion vectors in under 200 milliseconds. The codebase is structured as a standalone library with an HTTP API for remote access. It’s intended for high-performance search tasks—think similarity search, AI model retrieval, or reinforcement learning replay buffers. The codebase is located at https://github.com/rodlaf/BinaryGPUIndex.
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, March 2025
the whole month →
Mimic Human Research & Save Findings in AI Knowledge Base
AI · 2025 · sider.ai
