CocoIndex – Open-Source Data framework for AI, built for data freshness
Hi HN, I’ve been working on CocoIndex, an open-source Data ETL framework to transform data for AI, optimized for data freshness. You can start a CocoIndex project with `pip install cocoindex` and declare a data flow that can build ETL like LEGO - build a RAG pipeline for vector embeddings, knowledge graphs, or extract, transform data with LLMs. It is a data processing framework beyond text. When you run the data flow either with live mode or batch mode, it will process the data incrementally with minimal recomputation and make it super fast to update the target stores on source changes. Get…
CocoIndex – Open-Source Data framework for AI, built for data freshness launched on April 23, 2025 with 14 votes, #1,902 of 7,818 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
CocoIndex is an open-source data ETL framework designed to transform and prepare data for AI applications with a focus on keeping data fresh. Built with a modular approach similar to LEGO blocks, it enables users to construct data pipelines for RAG systems, vector embeddings, knowledge graphs, and data extraction or transformation using LLMs. The framework processes data incrementally in both live and batch modes, minimizing redundant computation and enabling fast updates to target stores when source data changes. It handles multiple data types beyond text.
written from the facts on this page · September 2026
From the sources
Incremental engine for long horizon agents 🌟 Star if you like it! - cocoindex-io/cocoindex
In the maker’s words, at launch
Hi HN, I’ve been working on CocoIndex, an open-source Data ETL framework to transform data for AI, optimized for data freshness. You can start a CocoIndex project with `pip install cocoindex` and declare a data flow that can build ETL like LEGO - build a RAG pipeline for vector embeddings, knowledge graphs, or…
Does a similar job
all alternatives →
Open-Source Codebase Index with Tree-sitter2025 · cocoindex.io · ▲6Hi HN, I made a data lineage tool for AI data pipeline, as a companion to open source ETL framework cocoindex. After months in private beta (and lots of love from early users), we’re excited to officially launch it today. It offers: - Before/after of the data are available at every transformation node - Every output field can be traced back to the exact set of input fields and operations that created it - Lineage is first-class - Zero pipeline data retention, connecting seamlessly to on-prem CocoIndex server This tool is free, and you can get start by running cocoindex server -ci…
LiquidIndex 2.02025 · liquidindex.dev · ▲134I'm building LiquidIndex, an RAG API service that makes it easy to add personalized context to AI apps. Instead of building a whole system to upload, process, and search through a user’s files or notes, you just call a few APIs. It handles the hard parts - like connecting to Notion or Google Drive, breaking the data into usable pieces, and making it searchable. Then, when you want to answer a question using that data, you just query it, and it gives you the most relevant results - optionally with an LLM-generated answer. No pipelines, no infrastructure, no headaches. Here are the core APIs:…
Data Engineering Book – An open source, community-driven guideFeb 2026 · github.com · ▲251Hi HN! I'm currently a Master's student at USTC (University of Science and Technology of China). I've been diving deep into Data Engineering, especially in the context of Large Language Models (LLMs). The Problem: I found that learning resources for modern data engineering are often fragmented and scattered across hundreds of medium articles or disjointed tutorials. It's hard to piece everything together into a coherent system. The Solution: I decided to open-source my learning notes and build them into a structured book. My goal is to help developers fast-track their learning curve. Key…
I built an open-source data pipeline tool in Go2024 · github.com · ▲200Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…
- AAArc, an open-source Databricks alternative2021 · arc.tripl.ai · ▲175
Find information, resources and relevant links for tripl.ai. This domain may be for sale.
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, April 2025
the whole month →
Hi everyone, I built PyXL — a hardware processor that executes a custom assembly generated from Python programs, without using a traditional interpreter or virtual machine. It compiles Python -> CPython Bytecode -> Instruction set designed for direct hardware execution. I’m sharing an early benchmark: a GPIO test where PyXL achieves a 480ns round-trip toggle — compared to 14-25 micro seconds on a MicroPython Pyboard - even though PyXL runs at a lower clock (100MHz vs. 168MHz). The design is stack-based, fully pipelined, and preserves Python's dynamic typing without static type restrictions.…
Dev tools · 2025 · runpyxl.com
The Unsure Calculator is an online tool that lets you calculate with numbers you’re not sure about.
Life & fun · 2025 · filiph.github.io
https://the-pocket.github.io/Tutorial-Codebase-Knowledge/
AI · 2025 · github.com
