VectorFlow – Open-Source Vector Embedding Pipeline
Hey HN We've just released the initial version of our open-source vector embedding pipeline. It's designed to embed large volumes of data. While embedding a few documents for Q&A is straightforward, consistently ingesting gigabytes of unstructured data is a whole different ballgame. By using our API, you can embed raw data and store vectors in your vector database, sidestepping the complexities of cloud infrastructure. Now, in true YC spirit, we're launching before everything is polished. Our Github repo (https://github.com/dgarnitz/vectorflow ) is a work in progress, and…
In plain words
VectorFlow is an open-source pipeline for embedding large volumes of unstructured data into vectors. It handles the complexity of ingesting gigabytes of raw data and storing the resulting vectors in vector databases, eliminating the need to manage cloud infrastructure directly. The tool is designed for developers and data teams working with large-scale embedding projects who need a simpler alternative to manual cloud setup and management.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hey HN We've just released the initial version of our open-source vector embedding pipeline. It's designed to embed large volumes of data. While embedding a few documents for Q&A is straightforward, consistently ingesting gigabytes of unstructured data is a whole different ballgame. By using our API, you can embed raw data and store vectors in your vector database, sidestepping the complexities of cloud infrastructure. Now, in true YC spirit, we're launching before everything is polished. Our Github repo (https://github.com/dgarnitz/vectorflow ) is a work in progress, and we're eager to get it in front of the community early on. Check out our Github repo and let us know what you think. Your feedback, suggestions, and critiques will be highly appreciated as we continue to refine and develop.
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, August 2023
the whole month →
Lottielab▲871Create and ship lottie animations to sites and apps faster
Dev tools · 2023 · lottielab.com
- LC
Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…
AI · 2023 · github.com