VDP – open-source unstructured visual data ETL
Hi HN - We're Ping-Lin and Xiaofei from Instill AI (https://www.instill.tech). We're building VDP (https://github.com/instill-ai/vdp), an open-source ETL tool for unstructured visual data. When people say they are data-driven, most of the time it means they are driven by structured data. I will cut the part where we cite reports claiming that 80% of data are unstructured. The reality is unstructured data are more difficult to analyse and not a lot of companies know or have the resources to deal with them. Before starting Instill AI, we were in a smart video…
VDP – open-source unstructured visual data ETL launched on August 22, 2022 with 11 votes, #938 of 3,307 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 4 years on.
In plain words
VDP is an open-source ETL tool designed to process unstructured visual data, helping companies that lack resources or expertise to handle image and video analysis at scale. Built by Instill AI, it addresses the challenge that while most enterprise data is unstructured, few organizations have the tools or knowledge to work with it effectively. The tool draws on the creators' experience building production-grade vision AI systems for video processing.
written from the facts on this page · September 2026
From the sources
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications - instill-ai/instill-core
In the maker’s words, at launch
Hi HN - We're Ping-Lin and Xiaofei from Instill AI (https://www.instill.tech). We're building VDP (https://github.com/instill-ai/vdp), an open-source ETL tool for unstructured visual data. When people say they are data-driven, most of the time it means they are driven by structured data.…
Does a similar job
all alternatives →
I Made an Open Source Platform for Structuring Any Unstructured Data2024 · github.com · ▲88Hey HN, I'm Adithya, a 20-year-old dev from India. I have been working with GenAI for the past year, and I've found it really painful to deal with the many different forms of data out there and get the best representation of it for my AI applications. That's why I built OmniParse—an open-source platform designed to handle any unstructured data and transform it into optimized, structured representations. Key Features: - Completely local processing—no external APIs - Supports ~20 file types - Converts documents, multimedia, and web pages to high-quality structured markdown - Table extraction,…
onprem unstructured data extraction with 4 lines of code2025 · github.com · ▲8The traditional pipeline for unstructured data extraction typically follows these steps: 1. Image → OCR Model (e.g., Google Vision) → Layout Model (e.g. Surya) → LLM → Final Answer However, this can be streamlined using a Vision-Language Model (VLM): 2. Image → VLM → Final Answer Recently VLMs have improved a lot for OCR and document understanding tasks, specifically the Qwen-2.5-VL series. We can run the Qwen-2.5-VL-7B-AWQ model locally with just 16GB VRAM, and perform end-to-end information extraction (fields and table extraction) without any external models. Hallucination with VLMs One…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, August 2022
the whole month →
DhiWise 2.0▲740Convert Figma designs into Flutter 3.0 & React code rapidly
Dev tools · 2022 · dhiwise.com
- PA
Hey HN, I've been working on https://pornpen.ai, a site for generating adult images. Please only visit the site if you are 18+ and willing to look at NSFW images. This site is an experiment using newer text-to-image models. I explicitly removed the ability to specify custom text to avoid harmful imagery from being generated. New tags will be added once the prompt-engineering algorithm is fine-tuned further. If the servers are overloaded, take a look at the feed and search pages to look through past results. For comments/suggestions/feedback please visit…
AI · 2022 · pornpen.ai