OCR pipeline for ML training (tables, diagrams, math, multilingual)
Hi HN, I’ve been working on an OCR pipeline specifically optimized for machine learning dataset preparation. It’s designed to process complex academic materials — including math formulas, tables, figures, and multilingual text — and output clean, structured formats like JSON and Markdown. Some features: • Multi-stage OCR combining DocLayout-YOLO, Google Vision, MathPix, and Gemini Pro Vision • Extracts and understands diagrams, tables, LaTeX-style math, and multilingual text (Japanese/Korean/English) • Highly tuned for ML training pipelines, including dataset generation and…
OCR pipeline for ML training (tables, diagrams, math, multilingual) launched on April 5, 2025 with 170 votes, #234 of 7,818 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
OCR Pipeline for ML Training is a tool that extracts text, tables, diagrams, and mathematical formulas from academic documents and converts them into structured formats like JSON and Markdown. It uses multiple OCR engines including DocLayout-YOLO, Google Vision, MathPix, and Gemini Pro Vision to handle complex content across multiple languages including Japanese, Korean, and English. The tool is designed for researchers and machine learning practitioners who need to prepare datasets from academic materials for training, fine-tuning, or retrieval-augmented generation systems.
written from the facts on this page · September 2026
From the sources
Multi-modal OCR pipeline optimized for ML training (text, figure, math, tables, diagrams) - raphael-seo/Versatile-OCR-Program
The project has been refactored into a modular, config-driven architecture. Get started: Older versions (v1.0, v2.0) are preserved under legacy/ for reference but not maintained. This OCR project is just the beginning. In less than 1 month , a powerful new system will be released: A customizable AI pipeline with memory — tailored to your field. Whether you're a student , researcher , or developer , you’ll be able to build your own smart, memory-enhanced AI — without needing deep AI knowledge. First of all, thank you so much for your interest in this project. I had originally planned to release the first version of the AI pipeline before June. But to be honest, I've been juggling a major…from github.com
In the maker’s words, at launch
Hi HN, I’ve been working on an OCR pipeline specifically optimized for machine learning dataset preparation. It’s designed to process complex academic materials — including math formulas, tables, figures, and multilingual text — and output clean, structured formats like JSON and Markdown. Some features: • Multi-stage…
Does a similar job
all alternatives →
OCR Arena – A playground for OCR modelsNov 2025 · ocrarena.ai · ▲216I built OCR Arena as a free playground for the community to compare leading foundation VLMs and open-source OCR models side-by-side. Upload any doc, measure accuracy, and (optionally) vote for the models on a public leaderboard. It currently has Gemini 3, dots.ocr, DeepSeek, GPT5, olmOCR 2, Qwen, and a few others. If there's any others you'd like included, let me know!
Zerox – Document OCR with GPT-mini2024 · github.com · ▲246This started out as a weekend hack with gpt-4-mini, using the very basic strategy of "just ask the ai to ocr the document". But this turned out to be better performing than our current implementation of Unstructured/Textract. At pretty much the same cost. I've tested almost every variant of document OCR over the past year, especially trying things like table / chart extraction. I've found the rules based extraction has always been lacking. Documents are meant to be a visual representation after all. With weird layouts, tables, charts, etc. Using a vision model just make sense! In…
Keras-OCR is an end-to-end, trainable OCR pipeline2019 · github.com · ▲11A packaged and flexible version of the CRAFT text detector and Keras CRNN recognition model. - faustomorales/keras-ocr
An annotation tool for ML and NLP2021 · getmarkup.com · ▲76The easy way to turn text into structure data
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, April 2025
the whole month →
Hi everyone, I built PyXL — a hardware processor that executes a custom assembly generated from Python programs, without using a traditional interpreter or virtual machine. It compiles Python -> CPython Bytecode -> Instruction set designed for direct hardware execution. I’m sharing an early benchmark: a GPIO test where PyXL achieves a 480ns round-trip toggle — compared to 14-25 micro seconds on a MicroPython Pyboard - even though PyXL runs at a lower clock (100MHz vs. 168MHz). The design is stack-based, fully pipelined, and preserves Python's dynamic typing without static type restrictions.…
Dev tools · 2025 · runpyxl.com
The Unsure Calculator is an online tool that lets you calculate with numbers you’re not sure about.
Life & fun · 2025 · filiph.github.io
https://the-pocket.github.io/Tutorial-Codebase-Knowledge/
AI · 2025 · github.com
