Built a tool solve the nightmare of chunking tables in PDF vs. Markdown
Hey HN, solo dev here. After years of frustration with how LLMs handle complex documents, especially PDFs with tables, I decided to build a solution myself. My approach uses a Markdown conversion step to preserve the table structure, which seems to work surprisingly well for chunking. This little parser is the first public piece of a much larger, privacy-focused AI platform I'm building. I'm pretty much running on fumes financially, so any feedback, critique, or support is massively appreciated. Happy to answer any questions about the approach!
Built a tool solve the nightmare of chunking tables in PDF vs. Markdown launched on November 23, 2025 with 15 votes, #727 of 9,795 launches that month and more than 75% of that year's launches.
In plain words
This tool helps developers chunk PDF documents while preserving table structure, a common problem when processing complex files with language models. It converts PDFs to Markdown format to maintain table integrity during the chunking process. Built by a solo developer, it serves as the first public component of a larger privacy-focused AI platform. The tool is available on GitHub and designed for those working with document processing and LLM workflows.
written from the facts on this page · September 2026
From the sources
Stop using static chunk sizes. A lightweight, production-ready RAG ingestion toolkit. Uses Docling for layout-aware parsing and applies smart heuristics for optimal chunking (PDF vs Code vs MD). Extracted from a production RAG platform - 2dogsandanerd/smart-ingest-kit
It has come to my attention that the GitHub user @tfantas (Thiago Antas) and his automated account @jarvis-aix are falsely claiming credit for my architecture. They have explicitly listed my original repositories (including RAG_enterprise_core, smart-ingest-kit, DAUT, etc.) as their own '🔬 Featured Work' on their public profile without authorization or proper attribution. Below is the documented proof. https://github.com/tfantas seems to have 20+ years of expirience but no own ideas .... Im gonna make him famous...... If you enjoyed my repos and found them useful, Im sorry but im out of this game !!! No more opensource Sorry Im sure you will find my further developed Repos at…from github.com
Does a similar job
all alternatives →
Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
PDF to MD by LLMs – Extract Text/Tables/Image Descriptives by GPT4o2024 · github.com · ▲191I've developed a Python API service that uses GPT-4o for OCR on PDFs. It features parallel processing and batch handling for improved performance. Not only does it convert PDF to markdown, but it also describes the images within the PDF using captions like `[Image: This picture shows 4 people waving]`. In testing with NASA's Apollo 17 flight documents, it successfully converted complex, multi-oriented pages into well-structured Markdown. The project is open-source and available on GitHub. Feedback is welcome.
PDF Dino2025 · pdfdino.com · ▲155Extract structured tables from messy PDFs using AI. Export to Excel, CSV, or JSON. Try 20 pages free—no credit card needed.
ChunkHound, a local-first tool for understanding large codebasesJan 2026 · github.com · ▲114ChunkHound’s goal is simple: local-first codebase intelligence that helps you pull deep, core-dev-level insights on demand, generate always-up-to-date docs, and scale from small repos to enterprise monorepos — while staying free + open source and provider-agnostic (VoyageAI / OpenAI / Qwen3, Anthropic / OpenAI / Gemini / Grok, and more). I’d love your feedback — and if you have, thank you for being part of the journey!
Markdown Converter 2025 · markdownconverters.com · ▲12Hey HN I built MarkdownConverters.com — a tool that converts any file format (PDF, DOCX, PPTX, HTML, or URL) into clean, structured Markdown. I often needed to prep documents, reports, or scraped pages for AI pipelines, documentation, or version control, but existing tools either broke formatting, lost code blocks, or produced unreadable Markdown. So I built something that focuses on: • Accurate structure (headings, lists, tables, code, links) • Consistent Markdown output ready for LLMs or docs • Fast, browser-based conversion with privacy-friendly processing • Support for multi-format and…
- DADoctly AI – Accurate AI-Powered PDF to Markdown Parser2024 · ▲7
I’m one of the co-founders of Doctly AI. I wanted to share our story. We didn’t originally set out to build a PDF-to-Markdown parser. It all started when we were building a RAG solution for a company that deals with regulatory agencies. All of their data was in PDFs, and as it is apparently with lawyers, they like to print and scan documents to make it hard on their counterparts. These documents contained complex tables that barely make sense, are rotated, and handwriting is mixed in between. Many pages are number ruled and potentially rotated. We spent a lot of time trying to get clean data…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗
Launched alongside, November 2025
the whole month →
Guideflow▲1,338Create interactive product demos and step-by-step guides in seconds with Guideflow, the leading AI-powered demo automation tool.
AI · Nov 2025 · guideflow.com
Hardware and software projects by Ali Roberts
Life & fun · Nov 2025 · bitsnpieces.dev
Welltory▲1,028Measure your wellness. Use data to feel great every day.
Work · Nov 2025 · welltory.com
TrustMRR▲833LLM Gateway is a b2b artificial intelligence based in United States, founded in 2025. $259,539/month in verified Stripe revenue. $78,764 MRR. Ahrefs Domain Rating 52/100. growing 55% month-over-month. Track LLM Gateway's verified metrics on TrustMRR.
Growth · Nov 2025 · trustmrr.com
Boing▲782Life & fun · Nov 2025 · boing.greg.technology