nowfound

AI · October 25, 2024

DA

Doctly AI – Accurate AI-Powered PDF to Markdown Parser

I’m one of the co-founders of Doctly AI. I wanted to share our story. We didn’t originally set out to build a PDF-to-Markdown parser. It all started when we were building a RAG solution for a company that deals with regulatory agencies. All of their data was in PDFs, and as it is apparently with lawyers, they like to print and scan documents to make it hard on their counterparts. These documents contained complex tables that barely make sense, are rotated, and handwriting is mixed in between. Many pages are number ruled and potentially rotated. We spent a lot of time trying to get clean data…

What it does

In the maker’s words, at launch

I’m one of the co-founders of Doctly AI. I wanted to share our story. We didn’t originally set out to build a PDF-to-Markdown parser. It all started when we were building a RAG solution for a company that deals with regulatory agencies. All of their data was in PDFs, and as it is apparently with lawyers, they like to print and scan documents to make it hard on their counterparts. These documents contained complex tables that barely make sense, are rotated, and handwriting is mixed in between. Many pages are number ruled and potentially rotated. We spent a lot of time trying to get clean data from the PDFs. Most OCR tools spit out garbage among the output and also can lose formatting and document hierarchy. We also wanted to reference the original documents within the RAG output, creating additional challenges. The existing solutions we looked at were unable to give us the quality we were looking for. Garbage in/garbage out. “Let’s just write our own. How hard could this be?” - we thought. Well it is definitely a difficult problem. AI vision models can do pretty well, but different ones excel at different things. From language support to table and chart conversion. Also cost becomes an issue. We settled on an “agentic” approach where we detect features/layout within the document and route them to different models and in some cases traditional OCR, achieving very high quality conversions, while keeping the costs at bay. After comparing our solution with existing solutions and APIs, we easily beat them on the quality of their ‘high-res’ offerings while matching or beating their ‘low-res’ costs. We still have work to do of course, we believe we can increase the quality and reduce the costs by a lot, but you have to start somewhere. We’re offering free credits so you can try it out for yourself! Check us out at Doctly.ai, No credit card required. Let us know how it helps with your document processing! Let me know if you need more credits for testing it out. Would love to hear your feedback, and leads are always appreciated :) You can reach me at ali at doctly.ai

Does the same job

all alternatives →

More ai this month

the category →
  • I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 17d ago · simedw.com

  • Astute585

    Automate your B2B brand going viral, with new media creators

    AI · 18d ago · company-app.joinastute.com

  • Grok Bot547

    AI teammates that you can give real work to

    AI · 25d ago · x.ai

  • Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 26d ago · cactuscompute.com

  • Make your software self-driving

    AI · 30d ago · coldtea.ai

  • Soloop472

    Approval-first Agent OS for solo founders

    AI · 30d ago · soloop.io

Launched alongside, October 2024

the whole month →
  • buzzabout1,267

    Audience insights from 1B+ online discussions in 2 mins

    AI · 2024 · buzzabout.ai

  • bolt.new1,233

    Prompt, run, edit & deploy full-stack web apps

    AI · 2024 · bolt.new

  • Feta1,217

    Run smarter stand-ups, build better products

    AI · 2024 · feta.io

  • Trag955

    AI code review companion

    AI · 2024 · usetrag.com

  • Turn Notion databases into portals & apps with no code

    Dev tools · 2024 · softr.io

  • One inbox for all your work discussions

    Work · 2024 · generalcollaboration.com