DocIngest – Download and save documentation from any URL
Have been getting tired of having wrong version api docs for building anything with LLMs, just wanted to curate all latest api docs in a single place and also let it be discoverable for others. It is integrated with firecrawl to pull any website data and make it available as md(markdown) file, yet to add bells and whistles or even guardrails to it. But hope you folks find it useful. I had previously built https://github.com/Amal-David/gitbook-downloader but whenever i tried to extend to other docs format, had to write a lot of code so just went with firecrawl for now.…
What it does
In the maker’s words, at launch
Have been getting tired of having wrong version api docs for building anything with LLMs, just wanted to curate all latest api docs in a single place and also let it be discoverable for others. It is integrated with firecrawl to pull any website data and make it available as md(markdown) file, yet to add bells and whistles or even guardrails to it. But hope you folks find it useful. I had previously built https://github.com/Amal-David/gitbook-downloader but whenever i tried to extend to other docs format, had to write a lot of code so just went with firecrawl for now. Stumbled upon gitingest and loved their UI so took that as a reference and built the platform. Some limits of 250 pages max and some sites not fully supported. Feel free to give any specific feedback, will try to progressively iterate on them.
Does the same job
all alternatives →- GDGitBook Documentation Downloader for LLMs2024 · github.com · ▲7
I built a tool that converts GitBook docs into LLM-friendly markdown files. Perfect for feeding technical documentation into ChatGPT, Claude, or custom LLaMA models. GitHub: https://github.com/Amal-David/gitbook-downloader Key features: Downloads complete GitBook documentation sites Converts to clean markdown format Web interface for easy URL input Works with ChatGPT, Claude, and other LLMs Preserves document structure and internal links [Still some bugs here, need to fix it] Will publish a hosted version if there is enough interest. Ideal for: Training custom LLMs with…
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
