Dev tools · alternatives · 2026
24 alternatives to CLI for crawling documentation sites into Markdown with defuddle
docrawl is a lightweight Node.js CLI for crawling documentation sites and converting them into Markdown with defuddle. It is built for static and server-rendered docs sites such as Docusaurus, VitePress, MkDocs, GitBook exports, and Obsidian Publish. It does not run a browser and does not execute page JavaScript.
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier.
- 1
Defuddle is an open-source JS library I built to parse and extract the main content and metadata from web pages. It can also return the content as Markdown. I built Defuddle while working on Obsidian Web Clipper[1] (also MIT-licensed) because Mozilla's Readability[2] appears to be mostly abandoned, and didn't work well for many sites. It's still very much a work in progress, but I thought I'd share it today, in light of the announcement that Mozilla is shutting down Pocket. This library could be helpful to anyone building a read-it-later app. Defuddle is also available as a CLI:…
2025 · github.com · its alternatives →
- 2
- 3
Docusaurus▲547Easy to maintain open source documentation websites
2018 · docusaurus.io · its alternatives →
- 4
Docusaurus 2.0▲711Build great docs websites, focus on your content - by Meta
2022 · docusaurus.io · its alternatives →
- 5
Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
2022 · crawlee.dev · its alternatives →
- 6
Docxy▲138Build fast & beautiful documentation websites with markdown.
2020 · docxy.traction.one · its alternatives →
- 7
Hi HN, This is a TUI app which displays interactive Markdown documents. Interactive in the sense that you can scroll code fences / tables / and click links. There's a Table of Contents extracted from the MD, and a very rudimentary browser like forward + back. I'm thinking it could be the starting point for a variety of hypertext like applications in the terminal. Very much a work in progress.
2022 · github.com · its alternatives →
- 8
Docbase▲110Render your markdown documentation into beautiful sites
2016 · opensource.appbase.io · its alternatives →
- 9
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf
2018 · github.com · its alternatives →
- 10
2019 · timothycrosley.github.io · its alternatives →
- 11
Flyscrape is a command-line web scraping tool designed for those without advanced programming skills. - philippta/flyscrape
2023 · github.com · its alternatives →
- 12DS
Docup is a single JavaScript file that fetches Markdown file and renders it as a beautiful one-page documentation.
2020 · docup.now.sh · its alternatives →
- 13
A simple HTTP server rendering Markdown styled documents - lithammer/go-wiki
2015 · github.com · its alternatives →
- 14
WikiCrawl▲91Wikipedia crawler that finds how any 2 articles are related
2022 · wikicrawl.xyz · its alternatives →
- 15DG
2012 · beautifuldocs.com · its alternatives →
- 16
Doccupine▲98Open source AI-ready documentation platform.
Mar 2026 · doccupine.com · its alternatives →
- 17
- 18
DocHUB – An easy way to create dynamic project docs with Markdownfree tier, from $19/mo▲25the easy way to create dynamic project documentation with Markdown. One of many database templates from restdb.io/templates
2017 · restdb.io · its alternatives →
- 19
MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl. - RayenMlayeh/jevcrawl
9d ago · github.com · its alternatives →
- 20
A high-performance CLI to transform Markdown into premium, academic-grade PDFs via Typst. Zero configuration required. - leonardosalasd/doc-engine-cli
Jul 2026 · github.com · its alternatives →
- 21
Lightweight Markdown Documentation System. Contribute to chutsu/ditto development by creating an account on GitHub.
2014 · github.com · its alternatives →
- 22
docmd▲13Generate beautiful, light documentation sites from Markdown.
2025 · docmd.io · its alternatives →
- 23
Markdown blog with GitHub Pages. Contribute to mg0x7BE/skunk-html development by creating an account on GitHub.
2024 · github.com · its alternatives →
- 24
Hi! I just made an obsdian alternative in terminal after searching for an Obsidian like TUI and got nothing. The closest I found was Glow, but it's only a markdown reader. I wanted something more powerful for the terminal, so I built one myself.
Dec 2025 · github.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →