Alternatives
Products that do what Web Ingest – Convert websites to LLM-friendly text does
I really love Git Ingest, but I needed something more general. So I built this! It crawls websites and converts each page to Markdown. It’s great for developer documentation. And it’s free. I built it over the excellent Jina Reader. I hope you get some use out of it!
- 1RH
Gitingest is a open-source micro dev-tool that I made over the last week. It turns any public Github repository into a text extract that you can give to your favourite LLM easily. Today I added this url trick to make it even easier to use! How I use it myself: - Quickly generate a README.md boilerplate for a project - Ask LLMs questions about an undocumented codebase It is still very much work in progress and I plan to add many more options (file size limits, exclude patterns..) and a public API I hope this tool can help you Your feedback is very valuable to help me prioritize And…
2024 · gitingest.com
- 2IM
My partner usually writes substack posts which I then mirror to our website’s blog section. To automate this, I made a simple tool to scrape the post and clean it so that I can drop it to our blog easily. This might be useful to others as well. Oh and ofcourse you can instruct GPT to make any final edits :D
2024 · markdowndown.vercel.app
- 3
- 4HT
Hey HN! I originally built “html-to-markdown” back in 2018 (while still in high school) to handle complex HTML conversions where other libraries struggled. Now, I’ve released v2 — a complete rewrite designed to handle even more edge cases. It supports entire websites with a high accuracy. Example use: I’ve used it in my RSS reader to strip HTML down to clean Markdown, similar to the "Reader Mode" in your Browser. It can be used as a Golang package or as an CLI. Give it a try & tell me what edge cases you encounter!
2024 · github.com
- 5
- 6TA
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io
- 7IB
Hi there, Burak here. I built an open-source data copy tool called ingestr (https://github.com/bruin-data/ingestr) I did build quite a few data warehouses both for the companies I worked at, as well as for consultancy projects. One of the more common pain points I observed was that everyone had to rebuild the same data ingestion bit over and over again, and each in different ways: - some wrote code for the ingestion from scratch to various degrees - some used off-the-shelf data ingestion tools like Fivetran / Airbyte I have always disliked both of these approaches,…
2024 · github.com
- 8
- 9GHGit Hooting▲124
00's called, they want their RSS feeds back. I was looking at my growing Github gist collection when a sudden urge to blog and make a name for myself "by not programming" struck. Part way into implementing my oh so special static website generator it occurred to me that, quite frankly, Github gists is a pretty decent publishing platform. I mean, it gives you reasonably extended markdown with previews, heck I could even write in org-mode, has comments, follower - followee relationship, extended search with filters, check out locally and push your edits. Did someone say "edit button"? Thus the…
2023 · git.ht
- 10IW
Hey HN, I made Browser-Use, an open-source tool that lets (all Langchain supported) LLMs execute tasks directly in the browser just with function calling. It allows you to build agents that interact with web elements using natural language prompts. We created a layer that simplifies website interaction for LLMs by extracting xPaths and interactive elements like buttons and input fields (and other fancy things). This enables you to design custom web automation and scraping functions without manual inspection through DevTools. Hasn't this been done a lot of times? Good question, as a general…
2024 · github.com
- 11
- 12
- 13AK
I shipped a wiki layer for AI agents that uses markdown + git as the source of truth, with a bleve (BM25) + SQLite index on top. No vector or graph db yet. It runs locally in ~/.wuphf/wiki/ and you can git clone it out if you want to take your knowledge with you. The shape is the one Karpathy has been circling for a while: an LLM-native knowledge substrate that agents both read from and write into, so context compounds across sessions rather than getting re-pasted every morning. Most implementations of that idea land on Postgres, pgvector, Neo4j, Kafka, and a dashboard. I…
Apr 2026 · github.com
- 14
- 15
- 16GC
2014 · gitprint.com
- 17CH
2024 · github.com
- 18
- 19
- 20
- 21GD
I built a tool that converts GitBook docs into LLM-friendly markdown files. Perfect for feeding technical documentation into ChatGPT, Claude, or custom LLaMA models. GitHub: https://github.com/Amal-David/gitbook-downloader Key features: Downloads complete GitBook documentation sites Converts to clean markdown format Web interface for easy URL input Works with ChatGPT, Claude, and other LLMs Preserves document structure and internal links [Still some bugs here, need to fix it] Will publish a hosted version if there is enough interest. Ideal for: Training custom LLMs with…
2024 · github.com
- 22
- 23DE
Hey! I wanted to share a tool I've been working on. It's still very early and a work in progress, but I've found it incredibly helpful when working with Claude and OpenAI's models. What it does: I created a Python script that dumps your entire Git repository into a single file. This makes it much easier to use with Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. Key Features: - Respects .gitignore patterns - Generates a tree-like directory structure - Includes file contents for all non-excluded files - Customizable file type filtering Why I find it useful for…
2024
- 24GB
I built simple Git-based CMS for Hugo static site generators. No backend, no database, no configs. Just login with Github, select your repo and start editing. If you use Hugo for blogging, feel free to check it out at https://github.com/arashthr/hugo-flow > Why did you make it? I wanted to be able to write posts on my phone, and it's not easy to do that with Markdown. Adding images is also always a headache: copy them, minimize and compress them, remember the correct syntax for images, and type the path. > How did you make it? I used Google Stitch for the design and…
May 2026 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →