Alternatives
Products that do what Simple CLI to aggregate repos, papers and docs for LLM ingestion does
I created a tool that consolidates information from the following inputs: GitHub repository URL (e.g., https://github.com/jimmc414/onefilellm) arXiv abstract URL (e.g., https://arxiv.org/abs/2401.14295) Local folder path (e.g., C:\python\PipMyRide) Youtube video URL (e.g., https://www.youtube.com/watch?v=KZ_NlnmPQYk) Webpage URL (e.g., https://llm.datasette.io/en/stable/) It outputs the repo, web documentation, arXiv paper or YT transcript to a text file and the clipboard, displaying a token count. It also…
- 1ML
2025 · simonwillison.net
- 2RH
Gitingest is a open-source micro dev-tool that I made over the last week. It turns any public Github repository into a text extract that you can give to your favourite LLM easily. Today I added this url trick to make it even easier to use! How I use it myself: - Quickly generate a README.md boilerplate for a project - Ask LLMs questions about an undocumented codebase It is still very much work in progress and I plan to add many more options (file size limits, exclude patterns..) and a public API I hope this tool can help you Your feedback is very valuable to help me prioritize And…
2024 · gitingest.com
- 3TA
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io
- 4WS
I’ve been in the MLOps space for ~10 years, and data is still the hardest unsolved open problem. Code is versioned using Git, data is stored somewhere else, and context often lives in a 3rd location like Slack or GDocs. This is why we built XetHub, a platform that enables teams to treat data like code, using Git. Unlike Git LFS, we don’t just store the files. We use content-defined chunking and Merkle Trees to dedupe against everything in history. This allows small changes in large files to be stored compactly. Read more here:…
2022 · xethub.com
- 5RC
Hey HN, I wanted to share a simple command line tool I made that has sped up and simplified my LLM assisted coding workflow. Whenever possible, I’ve been trying to use Claude as a first pass when implementing new features / changes. But I found that depending on the type of change I was making, I was spending a lot of thought finding and deciding which source files should be included in the prompt. The need to copy/paste each file individually also becomes a mild annoyance. First, I implemented `repogather --all` , which unintelligently copies all sources files in your repository…
2024 · github.com
- 6DE
Hey! I wanted to share a tool I've been working on. It's still very early and a work in progress, but I've found it incredibly helpful when working with Claude and OpenAI's models. What it does: I created a Python script that dumps your entire Git repository into a single file. This makes it much easier to use with Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. Key Features: - Respects .gitignore patterns - Generates a tree-like directory structure - Includes file contents for all non-excluded files - Customizable file type filtering Why I find it useful for…
2024
- 7
RAG-ready web scraping that cuts your LLM token costs
Apr 2026 · geekflare.com
- 8
- 9BA
Bash4LLM is a single-file Bash wrapper for interacting with LLMs from the terminal. I created it because I wanted something simple that worked without installing Python, Node, or any other runtime. It uses only Bash, curl, and jq. You can send prompts, start a small chat, process files line by line, stream output, and save session metadata in JSON format. I tried to make it safe and predictable: no use of the system /tmp, no use of eval. Groq is supported by default, and other providers can be added with dedicated Bash scripts in the extras/providers/ folder. Example: echo…
Jun 2026 · github.com
- 10IM
Live demo here: http://fonctionlabs.com:8000 Similarly to aka_sh (guess we were working parallelly on similar topics), I created with my brother a chainlit-based webapp, which summarizes Youtube videos in order to gain time. It works as an RAG-based LLM, and is very light in the sense that it does not use RAG libraries like langchain or llamaindex. You can use it with your own OpenAI API key. It also supports local models like Mistral, or Llamma. It is ofc open-source, and you can deploy with Docker if you choose. Some of the next steps are: - using whisper to be able to compute a…
2024 · github.com
- 11AArXivTok▲105
I made this, and it's fully open source so if someone wants to contribute here you have the url: https://github.com/Miguel07Alm/arxivtok. For this project I was inspired by https://wikitok.vercel.app.
2025 · arxivtok.vercel.app
- 12LT
Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.
2024 · github.com
- 13AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com
- 14IJ
Hi HackerNews, Lately, I have seen an explosion in posts offering paid APIs/services to get unstructured data into LLMs (i.e. langchain extract, ragflow, unstructured, unstract, just to name a few) and I have been largely disappointed by them, either because they fail to implement multimodal support, fail to give good context for "really tricky" PDFs / Word docs / Powerpoints, or are just plain difficult to use. In light of all these posts I figured I'd share my solution that has been working smoothly for me and my clients. I put it up on GitHub for free so you can check it…
2024 · github.com
- 15AN
When building workflows that rely on LLMs, we commonly use structured output for programmatic use cases like converting an invoice into rows or meeting transcripts into tickets or even complex PDFs into database entries. The model may return the schema you want, but with hallucinated values like `invoice_date` being off by 2 months or the transcript array ordered wrongly. The JSON is valid, but the values are not. Structured output today is a big part of using LLMs, especially when building deterministic workflows. Current structured output benchmarks (e.g., JSONSchemaBench) only validate…
Apr 2026 · interfaze.ai
- 16LA
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com
- 17TC
Hi HN, I built a CLI for uploading documents and querying them with an LLM agent that uses search tools rather than stuffing everything into the context window. I recorded a demo using the CrossFit 2025 rulebook that shows how this approach compares to traditional RAG and direct context injection[1]. The core insight is that LLMs running in loops with tool access are unreasonably effective at this kind of knowledge retrieval task[2]. Instead of hoping the right chunks make it into your context, the agent can iteratively search, refine queries, and reason about what it finds. The CLI handles…
2025 · github.com
- 18AL
Hey HN! After struggling with complex prompt engineering and unreliable parsing, we built L1M, a simple API that lets you extract structured data from unstructured text and images. curl -X POST https://api.l1m.io/structured \ -H "Content-Type: application/json" \ -H "X-Provider-Url: demo" \ -H "X-Provider-Key: demo" \ -H "X-Provider-Model: demo" \ -d '{ "input": "A particularly severe crisis in 1907 led Congress to enact the Federal Reserve Act in 1913", "schema": { "type": "object", "properties": { "items": { "type": "array", "items": { "type": "object", "properties": {…
2025 · l1m.io
- 19IB
Apr 2026 · github.com
- 20UE
I've created uithub, a tool that allows developers to easily get LLM context for their coding questions and perform AI repo analysis at scale. Here's what it does: - Get Context: Simply change the 'g' in github.com to 'u' to access AI-powered insights on any GitHub repo. - Flexible Querying: Fetch entire repos, specific branches/subfolders, or filter by file type and size. - API for Developers: Power the next generation of development tools with our API. Key features: - Customizable token limits - File type filtering - Multiple response formats - Size-based file exclusion I built this…
2024 · uithub.com
- 21LD
I was inspired by a recent tweet by Andrej Karpathy, as well as my own experience copying and pasting a bunch of html docs into Claude yesterday and bemoaning how long-winded and poorly formatted it was. I’m trying to decide if I should make it into a full-fledged service and completely automate the process of generating the distilled documentation. Problem is that it would cost a lot in API tokens and wouldn’t generate any revenue (plus it would have to be updated as documentation changes significantly). Maybe Anthropic wants to fund it as a public good? Let me know!
2025 · github.com
- 22RS
Terminal tool to search arXiv papers and render them as beautiful HTML for humans and LLMs
Oct 2025 · github.com
- 23GP
When working on data science projects I often want to just save my work, without having to think deeply about what’s changed. I found the intentionality of Git to feel like friction in these times, and I built GitEase to simplify my workflow. Instead of having to think about add/commit/push/pull with GitEase I just think about `ge load, ge save, ge share, ge undo`. And for even less thinking, I use an LLM (text-da-vinci-003) to generate commit messages by summarizing the diff. Take a look, try it out, and I’d welcome any contributions & feedback. pip install gitease $ ge —help…
2023 · medium.com
- 24EG
A neat (in my opinion) little side-project I've been working on, both to get somewhat basic React skills going, and to work with LLMs on even more cool projects to build. It should work for most major languages and output English summaries (or French summaries, if using the main https://enfinbref.io page instead of the /en/ subpage), no matter the input language. Currently planning on expanding in various directions, including some nice new features like choosing a summary type, better video type identification and LLM routing, and bullet points exec summaries. Pretty…
2023 · enfinbref.io
Ranked by how close each launch is in meaning, then by votes. Refine with a description →