AI · alternatives · 2026
24 alternatives to app for interaction with documents using local LLM (mini Chat With RTX)
Hello HN! I wanted to share a side project of mine: a fully standalone app that uses a local LLM (specifically Mistral 7B) for document interaction using RAG. It supports a wide variety of document types and is designed to run right after installation. There are still quite a few bugs to iron out and many features I'm excited to add. Considering this is my first time working on such a project, I'm really happy with the progress and am learning a ton! The project is open source, so I please feel free to check out my work and leave any feedback :)
Mini Chat With RTX is a standalone application that lets users interact with documents using a local large language model (Mistral 7B) through retrieval-augmented generation. It supports multiple document types and… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. app for interaction with documents using local LLM (mini Chat With RTX) launched in 2024; newer entries below may have overtaken it.
- 1
I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…
2024 · github.com · its alternatives →
- 2
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 3IB
We show the potential of modern, embedded graph databases in the browser by demonstrating a fully in-browser chatbot that can perform Graph RAG using Kuzu (the graph database we're building) and WebLLM, a popular in-browser inference engine for LLMs. The post retrieves from the graph via a Text-to-Cypher pipeline that translates a user question into a Cypher query, and the LLM uses the retrieved results to synthesize a response. As LLMs get better, and WebGPU and Wasm64 become more widely adopted, we expect to be able to do more and more in the browser in combination with LLMs, so a lot of…
2025 · blog.kuzudb.com · its alternatives →
- 4
Hey HN, I made Browser-Use, an open-source tool that lets (all Langchain supported) LLMs execute tasks directly in the browser just with function calling. It allows you to build agents that interact with web elements using natural language prompts. We created a layer that simplifies website interaction for LLMs by extracting xPaths and interactive elements like buttons and input fields (and other fancy things). This enables you to design custom web automation and scraping functions without manual inspection through DevTools. Hasn't this been done a lot of times? Good question, as a general…
2024 · github.com · its alternatives →
- 5
Dabarqus▲92Add PDF chat to your LLM app in less than 9 lines of code
2024 · dabarqus.com · its alternatives →
- 6
Hello HN, Talk2Arxiv is a small open-source RAG application I've been building for a few weeks. To use it just prepend any arxiv.org link with 'talk2' to load the paper into a responsive RAG chat application (e.g. www.arxiv.org/abs/1706.03762 -> www.talk2arxiv.org/abs/1706.03762). All implementation details are in the GitHub. Currently, because I've opted to extract text from the PDF of the paper rather than reading the LaTeX source code (since I wanted to build a more generic PDF RAG in the process), it struggles with symbolic text / mathematics, and sometimes fails…
2023 · github.com · its alternatives →
- 7
Twigg▲157Hi HN, we’re Jamie and Matti, co-founders of Twigg. During our master’s we continually found the same pain points cropping up when using LLMs. The linear nature of typical LLMs interfaces - like ChatGPT and Claude - made it really easy to get lost without any easy way to visualise or navigate your project. Worst of all, none of them are well suited for long term projects. We found ourselves spending days using the same chat, only for it to eventually break. Transferring context from one chat to another is also cumbersome. We decided to build something more intuitive to the ways humans think.…
Oct 2025 · twigg.ai · its alternatives →
- 8
TL;DR: Vector-based RAG performs poorly for many real-world applications like codebase chats, and you should consider 'language maps'. Part of our mission at Mutable.ai is to make it much easier for developers to build and understand software. One of the natural ways to do this is to create a codebase chat, that answer questions about your repo and help you build features. It might seem simple to plug in your codebase into a state-of-the-art LLM, but LLMs have two limitations that make human-level assistance with code difficult: 1. They currently have context windows that are too small to…
2024 · twitter.com · its alternatives →
- 9
An LLM chat web app optimized for Kindle. Contribute to andersrex/kindllm development by creating an account on GitHub.
2024 · kindllm.app · its alternatives →
- 10
Hi HackerNews, Lately, I have seen an explosion in posts offering paid APIs/services to get unstructured data into LLMs (i.e. langchain extract, ragflow, unstructured, unstract, just to name a few) and I have been largely disappointed by them, either because they fail to implement multimodal support, fail to give good context for "really tricky" PDFs / Word docs / Powerpoints, or are just plain difficult to use. In light of all these posts I figured I'd share my solution that has been working smoothly for me and my clients. I put it up on GitHub for free so you can check it…
2024 · github.com · its alternatives →
- 11
Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…
2024 · github.com · its alternatives →
- 12
This is like ChatGPT but simpler, with less features (for now). It offers unlimited access to o3, Claude Sonnet 4 and other models for the pro plan. It offers access to o4-mini and the like for the free version. Requests are unlimited up to rate limits that we hope apply to less than 2% of users (they're transparent and can be seen on the account page). I was sick of having these like t3.chat or abacus.ai that give you very few messages for the $8-$10 / month subscription, so wanted to create something closer to Cursor's new pricing but transparent. Image generation will come soon, I…
2025 · donsir.com · its alternatives →
- 13IB
I’ve been playing around with local LLMs for the past couple of months and decided to build something that can run on an iPhone. It’s a universal app built with SwiftUI and the excellent ggml library. The model is an SFT fine tuned and 4 bit quantised version of the RedPajama-INCITE-Chat-3B-v1 OSS LLM. It works reasonably well on recent-ish (~3 year old) iPhones, iPads and Macs. It was launched on the App Store yesterday[1] and Product Hunt today[2]. It seems to be reasonably ok at natural language interactions, but given its size, does pretty badly at coding and reasoning. Also, it…
2023 · its alternatives →
- 14
folio▲74hi HN! a couple of months ago I had to analyze a few thousand audio recordings to help identify issues with customer support. i was able to get some raw high-level initial results with python scripts invoking LLM APIs, but they were too general and unhelpful. writing basic prompts is easy, but tuning them and making them specific enough to ensure no faint signal is missed is hard. you need to iterate through the data with an initial prompt, segment the data into different buckets, chain another prompt for each bucket etc. Then you need to constantly review the raw data to tweak the prompts…
Apr 2026 · usefolio.ai · its alternatives →
- 15
I built a proof-of-concept for running RAG (Retrieval-Augmented Generation) entirely in the browser using WebGPU. You can chat with PDF documents using models like Phi-3, Llama 3, or Mistral 7B - all running locally with zero backend. Documents never leave your device. Tech stack: - WebLLM + WeInfer (optimized fork with ~3.76x speedup) - Transformers.js for embeddings (all-MiniLM-L6-v2) - IndexedDB as vector store - PDF.js for parsing The main challenges were: 1. Getting esbuild to bundle without choking on onnxruntime-node 2. Managing COOP/COEP headers for SharedArrayBuffer 3. Keeping…
Nov 2025 · github.com · its alternatives →
- 16
Author here. I wanted to keep my conversation with #Gemini about code handy while discussing something creative with #ChatGPT and using #DeepSeek in another window. I think it's a waste to have Electron apps and so wanted to chat with LLMs on my own terms. When I discovered the llm CLI tool I really wanted to have convenient and pretty looking access to my conversations, and so I wrote gtk-llm-chat - a plugin for llm that provides an applet and a simple window to interact with LLM models. Make sure you've configure llm first (https://llm.datasette.io/en/stable/) I'd…
2025 · github.com · its alternatives →
- 17IB
I'm lost between ChatGPT vs Claude vs Gemini... which subscriptions to take? With Cursor and all these specific AI tools, I just wanted one simple chat app where I can use any model and pay only when I use it. Couldn't find one, so I built one. Pay only for what you use. Your prompts and docs, knowledge bases work with every model - no more copy-pasting between apps. Started as a personal project, but thought someone else might benefit from this too. https://prismharmony.com/chat What do you think?
2025 · prismharmony.com · its alternatives →
- 18
Lately, I've been tinkering with llama.cpp and the ollama server. The speed of these tools caught my attention, even on my modest 4060 setup. I was quite impressed with the generation quality of models like Mistral. But I was a bit unhappy at the same time because whenever I explore a topic, there is a lot of typing involved when using the chat interface. So I needed a tool to not only give a response but also generate a set of "suggestions" which can be explored further just by clicking. My experience in front-end development is limited. Nonetheless, I tinkered together a small web app to…
2023 · github.com · its alternatives →
- 19
Hi HN, I built a CLI for uploading documents and querying them with an LLM agent that uses search tools rather than stuffing everything into the context window. I recorded a demo using the CrossFit 2025 rulebook that shows how this approach compares to traditional RAG and direct context injection[1]. The core insight is that LLMs running in loops with tool access are unreasonably effective at this kind of knowledge retrieval task[2]. Instead of hoping the right chunks make it into your context, the agent can iteratively search, refine queries, and reason about what it finds. The CLI handles…
2025 · github.com · its alternatives →
- 20
Hey HN! If you’re at all interested in LLMs/LLM-apps, you’ve probably heard of RAG: Retrieval-Assisted Generation, i.e. retrieving relevant documents to give to your LLM as context to answer user queries. Today, I’m releasing RAGatouille v0.0.1, whose aim is to make it as easy as can be to improve your RAG pipelines by leveraging state-of-the-art Information Retrieval research. As of right now, there’s quite a big gap between common everyday practice and the IR literature, and a lot of the gap is because there just aren’t good ways to quickly try out and leverage SotA IR techniques.…
2024 · github.com · its alternatives →
- 21
Hi all! We've built our fair share of LLM apps, everything from Shopify agents to real-time clones of "Samantha" from "Her". We started facing a lot of annoyances & issues repetitively with building functional apps. So we sifted through 97K posts from the OpenAI Community to confirm and find people with similar problems (& we did). It turns out that there are a handful of low-level problems that everybody who is building an AI app that works well needs to solve: statefulness to manage conversations interaction interface between multiple agents and multiple users. robust document search…
2024 · github.com · its alternatives →
- 22One AI Chat▲17
Access Gemini Pro, Claude Pro, ChatGPT Pro models and more for $8/month. Is it another AI/LLMs wrapper? Yes. So why should I use it? Honestly right now there are a lot of other alternatives. But here's why I think it's useful enough to release it in early access: 1. Clear & transparent pricing model. Usage rates is the same is providers api rates + 10%. 2. LLMs responses don't rely on the client connectivity. We use Convex. It's super stable. You can even run multiple chats in parallel. 3. Use it if you like the design :) 4. We have a very clear roadmap. What's next? A desktop app…
2025 · oneaichat.app · its alternatives →
- 23
Hi all, I threw together a small prototype I am calling “Notepad.ai”. A new take on UIs for interacting with LLMs. While I enjoy using LLM’s in the chat format I wanted to see what it would be like to do it in a more long form style. It let’s you write in a pretty free form, much like Window’s Notepad, but you can choose to hit ctrl+[ to analyze the text with a preset prompt of your choosing. It has a few other small features. It’s WIP and very experimental. I would appreciate any feedback or thoughts. Video: https://youtu.be/ntdlgFmSxQY Live Demo:…
2024 · github.com · its alternatives →
- 24
I've built an airgapped Retrieval-Augmented Generation (RAG) system for question-answering on documents, running entirely offline with local inference. Using Llama 3, Mistral, and Gemini, this setup allows secure, private NLP on your own machine. Perfect for researchers, data scientists, and developers who need to process sensitive data without cloud dependencies. Built with Llama C++, LangChain, and Streamlit, it supports quantized models and provides a sleek UI for document processing. Check it out, contribute, or suggest new features!
2024 · github.com · its alternatives →
Also compare
- I built a free in-browser Llama 3 chatbot powered by WebGPU alternatives
- Turn any website into a knowledge base for LLMs alternatives
- In-Browser Graph RAG with Kuzu-WASM and WebLLM alternatives
- I wrote an open-source browser alternative for Computer Use for any LLM alternatives
- Dabarqus alternatives
- Talk to any ArXiv paper just by changing the URL alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →