Self-Hosted RAG with Llama 3
100% offline RAG for engineers who can't use cloud AI
Self-Hosted RAG with Llama 3 launched on August 18, 2026 with 1 votes, #11,494 of 23,274 launches that month.
What it does
A Dockerized RAG system built with Ollama, ChromaDB, and Streamlit — for engineers handling sensitive documents (datasheets, specs, NDAs) that can't be pasted into ChatGPT. No cloud dependency. No API fees. No data leaving your machine. Ask questions about your technical docs in plain English, get answers grounded in your own files. Built for controls engineers, automation teams, and anyone who needs a private alternative to cloud AI tools for document Q&A.
Built by a working automation engineer with an M.S. from NYCU (National Yang Ming Chiao Tung University) and 12+ years in industrial systems — these are the...
Does a similar job
all alternatives →- OSOpen-Source DocumentAI with Ollama2025 · rlama.dev · ▲295
Complete AI Platform: RAG Systems & Intelligent Agents for Local AI
RAGstack – private ChatGPT for enterprise VPCs, built with Llama 22023 · github.com · ▲84Hey hacker news, We’re the cofounders at Psychic.dev (http://psychic.dev) where we help companies connect LLMs to private data. With the launch of Llama 2, we think it’s finally viable to self-host an internal application that’s on-par with ChatGPT, so we did exactly that and made it an open source project. We also included a vector DB and API server so you can upload files and connect Llama 2 to your own data. The RAG in RAGstack stands for Retrieval Augmented Generation, a technique where the capabilities of a large language model (LLM) are augmented by retrieving information…
LiquidIndex 2.02025 · liquidindex.dev · ▲134I'm building LiquidIndex, an RAG API service that makes it easy to add personalized context to AI apps. Instead of building a whole system to upload, process, and search through a user’s files or notes, you just call a few APIs. It handles the hard parts - like connecting to Notion or Google Drive, breaking the data into usable pieces, and making it searchable. Then, when you want to answer a question using that data, you just query it, and it gives you the most relevant results - optionally with an LLM-generated answer. No pipelines, no infrastructure, no headaches. Here are the core APIs:…
I built an offline open-source RAG system DataBridge2025 · github.com · ▲7Hey HN! Over the past few weeks, I’ve been working on DataBridge, an open-source solution for data ingestion and querying across text, PDFs, images, and videos. In our latest update, we’ve added a fully local deployment option: - No internet required – Runs entirely offline. - Customizable Models – Supports any LLM and embedding model via Ollama (with options for any other private providers) - Extensibility – You can plug in your own models or tools easily. This local-first approach ensures better privacy, security, and flexibility, especially for teams dealing with sensitive data. You can…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Product Hunt launch ↗
Launched alongside, August 2026
the whole month →- TL
Life & fun · Aug 2026 · louisabraham.github.io
Clipto MCP▲655Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…
Work · Aug 2026 · clipto.com
Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…
Life & fun · Aug 2026 · toneyalexander.github.io
Astute▲606Automate your B2B brand going viral, with new media creators
AI · Aug 2026 · company-app.joinastute.com