nowfound

AI · July 27, 2023

LLM App – build a realtime LLM app in 30 lines, with no vector database

Hi HN, I am Jan, CTO and co-founder of Pathway.com. We’ve built a LLM microservice that answers questions about a corpus of documents, while automatically reacting to additions of new docs. The single, self-contained service fully replaces a complex multi-system pipeline that scans in real-time for new documents, indexes them into a specialized database and queries it to generate answers. Everyone can have their own real-time vector now. Github: https://github.com/pathwaycom/llm-app Demo video: https://youtu.be/kcrJSk00duw I am eager to hear your thoughts…

LLM App – build a realtime LLM app in 30 lines, with no vector database launched on July 27, 2023 with 11 votes, #1,595 of 4,347 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 3 years on.

In plain words

LLM App is a microservice that answers questions about document collections while automatically processing new documents as they are added. Built by Pathway, it consolidates the functionality of complex multi-system pipelines that traditionally require separate components for document scanning, indexing, and query generation. The service is designed as a single self-contained deployment that handles real-time document updates without requiring a specialized vector database, allowing developers to build LLM applications in minimal code.

written from the facts on this page · September 2026

From the sources

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more. - pathwaycom/llm-app

In the maker’s words, at launch

Hi HN, I am Jan, CTO and co-founder of Pathway.com. We’ve built a LLM microservice that answers questions about a corpus of documents, while automatically reacting to additions of new docs. The single, self-contained service fully replaces a complex multi-system pipeline that scans in real-time for new documents…

Does a similar job

all alternatives →
  • LLM Spark2023 · yourgpt.ai · ▲365

    Dev platform for building production ready LLM apps

  • Why write code if the LLM can just do the thing? (web app experiment)Nov 2025 · github.com · ▲436

    I spent a few hours last weekend testing whether AI can replace code by executing directly. Built a contact manager where every HTTP request goes to an LLM with three tools: database (SQLite), webResponse (HTML/JSON/JS), and updateMemory (feedback). No routes, no controllers, no business logic. The AI designs schemas on first request, generates UIs from paths alone, and evolves based on natural language feedback. It works—forms submit, data persists, APIs return JSON—but it's catastrophically slow (30-60s per request), absurdly expensive ($0.05/request), and has zero UI…

  • LLMWare2024 · llmware.ai · ▲358

    Dev tool to make AI apps to deploy privately or locally

  • LLMWare – Small Specialized Function Calling 1B LLMs for Multi-Step RAG2024 · github.com · ▲51

    Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…

  • Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305

    I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...

  • Open-source real time data framework for LLM applications2024 · getindexify.ai · ▲92

    Hey HN, I am the founder of Tensorlake. Prototyping LLM applications have become a lot easier, building decision making LLM applications that work on constantly updating data is still very challenging in production settings. The systems engineering problems that we have seen people face are - 1. Reliably process ingested content in real time if the application is sensitive to freshness of information. 2. Being able to bring in any kind of model, and run different parts of the pipeline on GPUs and CPUs. 3. Fault Tolerance to ingestion spike, compute infrastructure failure. 4. Scaling compute,…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 19d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 19d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 22d ago · stillwet.art

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

  • Route requests to the right LLM for cost, latency & quality

    AI · 23d ago · fastrouter.ai

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, July 2023

the whole month →
  • Clustr▲1,526

    The reality check for your crypto portfolio

    Commerce · 2023 · clustr.io

  • Hey everyone, I here is a small open-source project I've been working on lately. I'd love to hear your thoughts and improvement ideas :) GitHub: [github.com/Vincenius/workout-lol](https://github.com/Vincenius/workout-lol)

    Dev tools · 2023 · workout.lol

  • HN

    I saw this [0] pretty cool thread by user revskill, and wanted a quicker way to search through it, but also to keep them all in one place so I can read them at my leisure whenever I get time. Right now is like 60 lines of Ruby using Nokogiri, but I will certainly look into it further down the line and improve the list. There's a cronjob checking the thread every 12 hours but I will eventually shut that down and it will become static after that. There are some really awesome blogs in there. I really recommend going through the list, it made my day. [0] "Could you share your personal blog…

    Life & fun · 2023 · dm.hn

  • Lazy▲928

    One ⌘ shortcut to capture anything straight to Notion

    AI · 2023 · lazy.so

  • Anytype is built on the open-source AnySync protocol: a local-first protocol based on CRDTs. Users of Anytype can create spaces - graph-based databases with modular UI. Each space has unique access rights. Today, Anytype's beta is in single-player mode. Multiplayer mode, which will support local-first collaboration between multiple users, will be launched in the first half of 2024. Anytype fulfils the seven ideals of local first software from here - https://www.inkandswitch.com/local-first/ , our team felt these things are important to all of us: • No spinners: your work…

    Commerce · 2023 · anytype.io

  • n8n 1.0▲786

    Workflow automation for technical people

    Dev tools · 2023 · n8n.io