nowfound

Alternatives

Products that do what LLM App – build a realtime LLM app in 30 lines, with no vector database does

Hi HN, I am Jan, CTO and co-founder of Pathway.com. We’ve built a LLM microservice that answers questions about a corpus of documents, while automatically reacting to additions of new docs. The single, self-contained service fully replaces a complex multi-system pipeline that scans in real-time for new documents, indexes them into a specialized database and queries it to generate answers. Everyone can have their own real-time vector now. Github: https://github.com/pathwaycom/llm-app Demo video: https://youtu.be/kcrJSk00duw I am eager to hear your thoughts…

  1. 1
    LLM Spark365

    Dev platform for building production ready LLM apps

    2023

  2. 2WW

    I spent a few hours last weekend testing whether AI can replace code by executing directly. Built a contact manager where every HTTP request goes to an LLM with three tools: database (SQLite), webResponse (HTML/JSON/JS), and updateMemory (feedback). No routes, no controllers, no business logic. The AI designs schemas on first request, generates UIs from paths alone, and evolves based on natural language feedback. It works—forms submit, data persists, APIs return JSON—but it's catastrophically slow (30-60s per request), absurdly expensive ($0.05/request), and has zero UI…

    Nov 2025 · github.com

  3. 3
    LLMWare358

    Dev tool to make AI apps to deploy privately or locally

    2024

  4. 4LS

    Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…

    2024 · github.com

  5. 5TA

    I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...

    2024 · embedding.io

  6. 6

    Build LLMs powered by GPT & your own data

    2023

  7. 7OS

    Hey HN, I am the founder of Tensorlake. Prototyping LLM applications have become a lot easier, building decision making LLM applications that work on constantly updating data is still very challenging in production settings. The systems engineering problems that we have seen people face are - 1. Reliably process ingested content in real time if the application is sensitive to freshness of information. 2. Being able to bring in any kind of model, and run different parts of the pipeline on GPUs and CPUs. 3. Fault Tolerance to ingestion spike, compute infrastructure failure. 4. Scaling compute,…

    2024 · getindexify.ai

  8. 8
    LM Studio209

    Discover, download, and run local LLMs (incl. DeepSeek R1)

    2025

  9. 9
    Twigg157

    Git for LLMs - a Context Management Tool

    Oct 2025

  10. 10DG

    2023 · github.com

  11. 11GF

    Hi HN, we’re Jamie and Matti, co-founders of Twigg. During our master’s we continually found the same pain points cropping up when using LLMs. The linear nature of typical LLMs interfaces - like ChatGPT and Claude - made it really easy to get lost without any easy way to visualise or navigate your project. Worst of all, none of them are well suited for long term projects. We found ourselves spending days using the same chat, only for it to eventually break. Transferring context from one chat to another is also cumbersome. We decided to build something more intuitive to the ways humans think.…

    Oct 2025 · twigg.ai

  12. 12AR

    So, it feels like this should exist. But I couldn't find it. So I tried to build it. Agentflow lets you run complex LLM workflows from a simple JSON file. This can be as little as a list of tasks. Tasks can include variables, so you can reuse workflows for different outputs by providing different variable values. They can also include custom functions, so you can go beyond text generation to do anything you want to write a function for. Someone might say: "Why not just use ChatGPT?" Among other reasons, I'd say that you can't template a workflow with ChatGPT, trigger it with different…

    2023 · github.com

  13. 13UL

    Recently featured in a LangChain blog https://blog.langchain.dev/empowering-development-with-flowt... , use LLMs to construct an API first runnable workflow with an IDE experience.

    2024 · github.com

  14. 14
    l1m.io135

    The simplest API to get structured data from any LLM

    2025

  15. 15MW

    Christmas project from a personal need to find ideal locations.

    2024 · godview.ai

  16. 16CL

    https://medium.com/@theaniketgiri/three-months-ago-i-wanted-...

    Oct 2025 · github.com

  17. 17LL

    Hi HN! Over the last several weekends, I've been building LLMFlows as an alternative to langchain. There's been a lot of discussion on the shortcomings of langchain in the past few weeks, but when I first tried it in March, I thought there are 3 main problems: 1. Too many abstractions 2. Hidden prompts and opinionated logic in chains which makes it hard to customize 3. Hard to debug This inspired me to try and build a framework that solves these 3 issues, and therefore I started building LLFlows with the "philosophy" of being "simple, explicit, and transparent." A few weekends later, I think…

    2023 · github.com

  18. 18RM
  19. 19IJ

    Hi HackerNews, Lately, I have seen an explosion in posts offering paid APIs/services to get unstructured data into LLMs (i.e. langchain extract, ragflow, unstructured, unstract, just to name a few) and I have been largely disappointed by them, either because they fail to implement multimodal support, fail to give good context for "really tricky" PDFs / Word docs / Powerpoints, or are just plain difficult to use. In light of all these posts I figured I'd share my solution that has been working smoothly for me and my clients. I put it up on GitHub for free so you can check it…

    2024 · github.com

  20. 20AI

    Hi I am Jan, CTO @ Pathway. A use case we have been working on with LLMs is to let people know when an answer to their query changes due to revisions of source documents. Obviously, we want to avoid periodically re-computing all queries for the LLM. Why I think it’s cool? - We don’t spin in a loop to repeat with the LLM. - Alerts are LLM-deduplicated - no spamming users with typo fixes - And the best - our framework, Pathway takes care of handling the updates, the example looks nearly like a regular, static RAG chatbot. More context + GIF of how it works for Google Drive document alerts:…

    2023 · github.com

  21. 21LA

    G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

    2023 · github.com

  22. 22AL
  23. 23AF

    Hello HN! I wanted to share a side project of mine: a fully standalone app that uses a local LLM (specifically Mistral 7B) for document interaction using RAG. It supports a wide variety of document types and is designed to run right after installation. There are still quite a few bugs to iron out and many features I'm excited to add. Considering this is my first time working on such a project, I'm really happy with the progress and am learning a ton! The project is open source, so I please feel free to check out my work and leave any feedback :)

    2024 · github.com

  24. 24GL

    Hey everyone! I made a Mac app for exploring large language models. It’s fast, small, has a tiny memory footprint. It’s immutable by design with both immediate time travel and automatic versioning as foundational elements. The app is written in Swift and a bit of Rust for the tokenizer. I used SwiftUI for structure and animations and Cocoa for advanced behavior. All storage is SQLite and local-only. You can go through the database as needed and backup it as well. The app has support for variants, which is the `n` parameter in the OpenAI chat completion API—equivalent to the drafts feature in…

    2023 · thellm.app

Ranked by how close each launch is in meaning, then by votes. Refine with a description →