nowfound

AI · alternatives · 2026

24 alternatives to Local LLM: MITHRIL

None of the on-device LLMs I tried on iPhone felt close to Gemini, ChatGPT, or Claude, so I built one that runs locally and aims for that kind of UX. The local LLM runs Qwen, Gemma, and other small models on your iPhone without an account. Chats stay on device. Download a model f

Local LLM: On-Device is an iPhone app that runs artificial intelligence chat models directly on the phone without requiring an account or internet connection. It offers a user experience similar to Gemini, ChatGPT, and… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

  1. 1
    Llamao▲496

    Private & offline alternative to ChatGPT on your device

    2025 · llamao.app · its alternatives →

  2. 2

    Hi Hackers, Excited to share a macOS app I've been working on: https://recurse.chat/ for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp / llamafile / ollama / llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver.…

    2024 · recurse.chat · its alternatives →

  3. 3

    I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…

    2024 · github.com · its alternatives →

  4. 4
    Apollo AI▲280

    Run local models like Llama on iOS

    2025 · apps.apple.com · its alternatives →

  5. 5
    Lekh AI▲80

    Run powerful AI models on your Mac:fully offline and private

    Jan 2026 · apps.apple.com · its alternatives →

  6. 6
    ChattyUI▲149

    Run open-source LLMs locally in the browser using WebGPU

    2024 · its alternatives →

  7. 7

    Chat with AI using your API keys. Pay only for what you use. ChatGPT, Gemini, Claude, and other LLMs supported. The best chat LLM frontend UI for all AI models.

    2023 · typingmind.com · its alternatives →

  8. 8IB

    I'm lost between ChatGPT vs Claude vs Gemini... which subscriptions to take? With Cursor and all these specific AI tools, I just wanted one simple chat app where I can use any model and pay only when I use it. Couldn't find one, so I built one. Pay only for what you use. Your prompts and docs, knowledge bases work with every model - no more copy-pasting between apps. Started as a personal project, but thought someone else might benefit from this too. https://prismharmony.com/chat What do you think?

    2025 · prismharmony.com · its alternatives →

  9. 9

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumbrel/llama-gpt

    2023 · github.com · its alternatives →

  10. 10

    Private & Offline AI Assistant

    2025 · apps.apple.com · its alternatives →

  11. 11IB

    I’ve been playing around with local LLMs for the past couple of months and decided to build something that can run on an iPhone. It’s a universal app built with SwiftUI and the excellent ggml library. The model is an SFT fine tuned and 4 bit quantised version of the RedPajama-INCITE-Chat-3B-v1 OSS LLM. It works reasonably well on recent-ish (~3 year old) iPhones, iPads and Macs. It was launched on the App Store yesterday[1] and Product Hunt today[2]. It seems to be reasonably ok at natural language interactions, but given its size, does pretty badly at coding and reasoning. Also, it…

    2023 · its alternatives →

  12. 12
    LM Studio▲209

    Discover, download, and run local LLMs (incl. DeepSeek R1)

    2025 · lmstudio.ai · its alternatives →

  13. 13

    Ollama but for mobile, with a cloud fallback

    2025 · runanywhere.ai · its alternatives →

  14. 14WE

    Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/ Code https://github.com/andreinwald/browser-llm - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github…

    2025 · andreinwald.github.io · its alternatives →

  15. 15

    Hey, I built this in a day while at Founders Inc Apple Vision Pro residency. Try it out, let me know what you think.

    2024 · apps.apple.com · its alternatives →

  16. 16

    On-device AI. Private. Fast. Built for iPhones wih iOS 26.

    2025 · apps.apple.com · its alternatives →

  17. 17
    Lapis▲79

    Secure, offline AI chat assistant on your device

    Nov 2025 · lapis.lvrpiz.com · its alternatives →

  18. 18

    I’ve been building a small hardware box that runs local LLMs like Mistral, Qwen and Llama, and exposes an OpenAI compatible API on your local network. There’s no cloud, no login system and no telemetry. I built it because a lot of small firms want ChatGPTbstyle tools but can’t use cloud AI for privacy or compliance reasons, and most don’t want to deal with GPU servers, drivers, Docker or model configs. The aim is to make local AI feel as simple as plugging in a router. Right now the box boots into a very simple web UI where you choose a model and start using it. The API follows the OpenAI…

    Nov 2025 · axis-one-psi.vercel.app · its alternatives →

  19. 19

    Edit & chat with any LLM anywhere on your Mac

    2025 · getpromptly.app · its alternatives →

  20. 20

    Run local LLMs offline on iPhone. MCP integrated.

    Feb 2026 · elio.love · its alternatives →

  21. 21

    All your LLMs, one workspace

    2025 · llmconnect.co · its alternatives →

  22. 22

    Your personal, private, powerful AI assistant | Free & OSS

    2025 · getbodhi.app · its alternatives →

  23. 23

    Hi HN, I'm excited to share Bodhi App, a tool designed to simplify running open-source Large Language Models (LLMs) locally on your laptops. While we currently support M2 Macs, we plan to support other platforms as our community grows. # Problem To use LLMs, you typically need to purchase a subscription from providers like OpenAI or Anthropic, or use OpenAI API credits with compatible Chat UIs. These options can not only burden you financially, but also raise data security and privacy concerns. Many laptops are capable of running powerful open-source LLMs, but for non-tech users, setting…

    2024 · github.com · its alternatives →

  24. 24

    Chat with on-device llm's on iphone

    2025 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →