Bodhi App - Run LLMs Locally

What it does

Run LLMs locally with Bodhi App- a drop-in OpenAI API replacement that saves costs while ensuring complete privacy. Perfect for non-technical users with its intuitive Chat UI. Features one-click model downloads, management, and security. Free and open source.

Unified AI gateway combining local LLM inference, cloud API proxying, and MCP tool integration with built-in chat UI and enterprise access control.

Run everything locally on your machine with complete data control. One-click downloads from HuggingFace with real-time progress tracking. Use local GGUF models alongside cloud API providers and MCP tools in one unified interface. Server-Sent Events provide instant response feedback with live token streaming. 12+ parameters for fine-tuning: temperature, top-p, frequency penalty, and more. Connect to MCP servers, discover and execute tools directly from the chat interface. Models invoke MCP tools mid-conversation for autonomous task completion. View LLM internal reasoning and chain-of-thought during conversations. Drop-in replacement for OpenAI APIs. Use your existing code and tools. Run…from getbodhi.app

• 
  Bodhi App – Run Open Source/Weights HuggingFace LLMs Locally2024 · github.com · ▲21

  Hi HN, I'm excited to share Bodhi App, a tool designed to simplify running open-source Large Language Models (LLMs) locally on your laptops. While we currently support M2 Macs, we plan to support other platforms as our community grows. # Problem To use LLMs, you typically need to purchase a subscription from providers like OpenAI or Anthropic, or use OpenAI API credits with compatible Chat UIs. These options can not only burden you financially, but also raise data security and privacy concerns. Many laptops are capable of running powerful open-source LLMs, but for non-tech users, setting…

• 
  LM Studio2025 · lmstudio.ai · ▲209

  Discover, download, and run local LLMs (incl. DeepSeek R1)

• 
  Apollo AI2025 · apps.apple.com · ▲280

  Run local models like Llama on iOS

• 
  Bodhi App – Bring your own AI model to any web appJan 2026 · bodhiapps.github.io · ▲6

  Bodhi Chat is a demo chat app that connects to Bodhi App running locally on your machine. The connection to Bodhi App is completely secure and backed by OAuth 2.1 PKCE standards. We also have a built-in Exa web — so the LLM can search the web during conversations if required. The complete setup is completely secured by OAuth authentication/authorization, and no access is allowed unless user consents to it. Links: - Demo: https://bodhiapps.github.io/chat/ - Bodhi App repo: https://github.com/BodhiSearch/BodhiApp - Developer waitlist:…

• 
  Lekh AIJan 2026 · apps.apple.com · ▲80

  Run powerful AI models on your Mac:fully offline and private

• 
  Ava PLS2023 · avapls.com · ▲94

  Desktop app for running LLMs locally

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 30d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  Screen Studio 3.0▲1,832

  Beautiful screen recordings with instant shareable links

  Growth · 2025 · screen.studio

• 
  Tana▲1,665

  Put your notes to work with voice and AI

  AI · 2025 · tana.inc

• IG
  I got laid off from Meta and created a minor hit on Steam▲1,581

  I was at FB/Meta from late 2013 to early 2023, mostly working in the compiler/runtime spaces. I got hit in the spring 2023 layoff wave. I immediately started making games in my newfound free time (a lifelong interest, and I even worked in AA(A?) back ca. ~2000), and in October 2023 I stumbled upon the idea of a roguelike pachinko/plinko game inspired by Luck Be A Landlord. Things snowballed quickly, I started talking to publishers, then worked like crazy through all of 2024, almost the hardest I've ever worked in my career, and launched the game in December 2024. It's sold…

  Work · 2025

• 
  Tanka▲1,410

  AI Messenger with smart reply & long term memory for teams

  AI · 2025 · tanka.ai

• 
  Tool Finder▲1,327

  Your shortcut to better software

  AI · 2025 · toolfinder.com

• 
  I built an app to stop me doomscrolling by touching grass▲1,203

  i wanted to change the habit of reaching for my phone in the morning and doomscrolling away an hour so i built an app to help me. now i have to literally touch grass before accessing my most distracting apps the app is built in swiftui, uses the screen time apis provided by apple and google vision to recognise grass or not i'd love to get your thoughts on the concept.

  Life & fun · 2025 · touchgrass.now