Alternatives
Products that do what Bodhi App - Run LLMs Locally does
Your personal, private, powerful AI assistant | Free & OSS
- 1BA
Hi HN, I'm excited to share Bodhi App, a tool designed to simplify running open-source Large Language Models (LLMs) locally on your laptops. While we currently support M2 Macs, we plan to support other platforms as our community grows. # Problem To use LLMs, you typically need to purchase a subscription from providers like OpenAI or Anthropic, or use OpenAI API credits with compatible Chat UIs. These options can not only burden you financially, but also raise data security and privacy concerns. Many laptops are capable of running powerful open-source LLMs, but for non-tech users, setting…
2024 · github.com
- 2
- 3
PoC for Bodhi Platform, create webapps powered by Local LLMs
Feb 2026 · bodhiapps.github.io
- 4
- 5BA
Bodhi Chat is a demo chat app that connects to Bodhi App running locally on your machine. The connection to Bodhi App is completely secure and backed by OAuth 2.1 PKCE standards. We also have a built-in Exa web — so the LLM can search the web during conversations if required. The complete setup is completely secured by OAuth authentication/authorization, and no access is allowed unless user consents to it. Links: - Demo: https://bodhiapps.github.io/chat/ - Bodhi App repo: https://github.com/BodhiSearch/BodhiApp - Developer waitlist:…
Jan 2026 · bodhiapps.github.io
- 6
- 7
- 8IB
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com
- 9
- 10OS
Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.
2025 · github.com
- 11
- 12
- 13
- 14
- 15TL
2023 · tinyllms.vercel.app
- 16
- 17SO
We built SwiftAI, an open-source Swift library that lets you use Apple’s on-device LLMs when available (Apple opened access in June), and fall back to a cloud model when they aren’t available — all without duplicating code. SwiftAI gives you: - A single, model-agnostic API - An agent/tool loop - Strongly-typed structured outputs - Optional chat state Backstory: We started experimenting with Apple’s local models because they’re free (no API calls), private, and work offline. The problem: not all devices support them (older iPhones, Apple Intelligence disabled, low battery, etc.). That…
2025 · github.com
- 18
- 19
- 20
- 21AP
Hey HN! We've run our privacy-focused open-source inference company for a while now, and we're launching a flat monthly subscription similar to Anthropic's. It should work with Cline, Roo, KiloCode, Aider, etc — any OpenAI-compatible API client should do. The rate limits at every tier are higher than the Claude rate limits, so even if you prefer using Claude it can be a helpful backup for when you're rate limited, for a pretty low price. Let me know if you have any feedback!
2025 · synthetic.new
- 22
- 23CI
One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.
2025 · can-i-run-this-llm-blue.vercel.app
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with a description →