Alternatives
Products that do what KubeAI: Private Open AI on K8s does
Serve LLMs privately with an OpenAI API compatible API
- 1IB
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com
- 2
- 3OS
Hey everyone, We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools. It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf/ggml models. Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features. Here are some quick demos: * Chat with documents using OpenAI's GPT3.5 model: https://www.youtube.com/watch?v=Br2D3G9O47s * Chat with documents…
2023 · github.com
- 4
- 5
- 6OS
Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.
2025 · github.com
- 7SO
We built SwiftAI, an open-source Swift library that lets you use Apple’s on-device LLMs when available (Apple opened access in June), and fall back to a cloud model when they aren’t available — all without duplicating code. SwiftAI gives you: - A single, model-agnostic API - An agent/tool loop - Strongly-typed structured outputs - Optional chat state Backstory: We started experimenting with Apple’s local models because they’re free (no API calls), private, and work offline. The problem: not all devices support them (older iPhones, Apple Intelligence disabled, low battery, etc.). That…
2025 · github.com
- 8
- 9
- 10
- 11TL
2023 · tinyllms.vercel.app
- 12OC
Hey HN, I’ve built Open Codex, a fully local, open-source alternative to OpenAI’s Codex CLI. My initial plan was to fork their project and extend it. I even started doing that. But it turned out their code has several leaky abstractions, which made it hard to override core behavior cleanly. Shortly after, OpenAI introduced breaking changes. Maintaining my customizations on top became increasingly difficult. So I rewrote the whole thing from scratch using Python. My version is designed to support local LLMs. Right now, it only works with phi-4-mini (GGUF) via…
2025 · github.com
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21BA
Hi HN, I'm excited to share Bodhi App, a tool designed to simplify running open-source Large Language Models (LLMs) locally on your laptops. While we currently support M2 Macs, we plan to support other platforms as our community grows. # Problem To use LLMs, you typically need to purchase a subscription from providers like OpenAI or Anthropic, or use OpenAI API credits with compatible Chat UIs. These options can not only burden you financially, but also raise data security and privacy concerns. Many laptops are capable of running powerful open-source LLMs, but for non-tech users, setting…
2024 · github.com
- 22
- 23
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with your own description →