AI · alternatives · 2026
24 alternatives to Umbra
OpenAI-compatible API for models nobody else hosts
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.
- 1
gpt-oss-120b and gpt-oss-20b open-weight language models
2025 · openai.com · its alternatives →
- 2
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com · its alternatives →
- 3
Hey HN, We just recently launched Forge – an AI model API platform that lets you access and call AI models from multiple providers in one place. Find it on our website: https://tensorblock.co/forge Some key features: Unified API Key – Store multiple provider API keys and access all with a single Forge API key. OpenAI API Compatible – Drop-in replacement for any application that uses OpenAI’s API. Advanced Security – Strong Encryption for API keys with JWT-based authentication. Client Management – Easy key and user management via included command-line interface. Open-source –…
2025 · tensorblock.co · its alternatives →
- 4
1Code▲569Just to clarify the background a bit. This project wasn’t planned as a big standalone release at first. On January 16, Ollama added support for an Anthropic-compatible API, and I was curious how far this could be pushed in practice. I decided to try plugging local Ollama models directly into a Claude Code-style workflow and see if it would actually work end to end. Here is the release note from Ollama that made this possible: https://ollama.com/blog/claude Technically, what I do is pretty straightforward: - Detect which local models are available in Ollama. - When…
Jan 2026 · github.com · its alternatives →
- 5
Hey everyone, We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools. It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf/ggml models. Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features. Here are some quick demos: * Chat with documents using OpenAI's GPT3.5 model: https://www.youtube.com/watch?v=Br2D3G9O47s * Chat with documents…
2023 · github.com · its alternatives →
- 6
Clevrr Computer▲195Computer use but with OpenAI and Gemini models
2024 · github.com · its alternatives →
- 7
LLM Gatewayfree tier▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
- 8
Hey HN, Henry and Roman here - we've been building a cross-platform framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones. Deploying directly on phones facilitates building AI apps and agents capable of phone use without breaking privacy, supports real-time inference with no latency, we have seen personalised RAG pipelines for users and more. Apple and Google actively went into local AI models recently with the launch of Apple Foundation Frameworks…
2025 · github.com · its alternatives →
- 9
Admittedly I work on this, but I anthropic's decision to finally embrace http, auth (at least a little), and other RFCs that are coming out is just great. With OpenAI behind it too, this ecosystem will be built around projects like this. Not saying it's MCP or not, but it'll be one of them
2025 · twitter.com · its alternatives →
- 10
Maki▲84An efficient AI coding agent. Native Rust TUI. Immediate startup, 60 FPS, low memory. Indexes files instead of reading them, chains tools in a sandbox interpreter. Anthropic, OpenAI, Google, Z.AI, OpenRouter, Synthetic, or any OpenAI / Anthropic compatible API.
2022 · maki.sh · its alternatives →
- 11
Self-hosted alternative to OpenAI's Responses API compatible with Agents SDK and works with all model providers (Claude/R1/Qwen/Ollama etc) - open-responses/open-responses
2025 · github.com · its alternatives →
- 12
Serve LLMs privately with an OpenAI API compatible API
2024 · github.com · its alternatives →
- 13
We built SwiftAI, an open-source Swift library that lets you use Apple’s on-device LLMs when available (Apple opened access in June), and fall back to a cloud model when they aren’t available — all without duplicating code. SwiftAI gives you: - A single, model-agnostic API - An agent/tool loop - Strongly-typed structured outputs - Optional chat state Backstory: We started experimenting with Apple’s local models because they’re free (no API calls), private, and work offline. The problem: not all devices support them (older iPhones, Apple Intelligence disabled, low battery, etc.). That…
2025 · github.com · its alternatives →
- 14
- 15
i built an open source version of OpenAI Assistants API it's compatible with any LLM & embeddings model and u can swap it out for OpenAI assistants API with just one line of code. if you want this let me know 👇
2023 · twitter.com · its alternatives →
- 16
- 17
Osaurus is an open-source local inference runtime for macOS, written in Swift and optimized for Apple Silicon. It lets you run Apple Foundation Models locally — fully accelerated by the Neural Engine — while also exposing OpenAI- and Ollama-compatible endpoints, so you can connect your favorite apps, tools, or clients without any code changes. Key points: * Supports Apple Foundation Models natively * Compatible with OpenAI & Ollama APIs * ~7 MB binary, runs locally (no cloud, no telemetry) * MIT Licensed, open source Project: https://osaurus.ai Source:…
2025 · github.com · its alternatives →
- 18
- 19
Provides the same proxy OpenAI API for different LLM models
2024 · github.com · its alternatives →
- 20
- 21Q3
Ubicloud is an open source alternative to AWS. Today, we launched our inference APIs, built with open source AI models. QwQ-32B-Preview is one of those models; and it can provide o1-like reasoning at 1% the cost. QwQ is licensed under Apache 2.0 [1] and Ubicloud under AGPL v3. We deploy open models on a cloud stack that can run anywhere. This allows us to offer great price / performance. From an accuracy standpoint, QwQ does well in math and coding domains. For example, in the MMLU-Pro Computer Science LLM Benchmark, the accuracy rankings are as follows. Claude-3.5 Sonnet (82.5),…
2025 · its alternatives →
- 22
- 23
AurraCloud▲18Hosted MCP and AI agent tooling for crypto & DeFi
2025 · aurracloud.com · its alternatives →
- 24
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →