Alternatives
Products that do what Basaran – OpenAI-compatible streaming API for your own models does
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models. The open source community will eventually witness the Stable Diffusion moment for large language models (LLMs), and Basaran is committed to becoming the Stable Diffusion web UI for LLMs. Basaran allows you to replace OpenAI's service with the latest open-source model to power your application without modifying a single line of code.
- 1
- 2
- 3
- 4
- 5
- 6
- 7
Trace LLM requests + costs with OpenTelemetry monitoring
Oct 2025
- 8
- 9
- 10
- 11
- 12
- 13LO
Hey HN! I built Lumina – an open-source observability platform for AI/LLM applications. Self-host it in 5 minutes with Docker Compose, all features included. The Problem: I've been building LLM apps for the past year, and I kept running into the same issues: - LLM responses would randomly change after prompt tweaks, breaking things - Costs would spike unexpectedly (turns out a bug was hitting GPT-4 instead of 3.5) - No easy way to compare "before vs after" when testing prompt changes - Existing tools were either too expensive or missing features in free tiers What I Built: Lumina is…
Jan 2026 · github.com
- 14CE
Hello! I built this to solve a personal problem of where I didn't want to wade down large chains of HackerNews comment threads in order to get the key takeaways from the discussions. I built this Chrome extension, which supports both OpenAI and Ollama(local LLMs) to summarize comments and display the summary within Chrome's sidepanel. It's open source as you can see from the link, feedback appreciated!
2024 · github.com
- 15
- 16LR
Hi hacker news, My name is Dillion and I'm the creator of llm.report. A few months ago, I was frustrated by the lack of observability into the OpenAI API. All of us are left in the dark about API performance, latency, cost calculation, cost breakdown, and more. I just wanted to know more about how my AI app is performing in production and make data-driven decisions to improve the product. So I ended up just building it myself. There are three parts to the platform: 1. OpenAI API Dashboard (no-code) - Enter your OpenAI key and get access to detailed insights straight from the OpenAI API…
2023 · github.com
- 17OA
Thesys just open-sourced their generative UI rendering engine. Interesting timing given where Google a2ui and Vercel's json-render are headed. The difference worth noting: a2ui and json-render both treat JSONL as the contract between the LLM and the renderer. Thesys is betting that's the wrong primitive. Their engine uses a code-like syntax (OpenUI Lang) instead — LLM writes it, renderer executes it. The argument is that LLMs are fundamentally better at generating code than generating structured data, so you get cleaner output and ~67% fewer tokens. The broader vision seems to be a…
Mar 2026 · openui.com
- 18SD
Hey HN! After spending way too many nights debugging flaky AI tests, I built SteadyText. It's a simple python library for deterministic llm generations and embeddings. We use it in production for: - Testing our AI features (zero flakes in 3 months) - CLI tools that need consistent outputs - Reproducible documentation examples It's not for creative tasks - this is specifically for when you need AI to be boring and predictable. Think of it as the opposite of ChatGPT. The coolest part? It includes a Postgres extension. You can now do: SELECT steadytext_generate('explain this query: ...'); And…
2025 · steadytext.julep.ai
- 19MY
LLM observability is an absolute must-have for anyone running something in prod (or prod-like). While all the observability startups are great, you're essentially sending all your OpenAI usage history - prompts, generations, chats - to a random third party. So this script deploys a basic proxy in your Azure account, catches all incoming OpenAI requests, stores logs in your own resource group, and comes with visualizations premade (charts, timelines, chat history, cost estimation, etc). Thanks for any thoughts and feedback!
2023 · github.com
- 20SO
SURF (Search Utility & Reading Framework) is an open-source API that bridges LLMs with the web. It provides a standardized interface for web search and content processing that preserves formatting of tables, code, and complex layouts. Key features: - Multiple search providers (SearXNG, DuckDuckGo, Brave) - HTML cleaning and smart content extraction - Model Context Protocol (MCP) integration for Claude and other AI assistants - Self-deployable with minimal setup (Docker, bare metal, cloud) - API key authentication I built this to make it easier to add web capabilities to LLM applications…
2025 · github.com
- 21
- 22WB
Hi HN, I'm one of the creators of Nanobrowser, an open-source Chrome extension that lets you automate web tasks using AI agents. We were inspired by the potential of tools like OpenAI's Operator, but we wanted something that was: -Open-Source:You can see the code, modify it, and contribute to the project. -Browser-Based:No complex setups or server deployments. It runs directly in your browser. -Customizable:You can tailor the agent's behavior to your specific needs. -BYO LLM:Bring your own large language model API key (OpenAI, Anthropic,or even local models), No vendor lock-in. -Privacy…
2025 · github.com
- 23AC
There's LLM Council and similar tools, but they use predefined model lineups. This one is different in a few ways that mattered to me: *Bring your own models.* Mix Ollama (local), OpenAI, Anthropic, Groq, Google — or any OpenAI-compatible endpoint — in whatever combination you want. A council of DeepSeek-R1 + llama2-uncensored + mistral-nemo is a very different deliberation than GPT-4o + Claude + Gemini. *Zero server, zero account, zero storage.* The app is purely static. API calls go directly from your browser to providers. Nothing touches a backend. No tokens, no sessions, no analytics.…
Feb 2026 · github.com
- 24LA
LunaRoute is a high-performance local proxy for AI coding assistants like Claude Code, OpenAI Codex CLI, and OpenCode. Get complete visibility into every LLM interaction with zero-overhead passthrough, comprehensive session recording, and powerful debugging capabilities. - See Everything Your AI Does - get full logs (JSONL), summary of sessions including tokens used (input/output) as well as tools usage and success rates. - Privacy & Compliance Built-In - redact or tokenize any sensitive information (regex based). - Speaks OpenAI and Anthropic dialects so you can route (and translate)…
Oct 2025 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →