Alternatives
Products that do what OpenLIT's Zero-code LLM Observability does
Trace LLM requests + costs with OpenTelemetry monitoring
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8LO
Hey HN, Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic and Cohere, popular frameworks like Langchain and LlamaIndex and vectorDBs like ChromaDB and Pinecone. The LLM monitoring/evaluations space has seen a number of products off late, both open source and closed source ones. But, a couple of things we have observed are: lack of…
2024
- 9
- 10LO
2024 · github.com
- 11
- 12
- 13
- 14MY
LLM observability is an absolute must-have for anyone running something in prod (or prod-like). While all the observability startups are great, you're essentially sending all your OpenAI usage history - prompts, generations, chats - to a random third party. So this script deploys a basic proxy in your Azure account, catches all incoming OpenAI requests, stores logs in your own resource group, and comes with visualizations premade (charts, timelines, chat history, cost estimation, etc). Thanks for any thoughts and feedback!
2023 · github.com
- 15
- 16
- 17
- 18
- 19OS
Hi HN, we’re Dylan and Matthew, building sublingual (https://github.com/sublingual-ai/sublingual), an open-source LLM observability tool you can use with zero code changes. As developers focused on iterating and building features as fast as possible, we felt observability would’ve been a helpful tool to have, but we found existing solutions had too much overhead to set up. So we gave ourselves the challenge of building an observability tool that you can integrate without changing a single line of code in your project. How it works Run your python application as usual with…
2025 · github.com
- 20DF
Hi HN, We’re the team at MyDecisive.ai, and today we’re giving developers a peek at Octant — point-and-click control and visibility for your OpenTelemetry. You've likely felt the pain of the "observability tax," especially if you manage K8S clusters. The modern standard is to instrument everything with OpenTelemetry, but piping all those rich OTLP logs, metrics, and traces straight to a SaaS vendor (Datadog, Splunk, Honeycomb) gets expensive fast. You end up paying massive ingestion and storage costs for noisy, low-value data just so it's searchable when something breaks. With Octant you get…
Jun 2026
- 21
- 22LO
Hey HN! I built Lumina – an open-source observability platform for AI/LLM applications. Self-host it in 5 minutes with Docker Compose, all features included. The Problem: I've been building LLM apps for the past year, and I kept running into the same issues: - LLM responses would randomly change after prompt tweaks, breaking things - Costs would spike unexpectedly (turns out a bug was hitting GPT-4 instead of 3.5) - No easy way to compare "before vs after" when testing prompt changes - Existing tools were either too expensive or missing features in free tiers What I Built: Lumina is…
Jan 2026 · github.com
- 23LR
Hi hacker news, My name is Dillion and I'm the creator of llm.report. A few months ago, I was frustrated by the lack of observability into the OpenAI API. All of us are left in the dark about API performance, latency, cost calculation, cost breakdown, and more. I just wanted to know more about how my AI app is performing in production and make data-driven decisions to improve the product. So I ended up just building it myself. There are three parts to the platform: 1. OpenAI API Dashboard (no-code) - Enter your OpenAI key and get access to detailed insights straight from the OpenAI API…
2023 · github.com
- 24
Deterministic tests for AI agents — no LLM required
11d ago · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →