Openlit
One click observability & evals for LLMs & GPUs
Openlit launched on July 26, 2024 with 152 votes, #404 of 5,184 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
OpenLIT is an open-source observability tool designed for developers working with large language models and GPUs. Built on OpenTelemetry, it provides tracing, metrics, and a playground environment for debugging and optimizing LLM applications. The tool integrates with over 20 frameworks and services including OpenAI and LangChain, and can export data to existing observability platforms. It enables developers to monitor and evaluate their AI applications efficiently.
written from the facts on this page · September 2026
From the sources
OpenLIT is an open-source LLM and GPU observability tool built on OpenTelemetry. It offers tracing, metrics, and a playground to debug and improve LLM apps. Supports 20+ integrations like OpenAI, LangChain, and exports data to your existing observability tools
Trace LLMs and AI agents with OpenTelemetry, run LLM evaluations, manage prompts, compare models, store API keys in Vault, and self-host free under Apache 2.0.
Does a similar job
all alternatives →
OpenLIT – Open-Source LLM Observability with OpenTelemetry2024 · github.com · ▲62Hey HN, we're super excited to share something we've been working on: OpenLIT. After an engaging preview that some of you might recall, we are now proudly announcing our first stable release! *What's OpenLIT?* Simply put, OpenLIT is an open-source tool designed to make monitoring your Large Language Model (LLM) applications straightforward. It’s built on OpenTelemetry, aiming to reduce the complexities that come with observing the behavior and usage of your LLM stack. *Beyond Basic Text Generation:* OpenLIT isn’t restricted to just text and chatbot outputs. It now includes automatic…
AI Observability by OpenObserveAug 2026 · openobserve.ai · ▲317OpenTelemetry-native observability for agents and LLMs
OpenLLMetry – OpenTelemetry-based observability for LLMs2023 · github.com · ▲154Hey HN, Nir, Gal and Tomer here. We’re open-sourcing a set of extensions we’ve built on top of OpenTelemetry that provide visibility into LLM applications - whether it be prompts, vector DBs and more. Here’s the repo: https://github.com/traceloop/openllmetry. There’s already a decent number of tools for LLM observability, some open-source and some not. But what we found was missing for all of them is that they were closed-protocol by design, vendor-locking you to use their observability platform or their proprietary framework for running your LLMs. It’s still early in the…
You don't need to adopt new tools for LLM observability2024 · github.com · ▲102If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…
Questions this answers
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, July 2024
the whole month →
Many years ago, I made VJ softwares (to mix live visuals in clubs) for unexpected platforms like the Game Boy Advance, the Playstation 2 and the Raspberry Pi. This year, I’m back with a new web-app: Pikimov. Inspired by Photopea (a free Photoshop clone), I created this web-based motion design & video editor as an alternative to After Effects, to fill empty void. It's free, without signup, without cloud uploads (your files stay on your machine), and your projects are not used for AI models training.
AI · 2024 · pikimov.com
