nowfound

AI · February 14, 2024

You don't need to adopt new tools for LLM observability

If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…

You don't need to adopt new tools for LLM observability launched on February 14, 2024 with 102 votes, #566 of 3,962 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 2 years on.

Visit github.com ↗Alternativestop 14% of February 2024

In plain words

OpenLLMetry-JS is an open-source SDK based on OpenTelemetry that provides traces and metrics for JavaScript and TypeScript applications using large language models. Built for developers who already use monitoring tools like Datadog, New Relic, or Sentry, it integrates with 15+ existing observability platforms without requiring new tools. The SDK enables LLM applications to use the same monitoring infrastructure as traditional web applications.

written from the facts on this page · September 2026

From the sources

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry - traceloop/openllmetry-js

In the maker’s words, at launch

If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK…

Does a similar job

all alternatives →
  • OpenLLMetry – OpenTelemetry-based observability for LLMs2023 · github.com · ▲154

    Hey HN, Nir, Gal and Tomer here. We’re open-sourcing a set of extensions we’ve built on top of OpenTelemetry that provide visibility into LLM applications - whether it be prompts, vector DBs and more. Here’s the repo: https://github.com/traceloop/openllmetry. There’s already a decent number of tools for LLM observability, some open-source and some not. But what we found was missing for all of them is that they were closed-protocol by design, vendor-locking you to use their observability platform or their proprietary framework for running your LLMs. It’s still early in the…

  • Langfuse2023 · langfuse.com · ▲771

    Open source tracing and analytics for LLM applications

  • AI Observability by OpenObserveAug 2026 · openobserve.ai · ▲317

    OpenTelemetry-native observability for agents and LLMs

  • TraceLLMJul 2026 · tracellm.in · ▲100

    OpenTelemetry for production AI applications

  • Openlit2024 · openlit.io · ▲152

    One click observability & evals for LLMs & GPUs

  • traceAIApr 2026 · github.com · ▲273

    Open-source LLM tracing that speaks GenAI, not HTTP.

Questions this answers

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 19d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 19d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 22d ago · stillwet.art

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

  • Route requests to the right LLM for cost, latency & quality

    AI · 23d ago · fastrouter.ai

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, February 2024

the whole month →
  • Flipner AI▲1,623

    Capture your ideas & craft texts with AI's touch

    AI · 2024 · flipner.webflow.io

  • Typeframes▲1,315

    Video creation for makers

    Work · 2024 · revid.ai

  • Superlist▲1,252

    The task layer for your AI agents

    Work · 2024 · superlist.com

  • Never run out of marketing ideas ever again

    Growth · 2024 · marketingideas.com

  • Layers▲1,198

    A home for designers

    Work · 2024 · layers.to

  • Heyday▲1,178

    AI copilot for your own research, notes & conversations

    AI · 2024 · heyday.xyz