nowfound

AI · April 25, 2024

LO

Langtrace – OpenTelemetry-Based LLM App Observability

Hey HN, Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic and Cohere, popular frameworks like Langchain and LlamaIndex and vectorDBs like ChromaDB and Pinecone. The LLM monitoring/evaluations space has seen a number of products off late, both open source and closed source ones. But, a couple of things we have observed are: lack of…

Langtrace – OpenTelemetry-Based LLM App Observability launched on April 25, 2024 with 9 votes, #1,245 of 4,347 launches that month and more than 75% of that year's launches.

What it does

In the maker’s words, at launch

Hey HN, Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic…

Does a similar job

all alternatives →
  • Langfuse2023 · langfuse.com · ▲771

    Open source tracing and analytics for LLM applications

  • Langtrace AI2024 · langtrace.ai · ▲119

    Improve your LLM apps with open-source observability tool

  • Langtrace – OpenTelemetry-Based Client & SDK for LLM App Observability2024 · github.com · ▲6

    Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊 - Scale3-Labs/langtrace

  • OpenLLMetry – OpenTelemetry-based observability for LLMs2023 · github.com · ▲154

    Hey HN, Nir, Gal and Tomer here. We’re open-sourcing a set of extensions we’ve built on top of OpenTelemetry that provide visibility into LLM applications - whether it be prompts, vector DBs and more. Here’s the repo: https://github.com/traceloop/openllmetry. There’s already a decent number of tools for LLM observability, some open-source and some not. But what we found was missing for all of them is that they were closed-protocol by design, vendor-locking you to use their observability platform or their proprietary framework for running your LLMs. It’s still early in the…

  • Langfuse – Open-source observability and analytics for LLM apps2023 · github.com · ▲143

    Hi HN! Langfuse is OSS observability and analytics for LLM applications (repo: https://github.com/langfuse/langfuse, 2 min demo: https://langfuse.com/video, try it yourself: https://langfuse.com/demo) Langfuse makes capturing and viewing LLM calls (execution traces) a breeze. On top of this data, you can analyze the quality, cost and latency of LLM apps. When GPT-4 dropped, we started building LLM apps – a lot of them! [1, 2] But they all suffered from the same issue: it’s hard to assure quality in 100% of cases and even to have a clear view…

  • traceAIApr 2026 · github.com · ▲273

    Open-source LLM tracing that speaks GenAI, not HTTP.

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 17d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 19d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 29d ago · world.pixverse.video

  • Hemory▲381

    Keep listening. Searchable memory for your AI agents.

    AI · 30d ago · hemory.com

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, April 2024

the whole month →
  • Supabase▲2,325

    The Postgres developer platform is now generally available

    Dev tools · 2024 · supabase.com

  • Build your pixel-perfect booking experience with Atoms

    Dev tools · 2024 · cal.com

  • PaddleBoat▲1,162

    Perfect your sales pitch with realistic AI roleplays

    AI · 2024 · padboat.com

  • deco.cx 2.0▲1,078

    Build web apps 10x faster with Deno, JSX, TS & Tailwind

    Dev tools · 2024 · decocms.com

  • IXORD AI▲955

    Navigate tasks, ignite creativity

    AI · 2024

  • A central nervous system for all your productivity apps

    AI · 2024 · getassista.com