nowfound

AI · February 14, 2024

YD

You don't need to adopt new tools for LLM observability

If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…

In plain words

OpenLLMetry-JS is an open-source SDK based on OpenTelemetry that provides traces and metrics for JavaScript and TypeScript applications using large language models. Built for developers who already use monitoring tools like Datadog, New Relic, or Sentry, it integrates with 15+ existing observability platforms without requiring new tools. The SDK enables LLM applications to use the same monitoring infrastructure as traditional web applications.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched the python flavor here (https://news.ycombinator.com/item?id=37843907) and we've now built a compatible one for Node.js. Would love to hear your thoughts and opinions! Check it out - Docs: https://www.traceloop.com/docs/openllmetry/getting-started-t... Github: https://github.com/traceloop/openllmetry-js https://github.com/traceloop/openllmetry

More ai this month

the category →
  • I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 17d ago · simedw.com

  • Astute585

    Automate your B2B brand going viral, with new media creators

    AI · 18d ago · company-app.joinastute.com

  • Grok Bot547

    AI teammates that you can give real work to

    AI · 25d ago · x.ai

  • Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 27d ago · cactuscompute.com

  • Turn website visitors into qualified pipeline

    AI · 19d ago · clarasdr.ai

  • Kane CLI446

    Natural language browser & mobile app tests from terminal

    AI · 24d ago · testmuai.com

Launched alongside, February 2024

the whole month →
  • Flipner AI1,629

    Capture your ideas & craft texts with AI's touch

    AI · 2024 · flipner.webflow.io

  • Typeframes1,307

    Video creation for makers

    Work · 2024 · revid.ai

  • Superlist1,254

    Home to all your lists

    Work · 2024 · superlist.com

  • Never run out of marketing ideas ever again

    Growth · 2024 · marketingideas.com

  • Layers1,201

    A home for designers

    Work · 2024 · layers.to

  • Heyday1,178

    AI copilot for your own research, notes & conversations

    AI · 2024 · heyday.xyz