AI · alternatives · 2026
24 alternatives to LangSmith General Availability
LLM application development, monitoring, and testing
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. LangSmith General Availability launched in 2024; newer entries below may have overtaken it.
- 1
LangSmith▲350Build and deploy LLM applications with confidence
2023 · langchain.com · its alternatives →
- 2
- 3
Langfuse▲771Open source tracing and analytics for LLM applications
2023 · langfuse.com · its alternatives →
- 4
- 5
LangWatch▲669Founder here. Langy is an AI engineer that lives inside our platform, LangWatch. It reads your production traces, writes Scenario tests and evaluations for the problems it finds, opens a pull request on your repo, and proves the fix by running those simulations in CI. A human still merges. Reachy robot from Hugging Face arrived on the same week we were planing on launching it, so we wanted to use for the launch. So we it wired to our Langy which actually lives on the platform, and asked it to test our own customer-support voice agent. On the video you can see it writing the agent tests…
2024 · langwatch.ai · its alternatives →
- 6
Hi HN! Langfuse is OSS observability and analytics for LLM applications (repo: https://github.com/langfuse/langfuse, 2 min demo: https://langfuse.com/video, try it yourself: https://langfuse.com/demo) Langfuse makes capturing and viewing LLM calls (execution traces) a breeze. On top of this data, you can analyze the quality, cost and latency of LLM apps. When GPT-4 dropped, we started building LLM apps – a lot of them! [1, 2] But they all suffered from the same issue: it’s hard to assure quality in 100% of cases and even to have a clear view…
2023 · github.com · its alternatives →
- 7
Langdock▲294Create, deploy, test & monitor ChatGPT plugins in minutes
2023 · langdock.com · its alternatives →
- 8
- 9Langtrace AI▲119
Improve your LLM apps with open-source observability tool
2024 · langtrace.ai · its alternatives →
- 10
Build LLM apps and plug AI into your team's operations
2023 · n8n.io · its alternatives →
- 11
Hey HN, I made Browser-Use, an open-source tool that lets (all Langchain supported) LLMs execute tasks directly in the browser just with function calling. It allows you to build agents that interact with web elements using natural language prompts. We created a layer that simplifies website interaction for LLMs by extracting xPaths and interactive elements like buttons and input fields (and other fancy things). This enables you to design custom web automation and scraping functions without manual inspection through DevTools. Hasn't this been done a lot of times? Good question, as a general…
2024 · github.com · its alternatives →
- 12
If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…
2024 · github.com · its alternatives →
- 13
A collection of production-ready reference architectures
2023 · github.com · its alternatives →
- 14LO
Hey HN, Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic and Cohere, popular frameworks like Langchain and LlamaIndex and vectorDBs like ChromaDB and Pinecone. The LLM monitoring/evaluations space has seen a number of products off late, both open source and closed source ones. But, a couple of things we have observed are: lack of…
2024 · its alternatives →
- 15PF
Hey everyone, I'm Petr. I'm excited to share LangTale Playground (https://langtale.ai/playground), a first-of-its-kind tool enabling anyone to experiment with OpenAI function calls without coding. Born out of a hackathon project, it's now a part of our broader LangTale platform aimed at tackling common developer challenges with Language Learning Models (LLM). These include prompt integration, testing and debugging, version control, auditing, and usage/cost management. Here's our tech stack: Next.js by Vercel, Tailwind CSS, OpenAI, PlanetScale's Vitess database, and the…
2023 · langtale.ai · its alternatives →
- 16
Aggregate uptime monitoring across OpenAI, Claude, and more
Apr 2026 · tools.lamatic.ai · its alternatives →
- 17
Recently featured in a LangChain blog https://blog.langchain.dev/empowering-development-with-flowt... , use LLMs to construct an API first runnable workflow with an IDE experience.
2024 · github.com · its alternatives →
- 18
- 19
Hi HN! Over the last several weekends, I've been building LLMFlows as an alternative to langchain. There's been a lot of discussion on the shortcomings of langchain in the past few weeks, but when I first tried it in March, I thought there are 3 main problems: 1. Too many abstractions 2. Hidden prompts and opinionated logic in chains which makes it hard to customize 3. Hard to debug This inspired me to try and build a framework that solves these 3 issues, and therefore I started building LLFlows with the "philosophy" of being "simple, explicit, and transparent." A few weekends later, I think…
2023 · github.com · its alternatives →
- 20
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊 - Scale3-Labs/langtrace
2024 · github.com · its alternatives →
- 21
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
- 22
- 23
Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app - GitHub - e2b-dev/code-interpreter: Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
2024 · github.com · its alternatives →
- 24
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →