Comet LLM - Open-source prompt management and analytics
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. - comet-ml/opik
Comet LLM - Open-source prompt management and analytics launched on March 13, 2024 with 19 votes, #1,160 of 4,270 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
Comet LLM is an open-source platform for managing prompts and analyzing their performance. It helps developers and AI teams organize, track, and optimize prompts used with language models. The tool provides analytics capabilities to monitor how prompts perform across different scenarios and use cases. Available on GitHub, it serves technical teams working with large language models who need better visibility and control over their prompt workflows.
written from the facts on this page · September 2026
Does a similar job
all alternatives →
PromptTools – open-source tools for evaluating LLMs and vector DBs2023 · github.com · ▲211Hey HN! We’re Kevin and Steve. We’re building PromptTools (https://github.com/hegelai/prompttools): open-source, self-hostable tools for experimenting with, testing, and evaluating LLMs, vector databases, and prompts. Evaluating prompts, LLMs, and vector databases is a painful, time-consuming but necessary part of the product engineering process. Our tools allow engineers to do this in a lot less time. By “evaluating” we mean checking the quality of a model's response for a given use case, which is a combination of testing and benchmarking. As examples: - For generated…
Latitude2024 · latitude.so · ▲685Open-source AI agent monitoring platform. Full observability into what
Laminar – Open-Source DataDog + PostHog for LLM Apps, Built in Rust2024 · github.com · ▲203Hey HN, we’re Robert, Din and Temirlan from Laminar (https://www.lmnr.ai), an open-source observability and analytics platform for complex LLM apps. It’s designed to be fast, reliable, and scalable. The stack is RabbitMQ for message queues, Postgres for storage, Clickhouse for analytics, Qdrant for semantic search - all powered by Rust. How is Laminar different from the swarm of other “LLM observability” platforms? On the observability part, we’re focused on handling full execution traces, not just LLM calls. We built a Rust ingestor for OpenTelemetry (Otel) spans with GenAI…
Opik, an open source LLM evaluation framework2024 · github.com · ▲86Hey HN! I'm Caleb, one of the contributors to Opik, a new open source framework for LLM evaluations. Over the last few months, my colleagues and I have been working on a project to solve what we see as the most painful parts of writing evals for an LLM application. For this initial release, we've focused on a few core features that we think are the most essential: - Simplifying the implementation of more complex LLM-based evaluation metrics, like Hallucination and Moderation. - Enabling step-by-step tracking, such that you can test and debug each individual component of your LLM application,…
Open CometApr 2026 · opencomet.onrender.com · ▲117The autonomous AI browser agent for deep research & tasks
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, March 2024
the whole month →
🌐 The Internet Computer! Free, Open-Source, and Self-Hostable. - HeyPuter/puter
Dev tools · 2024 · github.com
Microlaunch▲1,115Launch and get feedback on both the idea and product
Dev tools · 2024 · microlaunch.net
