Pezzo – Open-Source LLMOps Plaform Tailored for Developers
Hello HN, Introducing Pezzo – a developer-centric LLMOps platform designed to streamline Generative AI integrations. As Generative AI gains traction, we've observed a gap in tools catering to product teams and developers. Most are oriented toward ML/AI experts. That's why we created Pezzo - fully open-source under Apache 2.0. GitHub: https://github.com/pezzolabs/pezzo Why Pezzo? - Centralized Prompt Management: Think email templates but for prompts. Design, test, and publish prompts without undergoing an extensive release cycle. - Observability & Insights:…
In plain words
Pezzo is an open-source LLMOps platform built for developers integrating generative AI into their products. It provides centralized prompt management for designing and publishing prompts without complex release cycles, observability dashboards tracking costs and performance metrics across AI providers, and request caching to reduce expenses during development. The platform targets product teams and developers rather than ML specialists, and is available under the Apache 2.0 license.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hello HN, Introducing Pezzo – a developer-centric LLMOps platform designed to streamline Generative AI integrations. As Generative AI gains traction, we've observed a gap in tools catering to product teams and developers. Most are oriented toward ML/AI experts. That's why we created Pezzo - fully open-source under Apache 2.0. GitHub: https://github.com/pezzolabs/pezzo Why Pezzo? - Centralized Prompt Management: Think email templates but for prompts. Design, test, and publish prompts without undergoing an extensive release cycle. - Observability & Insights: Comprehensive dashboards that offer insights into cost metrics, AI provider expenses, success/error rates, and anomaly detection. Be in control of your AI operations. - Efficient Request Caching: Out-of-the-box caching reduces costs and redundancy. Especially valuable during local development with repetitive LLM requests. Future Roadmap: We're working on issue auto-suggestions, continuous prompt improvements, cost optimization, and security threat flagging, among other features. If you'd like to try it out, we've made our Cloud version available: https://pezzo.ai. Note: It runs the identical code as our open-source version! Additionally, we're always looking for contributors, so if you're interested - we'd love to hear from you.
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, August 2023
the whole month →
Lottielab▲871Create and ship lottie animations to sites and apps faster
Dev tools · 2023 · lottielab.com
- LC
Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…
AI · 2023 · github.com