Paramount is an OSS package that captures expert feedback on LLM chats
Hey HN, Hakim here from Fini (YC S22). We've seen first hand how AI chat projects pan out, and so have released an OSS library to ensure the industry gets more tools for improving outcomes. Many AI chat projects are scrapped due to persistent inaccuracies in LLM responses. Paramount is an open-source Python package designed to bridge the gap between LLM-generated and ideal responses by incorporating expert feedback directly into the evaluation process. It provides a robust framework for recording LLM function outputs (ground truth data) and facilitates agent evaluations, reducing the time to…
Paramount is an OSS package that captures expert feedback on LLM chats launched on May 3, 2024 with 9 votes, #1,332 of 4,539 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.
What it does
Agent accuracy measurements for LLMs. Contribute to ask-fini/paramount development by creating an account on GitHub.
In the maker’s words, at launch
Hey HN, Hakim here from Fini (YC S22). We've seen first hand how AI chat projects pan out, and so have released an OSS library to ensure the industry gets more tools for improving outcomes. Many AI chat projects are scrapped due to persistent inaccuracies in LLM responses. Paramount is an open-source Python package…
Does a similar job
all alternatives →
Paramount – Human Evals of AI Customer Support2024 · github.com · ▲71Hey HN, Hakim here from Fini (YC S22), a startup focused on providing automated customer support bots for enterprises that have a high volume of support requests. Today, one of the largest use cases of LLMs is for the purpose of automating support. As the space has evolved over the past year, there has subsequently been a need for evaluations of LLM outputs - and a sea of LLM Evals packages have been released. "LLM evals" refer to the evaluation of large language models, assessing how well these AI systems understand and generate human-like text. These packages have recently relied on…
- Helpedby AI2025 · chat.helpedby.ai · ▲122
Revolutionize LLMs chat platform with pay-as-you-go pricing
Chord - AI Group Chats2025 · chord.chat · ▲164Hey everyone, I've been hacking on this idea with a friend as we've been using chatgpt and other AI tools in our day to day work and find ourselves copy/pasting to each other frequently. We often share chatgpt links with each other, but it's been frustrating that they are read-only and we can't pickup the conversation or both talk to an LLM with shared context. We built a shared chatroom to explore what it'd be like to talk with multiple LLMs and humans in the same chat, and so far it feels pretty cool, but we're curious if anyone else would find it useful as well. Right now you can: -…
Humans vs LLMs2025 · aipageready.com · ▲138Hi HN, We just launched [AI Page Ready](https://aipageready.com) — a tool to check if your web pages are discoverable and understandable by AI tools like ChatGPT, Claude, Gemini, and Perplexity. It runs 40+ checks across six areas: Discoverability & Crawlability, Structured Data & Semantics, Content Quality, Answer-Ready Formatting, Accessibility & Rendering, and Deep AI LLM-specific checks. Would love your feedback — especially if you work in eCommerce, SEO, content, SaaS, or are trying to get traffic from AI tools. (Also open to ideas on what else to add to the tool!)
- IBI built an LLM chat app because we shouldn't need 10 AI subscriptions2025 · prismharmony.com · ▲58
I'm lost between ChatGPT vs Claude vs Gemini... which subscriptions to take? With Cursor and all these specific AI tools, I just wanted one simple chat app where I can use any model and pay only when I use it. Couldn't find one, so I built one. Pay only for what you use. Your prompts and docs, knowledge bases work with every model - no more copy-pasting between apps. Started as a personal project, but thought someone else might benefit from this too. https://prismharmony.com/chat What do you think?
Another LLM Chat App to avoid having 10 different subscriptions and MCP2025 · donsir.com · ▲18This is like ChatGPT but simpler, with less features (for now). It offers unlimited access to o3, Claude Sonnet 4 and other models for the pro plan. It offers access to o4-mini and the like for the free version. Requests are unlimited up to rate limits that we hope apply to less than 2% of users (they're transparent and can be seen on the account page). I was sick of having these like t3.chat or abacus.ai that give you very few messages for the $8-$10 / month subscription, so wanted to create something closer to Cursor's new pricing but transparent. Image generation will come soon, I…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
