Joinoptimai – Test, Track, Compare AI Responses
Hey HN! My name is Paulo. I made this (free) web app https://www.joinoptimai.com to test, track, and iterate on AI prompts. It tests your prompts against datasets that you upload and layers that over a nice UI so you can flag AI responses & compare different prompt responses in a GitHub diff-like view. This can be used to show stakeholders how your AI response quality is iterating over time. Would love to hear your feedback. Thanks!
Joinoptimai – Test, Track, Compare AI Responses launched on September 4, 2024 with 6 votes, #2,184 of 5,281 launches that month and more than 50% of that year's launches.
Does a similar job
all alternatives →
thisorthis.ai2024 · thisorthis.ai · ▲135Hey HN — I'm Parth, I built thisorthis.ai because I was tired of copy-pasting the same prompt across ChatGPT, Claude, and Gemini tabs to figure out which model actually gave the best answer. What it does: You type one prompt, pick 2–6 models (we support 47 text models and several image models across OpenAI, Anthropic, Google, xAI, Meta, Amazon, Mistral, Cohere, AI21), and see every response side-by-side. There's also a feature called SmartPick that uses an LLM evaluator to score each response on Clarity, Accuracy, Completeness, and Helpfulness — useful when you're comparing 6 models and…


Visual inference exploration and experimentation playground2024 · github.com · ▲46Most inference UIs that I've come across pretty much just give us a chat-like interface to toy around with models in a single visual conversation thread. Given the fact that we are limited to seeing only one output at a time, it's kind of hard to compare outputs from different models, adjustments made to the prompting, and sampler settings. But even when keeping the generation parameters the same (e.g., to test for reliability in the output) and just going for multiple passes, there is no easy way to have a side-by-side comparison to keep track of the outputs from the multiple "rounds". I…


More ai this month
the category →



Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art

PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, September 2024
the whole month →

BeforeSunset AI 2.0▲1,267Personalized AI daily planning that suits your life
AI · 2024 · beforesunset.ai


