Medical LLM API on par with Google Med-PaLM 2. 92% USMLE accuracy
Hello HN! I’d like to share a medical question-answering API which has state-of-the-art performance on the USMLE self-assessment exam. You can try out the MediSearch API in 10 seconds in this Colab [https://tinyurl.com/medisearch-colab], or test the search engine live at MediSearch [https://medisearch.io]. See our API page [https://medisearch.io/api] to apply for access. Some technical highlights: 1. State-of-the-art accuracy of 92% on the USMLE self-assessment exam [https://tinyurl.com/medisearch-eval]. 2. Ranked 2nd on MedQA benchmark,…
In plain words
MediSearch is a medical question-answering API that achieves 92% accuracy on USMLE self-assessment exams and ranks second on the MedQA benchmark. It is designed for developers building medical applications, such as chatbots or search features within healthcare software. The API provides answers with article references to support clinical decision-making and medical research.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hello HN! I’d like to share a medical question-answering API which has state-of-the-art performance on the USMLE self-assessment exam. You can try out the MediSearch API in 10 seconds in this Colab [https://tinyurl.com/medisearch-colab], or test the search engine live at MediSearch [https://medisearch.io]. See our API page [https://medisearch.io/api] to apply for access. Some technical highlights: 1. State-of-the-art accuracy of 92% on the USMLE self-assessment exam [https://tinyurl.com/medisearch-eval]. 2. Ranked 2nd on MedQA benchmark, closely tailing Google's Med-PaLM 2 (within ~2%). 3. The API provides article references as an output. We’d love to hear feedback from this community! We’ve seen people use the MediSearch API to implement a chat bot or search field within their app. Please note that MediSearch does not have a 100% accuracy. Therefore, a human professional should always make a final decision on the information suggested by MediSearch. You can use the MediSearch API similarly to the OpenAI API [https://pypi.org/project/medisearch-client/]. If you’d like access to the MediSearch API, please email [email protected] or visit our API page [https://medisearch.io/api]. Please specify your use case in the application.
Does the same job
all alternatives →
- ATA tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
- IBI built the LLM Comparison Tool I wish existed2025 · llm-stats.com · ▲7
I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
- SESearch engine for trustworthy medical information2023 · medisearch.io · ▲5
Hi HN, I’d like to share MediSearch with you. A few months ago, I had a knee injury and got several surgery options from doctors. I had to make an important decision, but the medical information search experience was terrible. The sites I found either did not answer my questions (long health blogs) or were too technical to easily understand (scientific papers). This gave me and my friend the idea for MediSearch. Our goal is to build a system that provides direct accurate answers to medical questions based on trustworthy sources. We’d like to make MediSearch helpful to everyone and we still…
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, August 2023
the whole month →
Lottielab▲871Create and ship lottie animations to sites and apps faster
Dev tools · 2023 · lottielab.com
- LC
Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…
AI · 2023 · github.com