Alternatives
Products that do what PyLLMs: – Connect and compare top AI models in Python does
Hi HN, We needed a simple way to connect to the top AI models to experiment, prototype and evaluate them. Main features: - Connect to top LLMs in few lines of code (currenly OpenAI, Anthropic and AI21 are supported) - Response meta includes tokens processed, cost and latency standardized across the models - Multi-model support: Get completitions from different models at the same time - LLM benchmark: Eevaluate models on quality, speed and cost The benchmark uses predefine questions to test AI reasoning abilities across a range of "hard" queries. The outputs are then automatically evaulauted…
- 1
- 2
- 3
- 4
- 5
- 6
- 7BO
Read the full blogpost at https://rach.codes/blog/Introducing-Bhumi (click on reader to see the technical breakdown!) AI inference should be fast, but in practice it’s painfully slow. Inference bottlenecks slow down LLM-powered chatbots and AI workflows everywhere. I built Bhumi to fix that. Bhumi is a Python library designed for developers, yet its performance-critical core is implemented in Rust (via PyO3) for near-native speed. This hybrid approach delivers up to 2.5x faster response times across providers like OpenAI, Anthropic, and Gemini—without changing the…
2025 · bhumi.trilok.ai
- 8BA
I built CodeLens.AI - a tool that compares how 6 top LLMs (GPT-5, Claude Opus 4.1, Claude Sonnet 4.5, Grok 4, Gemini 2.5 Pro, o3) handle your actual code tasks. How it works: - Upload code + describe task (refactoring, security review, architecture, etc.) - All 6 models run in parallel (~2-5 min) - See side-by-side comparison with AI judge scores - Community votes on winners (blind voting) - Each evaluation gets reflected in the overall AI model leaderboard, showing us best ones Why I built this: Existing benchmarks (HumanEval, SWE-Bench) don't reflect real-world developer tasks. I wanted to…
Oct 2025 · codelens.ai
- 9IM
Every time I wanted to use LLMs in my existing pipelines the integration was very bloated, complex, and too slow. This is why I created a lightweight library that works just like scikit-learn, the flow generally follows a pipeline-like structure where you “fit” (learn) a skill from sample data or an instruction set, then “predict” (apply the skill) to new data, returning structured results. High-Level Concept Flow Your Data --> Load Skill / Learn Skill --> Create Tasks --> Run Tasks --> Structured Results --> Downstream Steps And the bast part: Every step can be saved and reused as…
2025 · github.com
- 10PI
Hey HN, Hakim here from Fini (YC S22). We've seen first hand how AI chat projects pan out, and so have released an OSS library to ensure the industry gets more tools for improving outcomes. Many AI chat projects are scrapped due to persistent inaccuracies in LLM responses. Paramount is an open-source Python package designed to bridge the gap between LLM-generated and ideal responses by incorporating expert feedback directly into the evaluation process. It provides a robust framework for recording LLM function outputs (ground truth data) and facilitates agent evaluations, reducing the time to…
2024 · github.com
- 11RA
I built a local-first UI that adds two reasoning architectures on top of small models like Qwen, Llama and Mistral: a sequential Thinking Pipeline (Plan → Execute → Critique) and a parallel Agent Council where multiple expert models debate in parallel and a Judge synthesizes the best answer. No API keys, zero .env setup — just pip install multimind. Benchmark on GSM8K shows measurable accuracy gains vs. single-model inference.
Mar 2026 · github.com
- 12PL
Library makes requests asynchronously across models, so you can spend a lot of $$ quickly if you want XD. But seriously I hope this enables folks to create and run evals (especially safety ones) a lot easier than before.
2024 · github.com
- 13
- 14LA
We combined Stanford's ACE (agents learning from execution feedback) with the Reflective Language Model pattern. Instead of reading traces in a single pass, an LLM writes and runs Python in a sandbox to programmatically explore them - finding cross-trace patterns that single-pass analysis misses. The framework achieved 2x consistency improvement on τ2-bench.
Mar 2026 · github.com
- 15LO
Hi HN! I built LLM OneStop (https://www.llmonestop.com), a unified interface for accessing multiple AI language models in one place. The main problem I wanted to solve: constantly switching between different AI platforms, managing multiple subscriptions, and losing conversation context when comparing outputs across models. Key features: Switch between GPT-4, Claude, Gemini, Llama, and other models mid-conversation Compare responses side-by-side Single interface instead of juggling multiple tabs/subscriptions Free tier available to try it out (no credit card needed) "Connect"…
Nov 2025 · llmonestop.com
- 16RA
We built RapidFire AI, an open-source Python tool to speed up LLM fine-tuning and post-training with a powerful level of control not found in most tools: Stop, resume, clone-modify and warm-start configs on the fly—so you can branch experiments while they’re running instead of starting from scratch or running one after another. - Works within your OSS stack: PyTorch, HuggingFace TRL/PEFT), MLflow. - Hyperparallel search: launch as many configs as you want together, even on a single GPU - Dynamic real-time control: stop laggards, resume them later to revisit, branch promising configs in…
Sep 2025 · github.com
- 17OS
Companion is a free, open-source web app, featuring a Python REPL environment with an AI Tutor designed to support one’s learning and problem-solving in programming. I am leveraging the Hermes 3 405B model from Nous Research, hosted on Lambda’s Inference API. It's community-driven, 100% free, and open to all. I’d love your feedback and suggestions. Here's a short video where I demo the tool: https://www.youtube.com/watch?v=4Plt_sh_cIg&ab_channel=Rahul
2024 · companionai.dev
- 18PF
PD founder here. Building integrations with all of your customer's systems is a core challenge for every company building agentic AI solutions. Connect is the easiest way for your users to connect to over 2,400+ APIs and get access to 10,000+ tools, right in your product or AI agent. You can build in-app messaging, CRM syncs, vertical agents, and much more, all in a few minutes. Demo app - https://pipedream-connect-demo.vercel.app/ Quickstart - https://pipedream.com/docs/connect/quickstart You have full, code-level control over how these integrations…
2025 · pipedream.com
- 19AD
Ever wish you could get the best arguments for both sides of a debate? I built an AI-powered debate platform that pits language models against each other on controversial topics. Each AI is randomly assigned a side (pro/con). You vote before and after to see if you were persuaded. Most content today presents lopsided arguments. They provide strong points for one side, weak ones for the other. This project aims to surface the strongest arguments from both sides, using LLMs to simulate a fair debate. With enough usage, I want to use it to benchmark LLMs. My hypothesis is that randomly…
2025 · bot-bicker.vercel.app
- 20QA
I've built an aggregator for free Large Language Models that provides answer generation services. The project aims to make powerful AI accessible to everyone as I believe free LLMs may become a significant trend. Currently supported models: Qwen Series - Qwen 32B: Alibaba's 32B parameter model for Chinese/English content - Qwen 2.5 7B Instruct: Lightweight, responsive daily assistant DeepSeek Series - DeepSeek V3 0324: Specialized in long-text and domain knowledge - DeepSeek R1: Focused on mathematical and logical reasoning Google Series - Gemini 2.5 Pro: Google's latest multimodal…
2025 · qwq32.com
- 21HP
Hi HN. I heard you like dev tools and AI, so we wanted to share our project that we’ve been working on. We’re working on Horizon [1] - a higher level abstraction for LLMs so that developers can spend less time trying to grapple with LLMs to make them work and more time with users. This is the starting feature set which takes an auto-ML approach to identify the optimal LLM model, hyperparameters, and prompt - instead of just giving you the tooling to figure it out yourself. You can read more about it in our documentations. Our view is that as LLMs become increasingly commoditized and prompts…
2023 · gethorizon.ai
- 22AO
Hey HN, My workflow for any complex queries is to ask it in multiple AI chats (Gemini, Claude, o3,..) in parallel and then continue the conversation with the chat response that I found the most useful. I built a simple open source app that queries 10+ AI models at once and summarizes their answers with a selected combiner AI model. There's a GIF in the github repo that shows it in action. You can try it on your local machine: https://github.com/Nexarithm/multi_model_chat If you are interested, I also made a detailed blog post on technical details, feature of the personal…
2025 · github.com
- 23
- 24IB
Hey HN, I've been working on something cool that I wanted to share with you all. It's called Viewpoint, an analytics tool for LLMs like OpenAI, Anthropic models, and Gemini. The idea came from the constant flood of new LLM models and the need to figure out which ones work best for my projects without breaking the bank. With viewpoint, I can track token usage, costs, latency(WIP), and traffic over time, making it easier to compare different models and see which ones perform best and save money. The tool works asynchronously, so it doesn't add any latency to your LLM requests, and you have…
2024 · viewpointhq.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →