Dev tools · alternatives · 2026
24 alternatives to Catsu: A unified Python client for embedding APIs
We open-sourced catsu, a Python client for embedding APIs. The problem: every embedding provider has a different SDK with different bugs. OpenAI has undocumented token limits. VoyageAI's retry logic was broken until September. Cohere breaks downstream libraries every release. LiteLLM's embedding support is minimal. catsu provides: - One API for 11 providers (OpenAI, Voyage, Cohere, Jina, Mistral, Gemini, etc.) - Bundled database of 50+ models with pricing, dimensions, and benchmark scores - Built-in retry with exponential backoff - Automatic cost tracking per request - Full async support…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
After working with LLMs for long enough, I found myself wanting a lightweight utility for doing various small tasks to prepare inputs, locate information and create evaluators. This library is two things: a very simple model and utilities that inference it (eg. fuzzy deduplication). The target platform is CPU, and it’s intended to be light, fast and pip installable — a library that lowers the barrier to working with strings semantically. You don’t need to install pytorch to use it, or any deep learning runtimes. How can this be accomplished? The model is simply token embeddings that are…
2024 · github.com · its alternatives →
- 2
Opper AI▲229Hey HN! After the Car Wash Test post got quite a big discussion going (400+ comments, https://news.ycombinator.com/item?id=47128138), I spent the past few weeks building a tool so anyone can run these kinds of questions and get structured results. No signup and free to use. You type a question, define answer options, pick up to 50 models at a time from a pool of 200+, and they all answer independently under identical conditions. No system prompt, structured output, same setup for every model. You can also run a debate round where models see each other's reasoning and get a…
Jul 2026 · opper.ai · its alternatives →
- 3
I built this library because langchain was too bloated and I needed a simple abstraction to call multiple LLM APIs. litellm has two functions - completion(), embedding()
2023 · github.com · its alternatives →
- 4
Author here. I just wanted a quick and easy way to easily submit strings to a REST API and get back the embedding vectors in JSON using Llama2 and other similar LLMs, so I put this together over the past couple days. It's very quick and easy to set up and totally self-contained and self-hosted. You can easily add new models to it by simply adding the HuggingFace URL to the GGML format model weights. Two models are included by default, and these are automatically downloaded the first time it's run. It lets you not only submit text strings and get back the embeddings, but also to compare two…
2023 · github.com · its alternatives →
- 5
Everything that would be here is in the README. I hope this gets big, it has tons of potential.
2013 · github.com · its alternatives →
- 6AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 7AO
Hi, I'm Ben, the co-creator of Embedbase. Embedbase lets you use OpenAI Embeddings and Pinecone seamlessly. For example, you can add Embedbase to your app and pair it with GPT3 to allow people to search using natural language (e.g. How many workouts did I complete last week?), or simply expanding your current search experience beyond full-text search (e.g. looking for "similar" documents in Notion to find other related information) Managing embeddings is uncharted territory, we needed to discover the best practices ourselves. Now we're happy to share our learnings with Embedbase. Shoot if…
2023 · embedbase.xyz · its alternatives →
- 8
Hey HN! We've run our privacy-focused open-source inference company for a while now, and we're launching a flat monthly subscription similar to Anthropic's. It should work with Cline, Roo, KiloCode, Aider, etc — any OpenAI-compatible API client should do. The rate limits at every tier are higher than the Claude rate limits, so even if you prefer using Claude it can be a helpful backup for when you're rate limited, for a pretty low price. Let me know if you have any feedback!
2025 · synthetic.new · its alternatives →
- 9
We’ve recently open-sourced Model2vec, a method to distill sentence transformers into static embeddings that outperform all previous approaches by a large margin on MTEB. Our new models set a new state-of-the-art for static embeddings. Main features: - Our best model (potion-base-8M) has only 8M parameters, which is ~30mb on disk - Inference is ~500x faster than the distilled base model (bge-base), on a CPU - New models can be distilled in 30 seconds on a CPU without requiring a dataset - just a vocabulary - Numpy-only inference: The packaged can be install the package with minimal…
2024 · github.com · its alternatives →
- 10
Library makes requests asynchronously across models, so you can spend a lot of $$ quickly if you want XD. But seriously I hope this enables folks to create and run evals (especially safety ones) a lot easier than before.
2024 · github.com · its alternatives →
- 11
Drop in replacement for OpenAI's embedding API. Can be used with official OpenAPI libraries. Written in python3
2023 · github.com · its alternatives →
- 12AB
Hello HN, new user here, so please let me know if I break some rules. Currently I've been working on training reinforcement learning agents, and OpenAI gym, while is great, runs only one agent at a time. Hence I decided to extend it. I built a wrapper around OpenAI gym, such that it now runs several environments concurrently. All while (mostly) having the same call signature as OpenAI gym. And it is published to PyPI for anyone interested. For more details, please visit: https://github.com/Chimpan-Z/agymc Feedback really appreciated! Have a good day everyone!
2020 · its alternatives →
- 13IB
I had 14,000 photos sitting on a drive and wanted an excuse to play with local vision models and Elixir/Phoenix. I originally tried to get LLaVA to tell me if a photo was 'good' or matched my style, but quickly learned that LLMs have terrible taste. I ended up demoting the LLM to just extract metadata, and built a custom CLIP/Ridge Regression pipeline to actually learn my preferences based on how I rate things. The stack is Phoenix/Oban on the orchestrator side, and Python/FastAPI/Instructor for the AI workers. Happy to answer any questions about the architecture,…
Apr 2026 · qwelian.com · its alternatives →
- 14
I wanted to share a project I've been working on for the past few weeks: llgtrt. It's a Rust implementation of a HTTP REST server for hosting Large Language Models using llguidance library for constrained output with NVIDIA TensorRT-LLM. The server is compatible with the OpenAI REST API and supports structured JSON schema enforcement as well as full context-free grammars (via Guidance). It's similar in spirit to the Python-based TensorRT-LLM OpenAI server example but written entirely in Rust and built with constraints in mind. No Triton Inference Server involved. This also serves as a demo…
2024 · github.com · its alternatives →
- 15
Quick note on how it works and how I've done my batch embedding engine IgniteMS. The whole thing runs as one process using Rust, reading input, tokenizing, packing batches, keeping the queue full. TensorRT handles inference. Python is only as a wrapper. I built it this way because when you use more than couple of GPUs, the GPUs stop being the problem. CPU cannot feed them fast enough. One A100 can go through batches faster than Python can tokenize and feed, so the GPU just sits there idle waiting for work. Most of my time went into optimizing this. At 8 GPUs that was basically the entire…
Jun 2026 · github.com · its alternatives →
- 16PA
Hi HN, I’m experimenting with a small Python library called PicoFlow for building LLM agent workflows using a lightweight DSL. I’ve been using tools like LangChain and CrewAI, and wanted to explore a simpler, more function-oriented way to compose agent logic, closer to normal Python control flow and async functions. PicoFlow focuses on: - composing async functions with operators - minimal core and few concepts to learn - explicit data flow through a shared context - easy embedding into existing services A typical flow looks like: flow = plan >> retrieve >> answer await flow(ctx) Patterns…
Jan 2026 · its alternatives →
- 17PF
Introducing embeds.ai: an embedding playground to compare how embedding models work on a real world use case (retrieval augmented generation for Wikipedia articles + Elad Gil's High growth handbook) A few weeks ago, Shreyan and I were looking for an embedding model to use for RAG. We eventually came across the MTEB leaderboard, but we struggled to understand the benchmark scores. We wanted a tool to test various embedding models with example queries on real-world datasets. After unsuccessfully looking for such a “playground”, we decided to just build one ourselves! We embedded HuggingFace’s…
2023 · embeds.ai · its alternatives →
- 18
Hi all, so I've been working on this low to no code platform that allows you to spin up deep learning workloads(I'm talking LLM's, Huggingface models, etc), interconnect a bunch of them, and deploy them as API's. The idea essentially came up early in September, when experimenting with combining a Huggingface based BERT model with an LLM at work, and I realized it would be cool if I could do that instantly(especially since it was a prototype). At the time, I was considering a platform that could essentially help you train deep learning models without any code. It was my observation that much…
2024 · github.com · its alternatives →
- 19
LinkingMem — Graph-native RAG Engine
Jun 2026 · its alternatives →
- 20
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai · its alternatives →
- 21
Frustrated by the inability to play with semantic search / ANN in Go w/o a heavy-weight external DB, I created this HNSW library. I hope other gophers find it useful.
2024 · github.com · its alternatives →
- 22
Hey HN, we're excited to show you client-vector-search, a client-side library that helps you embed, store, search, and cache vectors in your browser or node env. We needed it at https://searchbase.app and that's why we've built it. with it you get: 1. easy setup: you only need to add 5 lines of code to build a semantic search 2. no embedding api needed: you don't need an api and have to pay for it unless ure scaling up millions 3. faster search: modern hardware is better than cheap cloud computers (0.5vCPUs) 4. zero latency: no back-and-forth with server-side 5. easy integration…
2023 · clientvectorsearch.com · its alternatives →
- 23SB
Hey HN! My brothers and I have worked on this for the last 2 weeks. We use OpenAI's `text-embedding-ada-002` model to embed queries and a vector database to search for similar verses / blocks of verses. We'd like to see what you think and appreciate any feedback!
2023 · siliconscripture.org · its alternatives →
- 24
Hi, I'm working on a project that regroups all best AI (AIaaS) from different providers (GCP, AWS, Azure, DeepL, etc.) in one API (https://github.com/edenai/edenai-apis). I've got asked the question : why aren't you regrouping Open Source models (instead of proprietary APIs) into one repo? Well because it doesn't make sens to deploy and maintain large pytorch (or other framework) AI models (especially for document parsing, image and video moderation or speech recognition) in every solution that wants AI capabilities. So using APIs makes way more sens. Deployed OpenSource…
2023 · github.com · its alternatives →
Also compare
- Wordllama – Things you can do with the token embeddings of an LLM alternatives
- Opper AI alternatives
- Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O alternatives
- Llama2 Embeddings FastAPI Server alternatives
- I started a repo for sharing algorithm implementations alternatives
- A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted) alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →