AI · alternatives · 2026

24 alternatives to Axilla – Open-source TypeScript framework for LLM apps

Hi HN, we are Nick and Ben, creators of Axilla - an open source TypeScript framework to develop LLM applications. It’s in the early stages but you can use it today: we’ve already published 2 modules and have more coming soon. Ben and I met while working at Cruise on the ML platform for self-driving cars. We spent many years there and learned the hard way that shipping AI is not quite the same as shipping regular code. There are many parts of the ML lifecycle, e.g., mining, processing, and labeling data and training, evaluating, and deploying models. Although none of them are rocket science,…

Axilla is an open-source TypeScript framework for building applications with large language models. Created by former Cruise engineers, it provides tools for developing LLM apps and currently includes two published… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier. Axilla – Open-source TypeScript framework for LLM apps launched in 2023; newer entries below may have overtaken it.

1
Zero-dependency, TypeScript SDK for building robust NLP applications▲16
Hey HN! We just released a new library for building LLM-powered applications: @axflow/models. It is part of a larger suite of libraries we're developing for TypeScript developers working with generative AI. This library provides the simplest APIs for 1) invoking the most popular LLM and embedding models (openai, anthropic, cohere, huggingface, etc.) 2) streaming LLM responses to clients, including augmenting the streams with additional arbitrary data and 3) building client-side applications with React hooks. @axflow/models has zero dependencies and is built using only the…
2023 · docs.axflow.dev · its alternatives →
2
Mastra 1.0▲451
Hi HN, we’re Sam, Shane, and Abhi, and we’re building Mastra (https://mastra.ai), an open-source JavaScript SDK for building agents on top of Vercel’s AI SDK. You can start a Mastra project with `npm create mastra` and create workflow graphs that can suspend/resume, build a RAG pipeline and write evals, give agents memory, create multi-agent workflows, and view it all in a local playground. Previously, we built Gatsby, the open-source React web framework. Later, we worked on an AI-powered CRM but it felt like we were having to roll all the AI bits (agentic workflows, evals,…
Jan 2026 · github.com · its alternatives →
3
TensorZero▲307
Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
4
Nous – Open-Source Agent Framework with Autonomous, SWE Agents, WebUI▲155
Hello HN! The day has finally come to stop adding features and start sharing what I've been building the last 5-6 months. It's a bit of CrewAI, OpenDevon, LangFuse/Cloud all in one, providing devs who prefer TypeScript an integrated framework thats provides a lot out of the box to start experimenting and building agents with. It started after peeking at the LangChain docs a few times and never liking the example code. I began experimenting with automating a simple Jira request from the engineering team to add an index to one of our Google Spanner databases (for context I'm the…
2024 · github.com · its alternatives →
5
Langfuse▲771
Open source tracing and analytics for LLM applications
2023 · langfuse.com · its alternatives →
6
Llama 2▲263
The next generation of Meta's open source LLM
2023 · developer.meta.com · its alternatives →
7
OpenRouter Model Fusion▲144
Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…
Apr 2026 · openrouter.ai · its alternatives →
8
Skyvern – Browser automation using LLMs and computer vision▲422
Hey HN, we're building Skyvern (https://www.skyvern.com), an open-source tool that uses LLMs and computer vision to help companies automate browser-based workflows. You can see some examples here: https://github.com/Skyvern-AI/skyvern#real-world-examples-of... and there's a demo video at https://github.com/Skyvern-AI/skyvern#demo, along with some instructions on running it locally. We provide a natural-language API to automate repetitive manual workflows that happen within the companies' backoffices. You can check out our code and play with…
2024 · github.com · its alternatives →
9
LLM Gatewayfree tier▲296
I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
10
OpenUI▲322
Thesys just open-sourced their generative UI rendering engine. Interesting timing given where Google a2ui and Vercel's json-render are headed. The difference worth noting: a2ui and json-render both treat JSONL as the contract between the LLM and the renderer. Thesys is betting that's the wrong primitive. Their engine uses a code-like syntax (OpenUI Lang) instead — LLM writes it, renderer executes it. The argument is that LLMs are fundamentally better at generating code than generating structured data, so you get cleaner output and ~67% fewer tokens. The broader vision seems to be a…
Mar 2026 · openui.com · its alternatives →
11
AI-assisted Contember Studio▲271
From concept to web app in minutes, fine-tune in TypeScript
2023 · contember.com · its alternatives →
12
Open-Source Alternative to OpenAI Platform, for Local Models▲93
Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.
2025 · github.com · its alternatives →
13
RΞASON – Open-source TypeScript framework for LLM apps▲16
Hi HN! I'm Inacio, the author of REASON. I've been tinkering with LLMs since the GPT-3 API's release May 2020. Seeing the emergence of many frameworks in the last 15 months has been exciting. While many understandably focused on launching quick, I found myself intrigued by a different question: what would a thoughtful, first-principles approach look like? This curiosity led to a personal project, RΞASON, a minimalistic open-source TypeScript framework. It's been a couple of months of digging deep and learning a ton, and I'm eager to share it and grow it with insights from all of you. In the…
2023 · tryreason.dev · its alternatives →
14
Code Mode▲144
I’ve been testing a simple idea inspired by Apple/Cloudflare/Anthropic: LLMs are far better at writing a small program than coordinating multiple tool calls. So instead of giving the model 10+ tools, I exposed one: a TypeScript sandbox with access to the same interfaces. The model writes a script → it runs once → done. What changed - +68% reduction in token use - No multi-step drift or retries - Local models (Llama 3.1 8B / Phi-3) became much more reliable Repo: https://github.com/universal-tool-calling-protocol/code-mode Curious whether others have seen…
Nov 2025 · github.com · its alternatives →
15
Open-source real time data framework for LLM applications▲92
Hey HN, I am the founder of Tensorlake. Prototyping LLM applications have become a lot easier, building decision making LLM applications that work on constantly updating data is still very challenging in production settings. The systems engineering problems that we have seen people face are - 1. Reliably process ingested content in real time if the application is sensitive to freshness of information. 2. Being able to bring in any kind of model, and run different parts of the pipeline on GPUs and CPUs. 3. Fault Tolerance to ingestion spike, compute infrastructure failure. 4. Scaling compute,…
2024 · getindexify.ai · its alternatives →
16
Opik, an open source LLM evaluation framework▲86
Hey HN! I'm Caleb, one of the contributors to Opik, a new open source framework for LLM evaluations. Over the last few months, my colleagues and I have been working on a project to solve what we see as the most painful parts of writing evals for an LLM application. For this initial release, we've focused on a few core features that we think are the most essential: - Simplifying the implementation of more complex LLM-based evaluation metrics, like Hallucination and Moderation. - Enabling step-by-step tracking, such that you can test and debug each individual component of your LLM application,…
2024 · github.com · its alternatives →
17
Building an LLM from Scratch in TypeScript▲33
The from-scratch guide to building large language models in NodeJS.
7d ago · book.humanexperiences.io · its alternatives →
18
RΞASON – Open-source TypeScript framework for LLM apps▲7
Hi HN! RΞASON is an OSS Typescript framework for developing LLM apps that uses Typescript's interfaces to get structured output from an LLM. While there are other TS LLM frameworks, I think RΞASON fills a unique space in the market: it's laser-focused on only three areas and, most importantly, actively stays away from pre-made prompting & retrieval. I've been in the LLM space since GPT-3 originally came out, and I've always had problems with other frameworks, such as LangChain. I dislike that they focus a ton on out-of-the-box prompting & pre-made agents — I, as the dev, should be the one in…
2023 · github.com · its alternatives →
19
LLMWare – Small Specialized Function Calling 1B LLMs for Multi-Step RAG▲51
Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…
2024 · github.com · its alternatives →
20
Output.ai - OSS framework we extracted from 500+ production AI agents▲40
Open-source TypeScript framework for AI dev: prompts, evals, tracing, cost tracking, security, and durable execution. Built for Claude Code.
Apr 2026 · output.ai · its alternatives →
21AG
AxonFlow, governing LLM and agent workflows▲11
Hi HN, we’re building AxonFlow for teams running LLMs or agents in real production systems. Once agent workflows move past demos, failures are rarely model issues. They tend to show up as execution problems during real runs. Short 2-minute technical demo showing execution control and auditability in practice: https://youtu.be/FNgnESo9RtI AxonFlow is a self-hosted, source-available (BSL 1.1) control plane that sits inline in the execution path and governs LLM calls, tool calls, retries, approvals, and policy enforcement step by step. It does not replace your orchestrator and…
Jan 2026 · its alternatives →
22UD
Unify – Dynamic LLM Benchmarks and SSO for Multi-Vendor Deployment▲91
Hey HN! I’m the founder of Unify, and we’ve just released our Model Hub, which provides a collection of LLM endpoints with live runtime benchmarks all plotted across time: https://unify.ai/hub A key finding is that static tabular runtime benchmarks for LLMs simply do not work. It’s necessary to take a time-series perspective, and plot the variations through time. We currently have 21 models provided by: Anyscale, Perplexity AI, Replicate, Together AI, OctoAI, Mistral AI and OpenAI, with more on the roadmap. We test across different regions (Asia, US, Europe), with varied…
2024 · its alternatives →
23
LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)▲45
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
24
Open-source ETL framework to sync data from SaaS tools to vector stores▲63
Hey hacker news, we launched a few weeks ago as a GPT-powered chatbot for developer docs, and quickly realized that the value of what we’re doing isn’t the chatbot itself. Rather, it’s the time we save developers by automating the extraction of data from their SaaS tools (Github, Zendesk, Salesforce, etc) and helping transform it to contextually relevant chunks that fit into GPT’s context window. A lot of companies are building prototypes with GPT right now and they’re all using some combination of Langchain/Llama Index + Weaviate/Pinecone + GPT3.5/GPT4 as their stack for…
2023 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →