AI · alternatives · 2026

Open-Source Microservices Framework for Cross-LLM Apps is an AI framework launched in October 2023 that enables developers to build applications working across multiple language models. It uses a microservices… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier. Open-Source Microservices Framework for Cross-LLM Apps launched in 2023; newer entries below may have overtaken it.

1. 1
   Go Micro – A distributed systems development framework▲115

   I can't tell if HN is the right kind of place for this stuff anymore since people are so advanced in their use but I thought it was interesting to leverage my existing Go microservices framework and turn it into the core of what would provide tools for an agent cli or whatever beyond that. Extensibility is key. Thought I'd share and get a conversation going.

   2020 · go-micro.dev · its alternatives →

2. 2
   A microservice framework, listed in CNCF Landscape, 1 year 10k+ stars▲65

   A cloud-native Go microservices framework with cli tool for productivity. - zeromicro/go-zero

   2021 · github.com · its alternatives →

3. 3
   LLMWare▲358

   Dev tool to make AI apps to deploy privately or locally

   2024 · llmware.ai · its alternatives →

4. 4
   Open-Source Alternative to OpenAI Platform, for Local Models▲93

   Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.

   2025 · github.com · its alternatives →

5. 5
   Go Micro – A Go microservices development framework▲68

   Hi all, I wanted to reshare this after some time. I've been working on evolving my service framework into an agent harness. As all of this AI tooling has evolved its become clear to me that agents, services and workflows are part of a core system of operations which would benefit from a single framework. Previously Go Micro only enabled service development. But now it includes Agents and Workflows. What does that mean? Well firstly services which are registered in a central registry automatically become tools for agents. The service endpoints individually become callable tools via MCP.…

   2019 · go.micro.mu · its alternatives →

6. 6
   Langfuse▲771

   Open source tracing and analytics for LLM applications

   2023 · langfuse.com · its alternatives →

7. 7
   LLM Gatewayfree tier▲296

   I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

   2025 · llmgateway.io · its alternatives →

8. 8
   TensorZero▲307

   Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

   2025 · github.com · its alternatives →

9. 9
   Axilla – Open-source TypeScript framework for LLM apps▲161

   Hi HN, we are Nick and Ben, creators of Axilla - an open source TypeScript framework to develop LLM applications. It’s in the early stages but you can use it today: we’ve already published 2 modules and have more coming soon. Ben and I met while working at Cruise on the ML platform for self-driving cars. We spent many years there and learned the hard way that shipping AI is not quite the same as shipping regular code. There are many parts of the ML lifecycle, e.g., mining, processing, and labeling data and training, evaluating, and deploying models. Although none of them are rocket science,…

   2023 · github.com · its alternatives →

10. 10OM
    OAuth microservice for FB, Twitter, etc.▲127

    2017 · login-with.com · its alternatives →

11. 11SM
    Serverless meets Microservices▲191

    2016 · blog.leveros.com · its alternatives →

12. 12TL
    Tiny LLMs – Browser-based private AI models for a wide array of tasks▲142

    2023 · tinyllms.vercel.app · its alternatives →

13. 13
    SaaS Success with Microservices▲180

    Free guide: building high-growth SaaS applications

    2023 · hypertest.co · its alternatives →

14. 14
    Langtrace AI▲119

    Improve your LLM apps with open-source observability tool

    2024 · langtrace.ai · its alternatives →

15. 15
    Open-source real time data framework for LLM applications▲92

    Hey HN, I am the founder of Tensorlake. Prototyping LLM applications have become a lot easier, building decision making LLM applications that work on constantly updating data is still very challenging in production settings. The systems engineering problems that we have seen people face are - 1. Reliably process ingested content in real time if the application is sensitive to freshness of information. 2. Being able to bring in any kind of model, and run different parts of the pipeline on GPUs and CPUs. 3. Fault Tolerance to ingestion spike, compute infrastructure failure. 4. Scaling compute,…

    2024 · getindexify.ai · its alternatives →

16. 16
    I built a backend so simple that it fits in a YAML file▲102

    The open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.

    2024 · manifest.build · its alternatives →

17. 17
    Concierge - Framework for Building Agentic Web Interfaces▲20

    Hey HN, We’re building Concierge, An open source framework that allows you to build Agentic Applications, letting LLMs navigate, interact, and transact with your service It's a declarative framework which makes it easy for you to create Microservices for AI agents. You can expose your existing web offerings to LLMs. To support navigation you can use several abstractions like Stages, Tasks, Workflows and more. These specify the rules and guiding principles of how an Agent interacts with the service. It's especially useful when you want to expose complex business logic with thousands of APIs,…

    Nov 2025 · github.com · its alternatives →

18. 18
    UnionML▲77

    The easiest way to build and deploy ML microservices

    2022 · union.ai · its alternatives →

19. 19
    OpenRouter Model Fusion▲144

    Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…

    Apr 2026 · openrouter.ai · its alternatives →

20. 20
    Agentfield▲91

    Build & scale AI \ agents as microservices with IAM

    Dec 2025 · agentfield.ai · its alternatives →

21. 21
    Go-micro – a microservices client/server library▲27

    A Go agent harness and service framework. Contribute to micro/go-micro development by creating an account on GitHub.

    2015 · github.com · its alternatives →

22. 22
    LLMWare – Small Specialized Function Calling 1B LLMs for Multi-Step RAG▲51

    Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks&#x2F;LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…

    2024 · github.com · its alternatives →

23. 23
    Ludwig 0.8▲109

    Build and fine-tune custom LLMs on your private data

    2023 · ludwig.ai · its alternatives →

24. 24
    Example of a polyglot microservice app▲92

    Example of polyglot microservice app. Contribute to elgris/microservice-app-example development by creating an account on GitHub.

    2017 · github.com · its alternatives →

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →