AI · alternatives · 2026
24 alternatives to Milk Infrastructure – AI that builds, deploys, manages infra
I've been working on a platform that uses LLMs to build maintain and manage k8s clusters on any cloud. The system writes infra as code to your Github repos and automatically containerizes and scales any services (public or private). The goal is to give your average engineer a vercel-like deployment experience for any service in any language at minimal cost. We have humans involved at the moment auditing LLM outputs and keeping an eye on clusters. We are looking for folks who may be thinking about their first infra/devops hire. Just connect your github and your cloud provider. The system…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier. Milk Infrastructure – AI that builds, deploys, manages infra launched in 2024; newer entries below may have overtaken it.
- 1
AI that builds, deploys, and manages k8s infra
2024 · milkinfrastructure.com · its alternatives →
- 2
Infrabase▲142We too at first thought that letting an LLM manage your AWS account must be a bad idea. What could possibly go wrong?? However we couldn’t resist building it, and when we did, we were surprised how much it can do even in plain vanilla form, which currently is just the ai-sdk frontend with some aws sdk code generation (inspared by aws-mcp). We all but stopped using the AWS console internally and switched to Infrabase - a lot of the time it’s much faster to prompt than to click around in AWS console, especially for things that involve multiple steps, IAM roles, etc. So we started to think of…
2025 · infrabase.co · its alternatives →
- 3
TensorZero▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
- 4
Hey HN, I am the founder of Tensorlake. Prototyping LLM applications have become a lot easier, building decision making LLM applications that work on constantly updating data is still very challenging in production settings. The systems engineering problems that we have seen people face are - 1. Reliably process ingested content in real time if the application is sensitive to freshness of information. 2. Being able to bring in any kind of model, and run different parts of the pipeline on GPUs and CPUs. 3. Fault Tolerance to ingestion spike, compute infrastructure failure. 4. Scaling compute,…
2024 · getindexify.ai · its alternatives →
- 5
Arch▲314Hey HN — I’m Adil from Katanemo (with Salman, Shuguang, and Meiyu) We previously shared an early version of this project as ArchGW. Based on customer feedback, the scope expanded from “LLM routing and model access” into something broader: delivery infrastructure for agentic applications. We renamed it to Plano and reworked the architecture accordingly. The problem On-the-ground AI practitioners will tell you that calling an LLM is not the hard part. The really hard part is delivering agentic applications to production quickly and reliably, then iterating without rewriting system code every…
2024 · github.com · its alternatives →
- 6
LLM Gatewayfree tier▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
- 7
- 8
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com · its alternatives →
- 9
- 10CA
Imagine you have to make a little change in all your microservices, like changing a line in Dockerfile, but you have 50 microservices, ouch right! The PRs, pipelines, reviews... I have created a dashboard with a chatbot where you can simply ask "Update all repositories with alpine base image version X to Y", and then click next a bunch of time and see a list of PRs with their pipeline status. Hi friends I'm Daniel, the creator of Infra as AI. I was laid off from my SRE role a couple of months ago, and decided to build something that could always help me at work. My job was to keep the lights…
2025 · infrastructureas.ai · its alternatives →
- 11
Hey folks, I’m Hassan, one of the co-founders of Infracost (https://www.infracost.io). Infracost helps engineers see and reduce the cloud cost of each infrastructure change before they merge their code. The way Infracost works is we gather pricing data from Amazon Web Services, Microsoft Azure and Google Cloud. What we call a ‘Pricing Service’, which now holds around 9 million live price points (!!). Then we map these prices to infrastructure code. Once the mapping is done, it enables us to show the cost impact of a code change before it is merged, directly in GitHub, GitLab etc.…
Jan 2026 · dashboard.infracost.io · its alternatives →
- 12
The open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.
2024 · manifest.build · its alternatives →
- 13
- 14
Manage AWS, GCP, Azure, Kubernetes, and 45+ cloud providers from one unified desktop and web app. SSH terminals, SQL editor, K8s exec, storage browser, and more.
Jul 2026 · infrawrench.com · its alternatives →
- 15
Deploy, secure & govern AI agents in your cloud.
Aug 2026 · infrastream.io · its alternatives →
- 16
Recently featured in a LangChain blog https://blog.langchain.dev/empowering-development-with-flowt... , use LLMs to construct an API first runnable workflow with an IDE experience.
2024 · github.com · its alternatives →
- 17
LLMs on Kubernetes. On premise, In cloud, on the Edge.
2025 · its alternatives →
- 18
Inframan▲1Enterprise cloud Infrastructure managed without DevOps team
Jul 2026 · inframan.cloud · its alternatives →
- 19WB
We’ve been building a Cloud-Managed Hypervisor that makes running applications on your own servers as effortless as the public cloud. Over my career I’ve watched the transition from on-prem to public cloud. The cloud paradigm shift is as much about empowering engineers as it is about elastic infrastructure, but the tooling for on-prem and private clouds is at best heavyweight and at worst stuck in the last century. We've tackled some interesting problems in the process of building this, such as providing a cloud-style metadata service from our platform. We’d love for you to read our story…
2023 · gallium.cloud · its alternatives →
- 20
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications - pyadav/gateway
2024 · github.com · its alternatives →
- 21
Production-ready Cloud infrastructure in 1 day
2025 · solutions.corewide.com · its alternatives →
- 22
Cloud cost intelligence for engineers, AI coding agents, and CI/CD 💰📉 Shift FinOps Left! - infracost/infracost
2021 · github.com · its alternatives →
- 23
See your infrastructure as a live canvas.
Jun 2026 · infracanvas.app · its alternatives →
- 24
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →