Alternatives
Products that do what Kubernetes LLM Operator does
LLMs on Kubernetes. On premise, In cloud, on the Edge.
- 1

- 2

- 3

- 4

- 5

- 6

- 7GO
Hello HN, we're Philip and Louis from Glasskube (https://github.com/glasskube/glasskube). We're working on an open-source package manager for Kubernetes. It's an alternative to tools like Helm or Kustomize, primarily focused on making deploying, updating, and configuring Kubernetes packages simpler and a lot faster. Here is a demo video (https://www.youtube.com/watch?v=aIeTHGWsG2c#t=17s) with quick start instructions. Most developers working with Kubernetes use Helm, an open-source tool created during a hackathon nine years ago. However, with the rapid…
2024 · github.com
- 8

- 9

- 10

- 11

- 12

- 13OY
2019 · github.com
- 14KO
2018 · github.com
- 15AP
2016 · distelli.com
- 16

Skip the setup and run OpenClaw & Hermes, fully managed
18d ago · cloudways.com
- 17MI
I've been working on a platform that uses LLMs to build maintain and manage k8s clusters on any cloud. The system writes infra as code to your Github repos and automatically containerizes and scales any services (public or private). The goal is to give your average engineer a vercel-like deployment experience for any service in any language at minimal cost. We have humans involved at the moment auditing LLM outputs and keeping an eye on clusters. We are looking for folks who may be thinking about their first infra/devops hire. Just connect your github and your cloud provider. The system…
2024 · milkinfrastructure.com
- 18LK
Hi HN! I built LLMKube, a Kubernetes operator for deploying GPU-accelerated LLMs in production. One command gets you from zero to inference with full observability. Why this exists: Regulated industries (healthcare, defense, finance) need air-gapped LLM deployments, but existing tools are either single-node only (Ollama) or lack GPU optimization and SLO enforcement. LLMKube bridges the gap. What's working: - 17x speedup with NVIDIA GPUs (64 tok/s on Llama 3.2 3B vs 4.6 tok/s CPU) - One command: llmkube deploy llama-3b --gpu (auto CUDA setup, scheduling, layer offloading) -…
Nov 2025 · github.com
- 19AU
Hey HN! We wanted to share with you nxs-universal-chart - our open-sourced universal Helm chart. You can use it to deploy any of your applications into Kubernetes/OpenShift and other orchestrators compatible with native Kubernetes API. Our team regularly faced the need to create almost identical charts, so when we had 14 identical microservices in one project, we came up with a chart format that essentially became a prototype of nxs-universal-chart. It turned out to be more relevant than we even thought! When we needed to prepare CI/CD for 60 almost identical projects for a…
2024 · github.com
- 20KS
Hi everyone, I run a generative AI infra company, unified API for 600+ models. Our team started deploying AI agents for our marketing and lead gen ops: content, engagement, analytics across multiple X accounts. OpenClaw worked fine for single agents. But at ~14 agents across 6 accounts, the problem shifted from "how do I build agents" to "how do I manage them." Deployment, monitoring, team isolation, figuring out which agent broke what at 3am. Classic orchestration problem. So I built klaw, modeled on Kubernetes: Clusters — isolated environments per org/project Namespaces — team-level…
Feb 2026 · github.com
- 21TM
Hi, we are a small team from Vienna and today released our first version of a Package Manager similar to apt, Homebrew, or Chocolatey, but specifically tailored for Kubernetes environments and cloud-native software. Originally, we wanted to contribute to the Kubernetes ecosystem with a different idea; however, after talking to the community, we uncovered that package management is an even bigger problem at the moment. We are now looking for as much feedback as possible, so we would really appreciate it if you could check it out and let us know what you think! Thanks!
2024 · github.com
- 22CP
I’m a software engineer who accidentally became my team’s Kubernetes person — and eventually the bottleneck for every Helm chart PR. I built Chart Preview so reviewers could see Helm chart changes running without waiting on me. A few years ago, my team needed to implement HA for an existing product, which meant deploying on Kubernetes and OpenShift. I spent months learning Kubernetes, Helm, and the surrounding ecosystem. After that, Kubernetes largely became “my thing” on the team. We later published public Helm charts for the product, and customers started submitting PRs. Those PRs would…
Dec 2025
- 23BA
Started this because configuring Fabric8 for EKS was driving me crazy. Building a client that auto-detects your environment (IAM roles, profiles, local configs) so you don't have to wire it all up manually. Still pretty early and building for EKS right now. Long way to go, but putting it out there early to see if others have hit the same problems or want to help shape where this goes.
Oct 2025 · github.com
- 24

Securely share and scale custom internal apps and workflows
28d ago · compartment.dev
Ranked by how close each launch is in meaning, then by votes. Refine with a description →