LiteLLM Operator
Run LiteLLM on Kubernetes the operator way
What it does
Stop hand-managing Helm installs. LiteLLM Operator brings a declarative, reconciliation-based workflow for LiteLLM on Kubernetes, with bidirectional sync between CRDs and the Admin UI, support for models, teams, users, and keys, plus OperatorHub/OpenShift-friendly distribution.
Does the same job
all alternatives →- GOGlasskube – Open Source Kubernetes Package Manager, alternative to Helm2024 · github.com · ▲266
Hello HN, we're Philip and Louis from Glasskube (https://github.com/glasskube/glasskube). We're working on an open-source package manager for Kubernetes. It's an alternative to tools like Helm or Kustomize, primarily focused on making deploying, updating, and configuring Kubernetes packages simpler and a lot faster. Here is a demo video (https://www.youtube.com/watch?v=aIeTHGWsG2c#t=17s) with quick start instructions. Most developers working with Kubernetes use Helm, an open-source tool created during a hackathon nine years ago. However, with the rapid…
- VOValkey-Operator Kubernetes Operator for Valkey (Redis Fork)2024 · github.com · ▲14
Hi there, I've been working on a Kubernetes Operator to deploy and manage Valkey Cluster (https://valkey.io). I was unsatisfied with the existing options available, and felt that it didn't hurt to create a new one. I know a lot of folks are going to make the case that the Bitnami helm chart (https://github.com/bitnami/charts/tree/main/bitnami/valkey-c...) is good enough, or just use a cloud provider option is ideal. And for some use cases that makes sense, but for a lot of other use cases, especially testing, and multi-tenant SaaS offerings I…
- KSKlaw.sh – Kubernetes for AI agentsFeb 2026 · github.com · ▲60
Hi everyone, I run a generative AI infra company, unified API for 600+ models. Our team started deploying AI agents for our marketing and lead gen ops: content, engagement, analytics across multiple X accounts. OpenClaw worked fine for single agents. But at ~14 agents across 6 accounts, the problem shifted from "how do I build agents" to "how do I manage them." Deployment, monitoring, team isolation, figuring out which agent broke what at 3am. Classic orchestration problem. So I built klaw, modeled on Kubernetes: Clusters — isolated environments per org/project Namespaces — team-level…
- KAKoreo – A platform engineering toolkit for Kubernetes2025 · koreo.dev · ▲120
A large part of our (Real Kinetic's) business is helping organizations implement platform engineering, but we've found the existing tooling to be lacking. For IaC, Terraform state becomes a pain because TF treats infrastructure as "one-shot" commands. The Kubernetes controller model provides a nicer approach to managing infrastructure, but the tooling here is also lacking. For configuration management, Helm just doesn't really scale with complexity, nor does Kustomize. For resource orchestration, Crossplane is a step in the right direction but still has challenges and limitations. As a…
- RTRenovate – The Kubernetes-Native WayFeb 2026 · github.com · ▲43
Hey folks, we built a Kubernetes operator for Renovate and wanted to share it. Instead of running Renovate as a cron job or relying on hosted services, this operator lets you manage it as a native Kubernetes resource with CRDs. You define your repos and config declaratively, and the operator handles scheduling and execution inside your cluster. No external dependencies, no SaaS lock-in, no webhook setup. The whole thing is open source and will stay that way – there's no paid tier or monetization plan behind it, we just needed this ourselves and figured others might too. Would love to hear…
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, April 2026
the whole month →
- AG
Thought the resources for GPU arch were lacking, so here we are
Life & fun · Apr 2026 · jaso1024.com
- IB
Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.
AI · Apr 2026 · github.com
- BC
Life & fun · Apr 2026 · sam-burns.com
- IB
With social media and now AI, its important to keep the indie web alive. There are many people who write frequently. Blogosphere tries to highlight them by fetching the recent posts from personal blogs across many categories. There are two versions: Minimal (HN-inspired, fast, static): https://text.blogosphere.app/ Non-minimal: https://blogosphere.app/ If you don't find your blog (or your favorite ones), please add them. I will review and approve it.
AI · Apr 2026 · text.blogosphere.app