Soperator – Run Slurm in Kubernetes
Hi HN, With this operator, you can run Slurm in Kubernetes and enjoy the benefits of both systems. Both Slurm and Kubernetes can serve as workload managers for distributed model training and high-performance computing (HPC) in general. Each system has its strengths and weaknesses, but the trade-offs are significant. Slurm offers advanced and effective scheduling, granular hardware control, and accounting, but lacks universality. On the other hand, Kubernetes can be used for purposes other than training (e.g. inference) and provides good auto-scaling and self-healing capabilities. It's…
What it does
In the maker’s words, at launch
Hi HN, With this operator, you can run Slurm in Kubernetes and enjoy the benefits of both systems. Both Slurm and Kubernetes can serve as workload managers for distributed model training and high-performance computing (HPC) in general. Each system has its strengths and weaknesses, but the trade-offs are significant. Slurm offers advanced and effective scheduling, granular hardware control, and accounting, but lacks universality. On the other hand, Kubernetes can be used for purposes other than training (e.g. inference) and provides good auto-scaling and self-healing capabilities. It's unfortunate that there is no way to combine the benefits of both solutions. And since many big tech companies use Kubernetes as their default infrastructure layer without supporting a dedicated model training system, some ML engineers don't even have a choice. That's why we decided to merge these systems, taking a "Kubernetes-first" approach. We implemented a Kubernetes operator, which is a software component that runs and manages Slurm clusters as Kubernetes resources.
Does the same job
all alternatives →


- KAKubernetes as a back-end for OpenFaaS2017 · github.com · ▲194


More dev tools this month
the category →



Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com

OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com

Launched alongside, October 2024
the whole month →


Softr for Notion▲925Turn Notion databases into portals & apps with no code
Dev tools · 2024 · softr.io

One inbox for all your work discussions
Work · 2024 · generalcollaboration.com