Alternatives
Products that do what Spell – simple, remote GPU execution does
We'd like to introduce HN to Spell, which is a tool for easily running ML/DL jobs remotely. As Deep Learning has grown we see engineers and researchers struggle to incorporate running on GPUs into their workflow. So we built Spell to be the easiest way to get code running elsewhere - like the bash '&' operator but for remote machines. Sign up for an account at https://web.spell.run/waitlist, which includes $300 in credits for GPU time. There's a waitlist, but we'll be approving accounts as they come in. Here are some of the features we really wanted and built into Spell:…
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10CG
2021 · gpu.land
- 11
- 12
- 13
- 14DG
2016 · github.com
- 15IE
Quick note on how it works and how I've done my batch embedding engine IgniteMS. The whole thing runs as one process using Rust, reading input, tokenizing, packing batches, keeping the queue full. TensorRT handles inference. Python is only as a wrapper. I built it this way because when you use more than couple of GPUs, the GPUs stop being the problem. CPU cannot feed them fast enough. One A100 can go through batches faster than Python can tokenize and feed, so the GPU just sits there idle waiting for work. Most of my time went into optimizing this. At 8 GPUs that was basically the entire…
Jun 2026 · github.com
- 16
- 17AS
2019 · github.com
- 18PO
Our company Vertex.AI has been working on this for a while but this is the first public release. We're starting with using PlaidML to bring OpenCL support to Keras and more frameworks, platforms, etc are coming. Yes, this means you can use use your AMD GPU for deep learning dev. Sorry, no Mac or Windows support yet although the brave can try building from source (it should work). http://vertex.ai/blog/announcing-plaidml https://github.com/plaidml/plaidml
2017
- 19RS
Hi HN! I've been hacking on this side project for the last month or two with the goal of making it dead simple to use cloud GPUs. I ran into this problem personally during the phd, and built my own tooling around it. I always thought it'd be fun to try to turn that tooling into a more general product... and bitbop.io is the result! All you have to do is run `ssh bitbop.io`, and you get your own personal dev GPU workstation in the cloud. Looking forward to hearing your thoughts!
2024 · twitter.com
- 20DI
Hi HN community, Shen and I created a service for anyone to easily train deep learning model on GPU power harnessed from the crowd. We have completed the first version DeepCluster.io (http://deepcluster.io) and welcome ML researchers to try it out for free! We are enthusiastic of deep learning, but often found training models with GPU instances on AWS very expensive. Meanwhile, some of our friends have idle GPUs that are used to mine cryptos. So we decided to borrow their GPUs for training deep learning model ourselves, and believe this could be a service that benefits other ML…
2019
- 21RP
I integrated a remote GPU execution backend into PyTorch through the same system that custom hardware accelerators get integrated into PyTorch. You can create a remote machine and obtain its CUDA device whenever you want to create or move tensors onto the remote GPU. machine = mycelya_torch.RemoteMachine("modal", "A100") cuda_device = machine.device("cuda") x = torch.randn(1000, 1000, device=cuda_device) y = torch.randn(1000, 1000).to(cuda_device) I made it reasonably performant by having most operations dispatch asynchronously whenever possible. For cases where slow performance is…
Oct 2025 · github.com
- 22RA
We built RapidFire AI, an open-source Python tool to speed up LLM fine-tuning and post-training with a powerful level of control not found in most tools: Stop, resume, clone-modify and warm-start configs on the fly—so you can branch experiments while they’re running instead of starting from scratch or running one after another. - Works within your OSS stack: PyTorch, HuggingFace TRL/PEFT), MLflow. - Hyperparallel search: launch as many configs as you want together, even on a single GPU - Dynamic real-time control: stop laggards, resume them later to revisit, branch promising configs in…
Sep 2025 · github.com
- 23BG
2018 · medium.com
- 245L
We've built InferX, a specialized runtime environment that fundamentally changes how LLMs are served. The core problem we solve is the latency bottleneck in AI inference, especially with large models. Current systems waste resources or suffer from painfully slow cold starts. InferX's AI-native architecture, with its "snapshot" technology, enables: * *Sub-2s cold starts:* Spin up models instantly. * *High density:* Serve more LLMs on the same GPUs. * *Optimal efficiency:* Maximize GPU utilization. This isn't just another API; it's a new execution layer designed from the ground up for the…
2025 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →