Alternatives
Products that do what Forge CLI does
Swarm agents optimize CUDA/Triton for any HF/PyTorch model
- 1
- 2
- 3
- 4
- 5
- 6
- 7SF
Author here. I’m unreasonably excited to share this library that we’re open-sourcing today — our team has been building it for five years and these ideas have been a passion of mine for fifteen. SymForce is a library that makes it easy to code a problem once in Python with an augmented SymPy API (backed by C++), experiment with it symbolically, generate optimized code in C++ or any backend language, and then run highly efficient nonlinear optimization problems based on the original problem definition. This workflow elegantly solves a wide variety of tasks in robotics and related domains, and…
2022 · github.com
- 8
- 9AM
2017 · github.com
- 10LL
After the incredible response to our launch of the first online CUDA playground, we have just shipped something we think all you GPU programming and ML enthusiasts will love. Introducing LeetGPU Challenges--the place to compete on writing the fastest CUDA kernels. We have problems like matrix multiplication, agent simulation, multi-head self-attention, with more dropping every couple of days! We have a lot of really cool things coming up, including support for PyTorch, TensorFlow, JAX, TinyGrad; Multi-GPU programs; H100, V100, A100 GPU options Give it a try and let us know what you think!
2025 · leetgpu.com
- 11OS
Triton Co-Pilot: A quick way to write glue code to make deploying with NVIDIA Triton Inference Server easier. It's a cool CLI tool that we created as part of an internal team hackathon. Earlier, deploying a model to Triton was very tough. You had to navigate through the documentation for the Python backend, figure out how to get your inputs and outputs right, write a bunch of glue code, create a config.pbtxt file with all the correct parameters, and then package everything up. It could easily take a couple of hours. But with Triton Co-Pilot, all that hassle is gone. Now, you just write your…
2024 · github.com
- 12T5
2021 · tensorbase.io
- 13
- 14RA
We built RapidFire AI, an open-source Python tool to speed up LLM fine-tuning and post-training with a powerful level of control not found in most tools: Stop, resume, clone-modify and warm-start configs on the fly—so you can branch experiments while they’re running instead of starting from scratch or running one after another. - Works within your OSS stack: PyTorch, HuggingFace TRL/PEFT), MLflow. - Hyperparallel search: launch as many configs as you want together, even on a single GPU - Dynamic real-time control: stop laggards, resume them later to revisit, branch promising configs in…
Sep 2025 · github.com
- 15RP
I integrated a remote GPU execution backend into PyTorch through the same system that custom hardware accelerators get integrated into PyTorch. You can create a remote machine and obtain its CUDA device whenever you want to create or move tensors onto the remote GPU. machine = mycelya_torch.RemoteMachine("modal", "A100") cuda_device = machine.device("cuda") x = torch.randn(1000, 1000, device=cuda_device) y = torch.randn(1000, 1000).to(cuda_device) I made it reasonably performant by having most operations dispatch asynchronously whenever possible. For cases where slow performance is…
Oct 2025 · github.com
- 16FH
Hi, This is Dan and Genevieve from Burstable AI. We've iterated and made a 45 degree pivot, taking what we learned from developing burst (https://news.ycombinator.com/item?id=28191459) to introduce a cloud service that provides access to a GPU-enabled machine using Jupyterlab to provide notebooks, shell access, and a code/text editor. GPU access is measured and the first 50 hours are free. This is *not* a platform to do crypto mining or run weeks of model training for free. We are focused on the R & D phase of modern AI/ML, where developers/scientists are…
2022 · cloudburst.host
- 17IE
Quick note on how it works and how I've done my batch embedding engine IgniteMS. The whole thing runs as one process using Rust, reading input, tokenizing, packing batches, keeping the queue full. TensorRT handles inference. Python is only as a wrapper. I built it this way because when you use more than couple of GPUs, the GPUs stop being the problem. CPU cannot feed them fast enough. One A100 can go through batches faster than Python can tokenize and feed, so the GPU just sits there idle waiting for work. Most of my time went into optimizing this. At 8 GPUs that was basically the entire…
Jun 2026 · github.com
- 18HC
Hello everyone, After recreating the accuracy/rough speed from David Page's implementation in hlb-CIFAR10 0.1.0 (18.1s on an A100, SXM4, Colab), it was down to some basic NVIDIA kernel profiling to figure out which operations were the long poles in the tent. Perhaps (somewhat?) unsurprisingly, the NCHW NHWC thrash was the worst part, but unfortunately the GhostBatchNorm was a barrier even using the faster-on-Ampere channels_last memory format. A quick note before continuing -- some may find the use of a convolutional network and on CIFAR10 to be curious. A quick answer to that would be…
2023 · github.com
- 19FN
"I wanted to see if I could optimize the dequantization bottleneck during 4-bit LLM inference. By writing a custom kernel in Triton to optimize memory access patterns, I managed to get up to a 1.41x speedup over the standard bitsandbytes implementation. Check out the source code and benchmarks, feedback is highly appreciated!"
Jul 2026 · github.com
- 20FG
Open-source tutorial series teaching real-time graphics programming with SDL's GPU API. Covers everything from Hello Window to SSAO, with math lessons, engine lessons, and a UI track building font rendering from scratch. Every lesson is a standalone C program with commented code explaining why, not just what. The whole project was built with Claude Code. Each lesson also distills into a reusable Claude Code skill — copy them into your own project and build games with AI that actually understands the GPU patterns.
Feb 2026 · github.com
- 21AL
2019 · dev.to
- 22UD
Hi HN! I was inspired by Andrej Karpathy's llm.c (https://github.com/karpathy/llm.c), and wrote a full diffusion model training loop in CUDA. I learnt a lot about CUDA from Simon Boehm's Matmul blog (https://siboehm.com/articles/22/CUDA-MMM). Currently there is still a lot of room for optimization: the model is running at 45% speed of PyTorch with torch.compile. I'm curious about any thoughts or CUDA tips for convolutions.
2024 · github.com
- 23RA
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai
- 24AF
I built this mostly because I love the intersection of game AI, high-performance computing, and poker. I’d love for anyone interested in game theory or CUDA optimization to tear it apart, test the accuracy, and give me feedback. Happy to answer any questions about the algorithms, the transition from CPU to GPU, or poker AI in general!
Jul 2026 · bupticybee.github.io
Ranked by how close each launch is in meaning, then by votes. Refine with a description →