Dev tools · alternatives · 2026
24 alternatives to Cuq – Formal Verification of Rust GPU Kernels
A pipeline that translates Rust GPU code into formal Coq models, as a foundation for memory model proofs - neelsomani/vericuda
Cuq is a formal verification tool designed for Rust GPU kernel developers. It enables developers to mathematically prove the correctness of GPU code written in Rust, helping catch bugs and ensure reliability in… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions. - NVlabs/cutile-rs
Jun 2026 · github.com · its alternatives →
- 2
I replicated David Ng's RYS method (https://dnhkng.github.io/posts/rys/) on consumer AMD GPUs (RX 7900 XT + RX 6950 XT) and found something I didn't expect. Transformers appear to have discrete "reasoning circuits" — contiguous blocks of 3-4 layers that act as indivisible cognitive units. Duplicate the right block and the model runs its reasoning pipeline twice. No weights change. No training. The model just thinks longer. The results on standard benchmarks (lm-evaluation-harness, n=50): Devstral-24B, layers 12-14 duplicated once: - BBH Logical Deduction: 0.22 → 0.76…
Mar 2026 · github.com · its alternatives →
- 3
I've been playing around with https://github.com/zphang/minimal-llama/ and https://github.com/tloen/alpaca-lora/blob/main/finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy!
2023 · github.com · its alternatives →
- 4
Hi HN! I'm just sharing a project I've been working on during the LLM Efficiency Challenge - you can now finetune Llama with QLoRA 5x faster than Huggingface's original implementation on your own local GPU. Some highlights: 1. Manual autograd engine - hand derived backprop steps. 2. QLoRA / LoRA 80% faster, 50% less memory. 3. All kernels written in OpenAI's Triton language. 4. 0% loss in accuracy - no approximation methods - all exact. 5. No change of hardware necessary. Supports NVIDIA GPUs since 2018+. CUDA 7.5+. 6. Flash Attention support via Xformers. 7. Supports 4bit and 16bit…
2023 · github.com · its alternatives →
- 5
CUDA is NVIDIA's language for GPU programming, allowing you to mix write CPU and GPU code in C++ in one file. By chaining a few projects that compile CUDA to OpenCL, then Vulkan, then WebGPU, you can experiment with this GPGPU language on any hardware.
2025 · hipscript.lights0123.com · its alternatives →
- 6
Copper is an operating system for robots - build, run, and replay your entire robot deterministically. - Home · copper-project/copper-rs Wiki
2024 · github.com · its alternatives →
- 7
Hi HN, Over the past few months, I've been building `dsc`, a tensor library from scratch in C++/CUDA. My main focus has been on getting the basics right, prioritizing a clean API, simplicity, and clear observability for running small LLMs locally. The key features are: - C++ core with CUDA support written from scratch. - A familiar, PyTorch-like Python API. - Runs real models: it's complete enough to load a model like Qwen from HuggingFace and run inference on both CUDA and CPU with a single line change[1]. - Simple, built-in observability for both Python and C++. Next on the roadmap is…
2025 · github.com · its alternatives →
- 8
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
- 9
To my knowledge, this is the first formally verified implementation of a 3D constructive solid geometry (CSG) operation: mesh intersection, implemented in Lean 4 and verified against a concise specification that pins down the surface of the resulting mesh exactly and guarantees practical well-formedness conditions on the triangulation. This project is also an experiment in avoiding having to trust AI-generated code. A human reviewer only needs to read 93 lines of formal specification and run the Lean checker to certify the correctness of the kernel, skipping the intricate 1000+ lines of…
Jul 2026 · github.com · its alternatives →
- 10
- 11
RightNow CLI▲121I locked in for 18 hours and built Claude Code for CUDA. It is completely open source! It writes CUDA kernels, debugs memory issues, and optimizes for your specific GPU. It is a fully agentic AI with tool calling built specifically for the CUDA toolkit This is the CLI version of RightNow AI code editor, our GPU-native code editor with a built-in emulator, visual profiling, and remote GPU access. The CLI is open source, lightweight, and fast. It is designed for anyone who wants AI help with CUDA without setup I used Python because it is the most common language, so anyone can build on top of…
2025 · github.com · its alternatives →
- 12
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
May 2026 · github.com · its alternatives →
- 13WM
Try it out! https://glhf.chat/ Hey HN! We’ve been working for the past few months on a website to let you easily run (almost) any open-source LLM on autoscaling GPU clusters. It’s free for now while we figure out how to price it, but we expect to be cheaper than most GPU offerings since we can run the models multi-tenant. Unlike Together AI, Fireworks, etc, we’ll run any model that the open-source vLLM project supports: we don’t have a hardcoded list. If you want a specific model or finetune, you don’t have to ask us for it: you can just paste the Hugging Face link in and…
2024 · glhf.chat · its alternatives →
- 14
GPU Raytracer from scratch in C++/CUDA. Contribute to jan-van-bergen/GPU-Raytracer development by creating an account on GitHub.
2021 · github.com · its alternatives →
- 15
An on-premises, bare-metal solution for deploying GPU-powered applications in containers - emergingstack/es-dev-stack
2016 · github.com · its alternatives →
- 16
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization - RahulSChand/gpu_poor
2023 · github.com · its alternatives →
- 17
A simple GPU hash table implemented in CUDA using lock free techniques - nosferalatu/SimpleGPUHashTable
2020 · github.com · its alternatives →
- 18
Single-source pure-Rust heterogeneous GPU compute platform - enkiruntime/enki
19d ago · github.com · its alternatives →
- 19AG
This is a vector index I built that supports insertion and k-nearest neighbors (k-NN) querying, optimized for GPUs. It operates entirely in CUDA and can process queries on half a billion vectors in under 200 milliseconds. The codebase is structured as a standalone library with an HTTP API for remote access. It’s intended for high-performance search tasks—think similarity search, AI model retrieval, or reinforcement learning replay buffers. The codebase is located at https://github.com/rodlaf/BinaryGPUIndex.
2025 · rlafuente.com · its alternatives →
- 20
A langgraph based workflow with a C++ CUDA suite to optimize CUDA kernels - bertaye/agentic-cuda-optimizer
26d ago · github.com · its alternatives →
- 21
Demo of agent based model on GPU with CUDA and OpenGL (Windows/Linux) Agent instances on GPU memory Uses SSBO for instanced objects (with GLSL 450 shaders) CUDA OpenGL interops Renders with GLFW3 window manager Dynamic camera views in OpenGL (pan,zoom with mouse) Libraries installed using vcpkg (https://github.com/KienTTran/ABMGPU)
2023 · github.com · its alternatives →
- 22
Hi everyone, I started working on nanoeuler after the ban of anthropic's fable because my ambition and dream is to work in the AI field in anthropic. The two interesting reasons that led me to create nanoeuler were (1) interfacing with llm does not mean understanding how they are composed and (2), working on llm with a very low-level layer to understand the correlation between parameters and data and growth of the model and how the GPU works and how some layers can be optimized. So I started working on it with a research aspect by making nanoeuler grow more and more but doing one step after…
Jun 2026 · github.com · its alternatives →
- 23
I built a small Linux tool to deterministically verify GPU PCIe link health and bandwidth. It reports: - Negotiated PCIe generation and width - Peak Host→Device and Device→Host memcpy bandwidth - Sustained PCIe TX/RX utilization via NVML - A rule-based verdict derived from observable hardware data only This exists because PCIe issues (Gen downgrades, reduced lane width, risers, bifurcation) are often invisible at the application layer and can’t be fixed by kernel tuning or async overlap. Linux-only: it relies on sysfs and PCIe AER exposure that Windows does not provide.
Dec 2025 · github.com · its alternatives →
- 24PO
Our company Vertex.AI has been working on this for a while but this is the first public release. We're starting with using PlaidML to bring OpenCL support to Keras and more frameworks, platforms, etc are coming. Yes, this means you can use use your AMD GPU for deep learning dev. Sorry, no Mac or Windows support yet although the brave can try building from source (it should work). http://vertex.ai/blog/announcing-plaidml https://github.com/plaidml/plaidml
2017 · its alternatives →
Also compare
- cuTile Rust: Safe, data-race-free GPU kernels in Rust alternatives
- Duplicate 3 layers in a 24B LLM, logical deduction .22→.76. No training alternatives
- Finetune LLaMA-7B on commodity GPUs using your own text alternatives
- 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning alternatives
- HipScript – Run CUDA in the browser with WebAssembly and WebGPU alternatives
- Copper – Open-source robotics in Rust with deterministic log replay alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →