Life & fun · alternatives · 2026

24 alternatives to TiGrIS, a tiling compiler that fits ML models onto embedded devices

Ahead-of-time compiler that fits ML models on embedded devices with hard memory budgets. - raws-labs/tigris

TiGrIS is a tiling compiler designed to fit machine learning models onto embedded devices. It handles the technical challenge of restructuring ML models so they can run on hardware with limited resources. The tool is… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

1TO
Tigris – open-source developer data platform for your next app▲58
Tigris is the first truly open source developer data platform with a simple yet powerful, unified API that spans search, event streaming, and transactional document store. It enables you to focus on building your applications and stop worrying about the data infrastructure.
2022 · docs.tigrisdata.com · its alternatives →
2HP
High-performance ahead-of-time compiler for Machine Learning▲83
2018 · scss.tcd.ie · its alternatives →
3AO
An OSS developer data platform on your laptop in a few steps▲12
Tigris is an OSS developer data platform that provides all the building blocks you need to build data-rich applications without the Ops burden. This is the first of a series of blog posts where we show you how to deploy Tigris in various environments. In this first post of the series, we will show you how to set up the Tigris platform on your laptop. In our next posts, we will cover deploying Tigris on EKS and GKE.
2022 · blog.tigrisdata.com · its alternatives →
4
Timber – Ollama for classical ML models, 336x faster than Python▲207
Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference. - kossisoroyce/timber
Mar 2026 · github.com · its alternatives →
5
TensorZero▲307
Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
6
MakeML▲274
Train Neural Networks without a line of code
2019 · makeml.app · its alternatives →
7
Run TRELLIS.2 Image-to-3D generation natively on Apple Silicon▲202
I ported Microsoft's TRELLIS.2 (4B parameter image-to-3D model) to run on Apple Silicon via PyTorch MPS. The original requires CUDA with flash_attn, nvdiffrast, and custom sparse convolution kernels: none of which work on Mac. I replaced the CUDA-specific ops with pure-PyTorch alternatives: a gather-scatter sparse 3D convolution, SDPA attention for sparse transformers, and a Python-based mesh extraction replacing CUDA hashmap operations. Total changes are a few hundred lines across 9 files. Generates ~400K vertex meshes from single photos in about 3.5 minutes on M4 Pro (24GB). Not as fast as…
Apr 2026 · github.com · its alternatives →
8
Ollama v0.19▲410
Massive local model speedup on Apple Silicon with MLX
Apr 2026 · ollama.com · its alternatives →
9
Luminal – Open-source, search-based GPU compiler▲153
Hi HN, I’m Joe. My friends Matthew, Jake and I are building Luminal (https://luminalai.com/), a GPU compiler for automatically generating fast GPU kernels for AI models. It uses search-based compilation to achieve high performance. We take high level model code, like you'd have in PyTorch, and generate very fast GPU code. We do that without using LLMs or AI - rather, we pose it as a search problem. Our compiler builds a search space, generates millions of possible kernels, and then searches through it to minimize runtime. You can try out a demo in `demos/matmul` on mac to…
2025 · github.com · its alternatives →
10
Gradio 5.0▲224
connect nodes to build AI pipelines, powered by Hugging Face
2024 · gradio.app · its alternatives →
11
GUIs for Faster ML Prototyping and Sharing▲85
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work! - gradio-app/gradio
2020 · github.com · its alternatives →
12
HuggingFace – Fast tokenization library for deep-learning NLP pipelines▲168
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production - huggingface/tokenizers
2020 · github.com · its alternatives →
13
Tiny-vLLM – high performance LLM inference engine in C++ and CUDA▲205
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
May 2026 · github.com · its alternatives →
14
A Python container for dataclasses with multi-indexing and vector opps▲122
A container for dataclasses with multi-indexing and bulk operations. - joshlk/dataclassframe
2020 · github.com · its alternatives →
15
Spice.ai – materialize, accelerate, and query SQL data from any source▲177
Hi HN, We're Luke and Phillip, and we're building Spice.ai OSS - a lightweight, portable runtime, built in Rust and powered by Apache DataFusion to locally materialize, accelerate, and query data tables sourced from any database, data warehouse or data lake. Phillip and I first introduced Spice on Show HN in September 2021. Since then, we’ve been schooled and humbled in every way building 100TB+ data and ML systems for the https://spice.ai cloud platform. Along with our customers, we struggled with getting fast, low-latency, high-concurrency SQL query within a budget, accessing and…
2024 · github.com · its alternatives →
16
Dockerized GPU Deep Learning Solution (Code and Blog and TensorFlow Demo)▲80
An on-premises, bare-metal solution for deploying GPU-powered applications in containers - emergingstack/es-dev-stack
2016 · github.com · its alternatives →
17PO
PlaidML, open source deep learning for any GPU▲52
Our company Vertex.AI has been working on this for a while but this is the first public release. We're starting with using PlaidML to bring OpenCL support to Keras and more frameworks, platforms, etc are coming. Yes, this means you can use use your AMD GPU for deep learning dev. Sorry, no Mac or Windows support yet although the brave can try building from source (it should work). http://vertex.ai/blog/announcing-plaidml https://github.com/plaidml/plaidml
2017 · its alternatives →
18
I built a tensor library from scratch in C++/CUDA▲119
Hi HN, Over the past few months, I've been building `dsc`, a tensor library from scratch in C++/CUDA. My main focus has been on getting the basics right, prioritizing a clean API, simplicity, and clear observability for running small LLMs locally. The key features are: - C++ core with CUDA support written from scratch. - A familiar, PyTorch-like Python API. - Runs real models: it's complete enough to load a model like Qwen from HuggingFace and run inference on both CUDA and CPU with a single line change[1]. - Simple, built-in observability for both Python and C++. Next on the roadmap is…
2025 · github.com · its alternatives →
19MW
My "weekend" project, an ML dialect and compiler▲68
2012 · texodus.github.com · its alternatives →
20AG
A GPU-accelerated binary vector index▲65
This is a vector index I built that supports insertion and k-nearest neighbors (k-NN) querying, optimized for GPUs. It operates entirely in CUDA and can process queries on half a billion vectors in under 200 milliseconds. The codebase is structured as a standalone library with an HTTP API for remote access. It’s intended for high-performance search tasks—think similarity search, AI model retrieval, or reinforcement learning replay buffers. The codebase is located at https://github.com/rodlaf/BinaryGPUIndex.
2025 · rlafuente.com · its alternatives →
21
End-to-end deep learning experimentation platform for Tensorflow▲151
AI Infra / AI Orchestration / AI Control Plane. Contribute to polyaxon/polyaxon development by creating an account on GitHub.
2017 · github.com · its alternatives →
22
SelfHostLLM▲134
A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.
2025 · selfhostllm.org · its alternatives →
23
SymForce – Fast symbolic computation, code generation, and optimization▲125
Author here. I’m unreasonably excited to share this library that we’re open-sourcing today — our team has been building it for five years and these ideas have been a passion of mine for fifteen. SymForce is a library that makes it easy to code a problem once in Python with an augmented SymPy API (backed by C++), experiment with it symbolically, generate optimized code in C++ or any backend language, and then run highly efficient nonlinear optimization problems based on the original problem definition. This workflow elegantly solves a wide variety of tasks in robotics and related domains, and…
2022 · github.com · its alternatives →
24
Engrim – A universal, local-first SQLite memory engine for AI CLIs▲93
The Universal Cross-Model Episodic Memory Standard. Local-first, project-scoped SQLite memory engine for Google Antigravity, Claude Code, Cursor, and Windsurf. Zero cloud lock-in. - timgordontg/engrim
Sep 2026 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →