AI · alternatives · 2026

24 alternatives to Larq – Binarized Neural Network Inference with MLIR and TFLite

Highly optimized inference engine for Binarized Neural Networks - larq/compute-engine

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Larq – Binarized Neural Network Inference with MLIR and TFLite launched in 2020; newer entries below may have overtaken it.

1
We made our own inference engine for Apple Silicon▲186
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
2
Applying the Unix philosophy to neural networks▲251
Neural network inference the Unix way. Contribute to cloudkj/layer development by creating an account on GitHub.
2019 · github.com · its alternatives →
3
Netmind Power▲272
Hi HN, We just opened public access to Qwen3‑Coder‑480B‑A35B‑Instruct via a REST/SDK API. Why it might be interesting: - Fully open-source (Apache‑2.0): https://github.com/QwenLM/Qwen3-Coder - 480B params (35B active MoE), long context up to 1M tokens with YaRN - Matches Claude Sonnet/GPT‑4o on SWE-Bench Verified (81.6%) - Free tier: 100K tokens/month
2023 · netmind.ai · its alternatives →
4
General Compute▲315
AI models that run on an inference cloud optimized for speed
May 2026 · generalcompute.com · its alternatives →
5
Tiny-vLLM – high performance LLM inference engine in C++ and CUDA▲205
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
May 2026 · github.com · its alternatives →
6
Qwen3.5▲288
The 397B native multimodal agent with 17B active params
Feb 2026 · qwen.ai · its alternatives →
7
Sonnet▲134
A new library for constructing neural networks from DeepMind
2017 · deepmind.google · its alternatives →
8
Groq®▲237
Hyperfast LLM running on custom built GPUs
2024 · groq.com · its alternatives →
9IB
I built a toy TPU that can do inference and training on the XOR problem▲134
We wanted to do something very challenging to prove to ourselves that we can do anything we put our mind to. The reasoning for why we chose to build a toy TPU specifically is fairly simple: - Building a chip for ML workloads seemed cool - There was no well-documented open source repo for an ML accelerator that performed both inference and training None of us have real professional experience in hardware design, which, in a way, made the TPU even more appealing since we weren't able to estimate exactly how difficult it would be. As we worked on the initial stages of this project, we…
2025 · tinytpu.com · its alternatives →
10
Qwen3.6-35B-A3B▲124
The open sparse MoE model for agentic coding
Apr 2026 · qwen.ai · its alternatives →
11
A general-purpose encoder-decoder framework for Tensorflow▲54
A general-purpose encoder-decoder framework for Tensorflow - google/seq2seq
2017 · github.com · its alternatives →
12
Neural Networks and Deep Learning▲95
Core concepts behind neural networks and deep learning
2015 · neuralnetworksanddeeplearning.com · its alternatives →
13
Neuropod – Uber ATG's open source deep learning inference engine▲80
A uniform interface to run deep learning models from multiple frameworks - uber/neuropod
2020 · github.com · its alternatives →
14
An educational Local Qwen3 LLM Inference project written in Rust▲15
An educational Rust project for exporting and running inference on Qwen3 LLM family - reinterpretcat/qwen3-rs
2025 · github.com · its alternatives →
15
Entropy-Guided Loop – How to make small models reason▲33
TLDR: A small, vendor-agnostic inference loop that turns token logprobs/perplexity/entropy into an extra pass and reasoning for LLMs. - Captures logprobs/top-k during generation, computes perplexity and token-level entropy. - Triggers at most one refine when simple thresholds fire; passes a compact “uncertainty report” (uncertain tokens + top-k alts + local context) back to the model. - In our tests on technical Q&A / math / code, a small model recovered much of “reasoning” quality at ~⅓ the cost while refining ~⅓ of outputs. I kept seeing “reasoning” models behave…
2025 · github.com · its alternatives →
16
TensorFlow 1.0▲80
Open-source machine learning library by Google
2018 · tensorflow.org · its alternatives →
17IG
Inference GUIs for 12 SoTA ML models▲9
2020 · gradiohub.com · its alternatives →
18
Deep Learning▲67
The textbook for modern machine learning
2016 · amazon.com · its alternatives →
19
Talking Machines - Solving intelligence and machine learning fundamentals▲56
Guest: Nando de Freitas (Oxford, Google DeepMind)
2015 · thetalkingmachines.com · its alternatives →
20
Inferencer – Run and deeply control local AI models (macOS release)▲15
Private inference app that lets you see the token entropy, explore and change the token probabilities. Just released on macOS, iOS version next then other platforms. Here's a demo of it in action running DeepSeek Terminus: https://youtu.be/kts098EL2PQ Would love to hear any feedback or feature requests from the community.
2025 · inferencer.com · its alternatives →
21
We Beat MLPerf: Modern Storage for KV Offload and LLM Training▲35
High performance storage engine for efficient LLM inference and GPU Training.
Sep 2026 · theopenlake.com · its alternatives →
22
A reimplementation of Google's sparsehash in C▲22
A simple re-implementation of Google's sparsehash as a learning excercise. - qpfiffer/Simple-Sparsehash
2015 · github.com · its alternatives →
23
Training Neural Networks with a Single Unix Pipeline▲5
A Command-Line Program of Feedforward Neural Networks - dongyx/lnn
2023 · github.com · its alternatives →
24
KTransformers–236B Model and 1M Context LLM Inference on Local Machines▲20
Hey Hacker News! We are excited to share our open-source project, KTransformers, a flexible framework designed for cutting-edge LLM inference optimizations! Leveraging state-of-the-art kernels from llamafile and marlin, KTransformers seamlessly enhances the performance of HuggingFace Transformers, making it possible to operate large 236B MoE models or extremely long 1M context locally with promising speed. KTransformers is a Python-centric framework designed with extensibility at its core. By implementing and injecting an optimized module with a single line of code, users gain access to a…
2024 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →