Alternatives

Products that do what GPT-J inference on the CPU using C/C++ does

1XA
Xmake, a modern C/C++ build utility▲186
2019 · github.com
2GA
GPU-Accelerated Inference Hosting▲56
2021 · inferrd.com
3AM
A minimal C runtime for Linux i386 and x86_64 in 87 SLOC of C▲172
2015 · github.com
48B
8-bit CPU simulator in C▲67
2020 · github.com
5TL
TinyGo – LLVM-based Go compiler for microcontrollers▲177
2018 · github.com
6PA
Pystitcher – A Declarative Alternative to Pdftk▲117
2021 · github.com
7TR
Try running deep learning inference on Raspberry Pi▲53
2018 · actcast.io
8AM
A Modern C/C++ build tools (Simple, Fast, Cross-platform)▲89
2019 · xmake.io
9HP
High-performance ahead-of-time compiler for Machine Learning▲83
2018 · scss.tcd.ie
10MC
Moustique – C++14 coroutine-based non-blocking IO on Linux▲68
2018 · github.com
11CR
C++ runtime/compile-time detection in constexpr functions▲83
2017 · github.com
12FA
forthy2 – a higher level Forth-remix in C++▲65
2019 · github.com
13AM
A minimal stack based VM in C▲60
2020 · github.com
14JA
Jlama – A fast Java inference engine for GPT and Llama models▲7
2023 · github.com
15PS
Prof – Self-contained C/C++ profiler library for Linux▲22
2015 · github.com
16PP
Pipeglade – Pipe-Driven GTK+ Interfaces▲47
2015 · pipeglade.boundp.org
17PA
Pbtools, a fast protobuf library in C▲9
2019 · github.com
18G3
Gemma 3 inference in pure C++ with Metal acceleration▲6
Jul 2026 · github.com
19MA
MeTA: A Modern C++ Data Sciences Toolkit▲39
2014 · meta-toolkit.github.io
20LA
liblgpp – an extensible stack based VM for interpreters in C++▲12
2020 · github.com
21NA
NeuralScript – A pure-Rust AOT compiler▲5
May 2026 · github.com
22CA
Cat, a C++14 functional library▲34
2015 · cat.github.io
23ED
Efficient Data Formats for GPT▲6
2023 · nikas.praninskas.com
24RA
Rcjit – An experimental Jit Compiler for R▲7
2017 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →