Alternatives

Products that do what Jlama – A fast Java inference engine for GPT and Llama models does

1. 1HM
   Hindley-Milner Type Inference Algorithm in OCaml▲136

   2016 · github.com

2. 2GA
   GPU-Accelerated Inference Hosting▲56

   2021 · inferrd.com

3. 3BA
   Brancher – A user-friendly PyTorch module for probabilistic inference▲96

   2019 · brancher.org

4. 4GW
   Goku – WASM (wllama)-powered LLM inference and model manager▲9

   Jul 2026 · userfrom1995.github.io

5. 5NU
   Neuropod – Uber ATG's open source deep learning inference engine▲80

   2020 · github.com

6. 6IG
   Inference GUIs for 12 SoTA ML models▲9

   2020 · gradiohub.com

7. 7SH
   Skizze – High-throughput probabilistic data structure service▲53

   2016 · github.com

8. 8PP
   Plait.py – a fake data modeler▲85

   2018 · github.com

9. 9GJ
   GPT-J inference on the CPU using C/C++▲5

   2022 · github.com

10. 10MA
    MistQL, a mini-language for querying JSON-like structures▲55

    2021 · mistql.com

11. 11
    BigML▲64

    Machine learning as a service - build predictive apps

    2014

12. 12LA
    Lambdacult, a low-cost alternative to API Gateway for Lambda functions▲47

    2017 · lambdacult.com

13. 13AA
    AutoAI – A framework to find the best performing AI/ML model▲41

    2021 · github.com

14. 14BS
    BonzAI – self-sovereign, local LLM inference in the browser▲5

    May 2026 · bonzai.sh

15. 15FA
    FlashQwen – A from-scratch CUDA inference engine for Qwen3▲5

    Jun 2026 · github.com

16. 16KA
    KeraSH, a ML Framework in Shell▲15

    2019 · github.com

17. 17ZE
    ZenML, extensible open-source MLOps framework for reproducible ML▲37

    2020 · github.com

18. 18MI
    Mighty Inference Server▲6

    2022 · max.io

19. 19LM
    LLaMArch – Minimal, Building Blocks for Large Language Models▲5

    2024 · gpavanb1.github.io

20. 20PA
    Panini AI – A platform to serve ML/DL models at low latency▲29

    2019 · panini.ai

21. 21MI
    MLReef – its Gitlab for machine learning (open source / alpha)▲5

    2020 · mlreef.com

22. 22RA
    Rembulan, an implementation of Lua 5.3 for the JVM▲6

    2016 · github.com

23. 23SO
    Seldon – Open Predictive AI released on GitHub under Apache 2.0▲27

    2015 · seldon.io

24. 24AG
    A GUI for OpenAI's GPT-2 774M model▲11

    2019 · storyai.botsociety.io

Ranked by how close each launch is in meaning, then by votes. Refine with a description →