Alternatives

Products that do what Goku – WASM (wllama)-powered LLM inference and model manager does

1. 1CO
   Cortex – Open-source alternative to SageMaker for model serving▲65

   2020 · github.com

2. 2JA
   Jlama – A fast Java inference engine for GPT and Llama models▲7

   2023 · github.com

3. 3BA
   Brancher – A user-friendly PyTorch module for probabilistic inference▲96

   2019 · brancher.org

4. 4PA
   Panini AI – A platform to serve ML/DL models at low latency▲29

   2019 · panini.ai

5. 5GA
   GPU-Accelerated Inference Hosting▲56

   2021 · inferrd.com

6. 6NU
   Neuropod – Uber ATG's open source deep learning inference engine▲80

   2020 · github.com

7. 7
   Data Robot▲92

   Build Better Predictive Models — Faster

   2014

8. 8BS
   BonzAI – self-sovereign, local LLM inference in the browser▲5

   May 2026 · bonzai.sh

9. 9IG
   Inference GUIs for 12 SoTA ML models▲9

   2020 · gradiohub.com

10. 10BP
    Byte-Pair Encoding tokenizer for training LLMs on large datasets▲5

    2024 · github.com

11. 11SO
    Seldon – Open Predictive AI released on GitHub under Apache 2.0▲27

    2015 · seldon.io

12. 12VF
    Viveka: filter LLM output against a Lean-verified Advaita Vedanta model▲7

    Jun 2026 · github.com

13. 13RA
    Rembulan, an implementation of Lua 5.3 for the JVM▲6

    2016 · github.com

14. 14AN
    A Node Editor for LLMs with Semantic Kernel▲8

    2023 · docs.anyassistant.ai

15. 15DA
    Deepserve.ai – Heroku for Deep Learning▲7

    2020 · deepserve.ai

16. 16LC
    Local Coding Agent with LLMs to Delegate Tool Calls to Small AI Models▲9

    May 2026 · github.com

17. 17AH
    A Haskell DSL for deep learning models▲10

    2015 · github.com

18. 18ZG
    ZenModel – Golang framework for LLM Agentic apps▲5

    2024 · github.com

19. 19GM
    Go-Mind – A Neural Network Library Built in Go▲9

    2015 · github.com

20. 20LM
    LLaMArch – Minimal, Building Blocks for Large Language Models▲5

    2024 · gpavanb1.github.io

21. 21GF
    Grunden – Frontier AI inference hosted in Sweden, OpenAI-compatible▲7

    May 2026 · grunden.ai

22. 22LB
    Larq – Binarized Neural Network Inference with MLIR and TFLite▲6

    2020 · github.com

23. 23LL
    LLMStack – Low-Code Platform for Building LLM Apps with LocalAI Support▲7

    2023 · github.com

24. 24LA
    Local AI – Curated resources for running LLMs on consumer hardware▲5

    Feb 2026 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →