Run LLaMa2 on the Browser with Ggml.js

In plain words

Ggml.js enables developers to run LLaMa2 language models directly in web browsers using serverless AI inference. The tool provides language model backends that allow building AI applications entirely on the client side without server dependencies. It is designed for developers who want to create web-based AI applications with local model execution capabilities.

written from the facts on this page · September 2026

• 
  Llama 22023 · developer.meta.com · ▲263

  The next generation of Meta's open source LLM

• 
  I built a free in-browser Llama 3 chatbot powered by WebGPU2024 · github.com · ▲547

  I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…

• 
  Ollama2023 · github.com · ▲235

  The easiest way to run large language models locally

• 
  A fully open-source (Apache 2.0)implementation of llama2023 · github.com · ▲158

  We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it must also be released under GPL. This "taints" any other code and prevents meaningful academic and commercial use. Lit-LLaMA solves that for good.

• 
  Apollo AI2025 · apps.apple.com · ▲280

  Run local models like Llama on iOS

• 
  LlamaGym – fine-tune LLM agents with online reinforcement learning2024 · github.com · ▲239

  Fine-tune LLM agents with online reinforcement learning - KhoomeiK/LlamaGym

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Beam.win▲377

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  Resend▲1,325

  An entire collection of pre-built components with a much faster development experience.

  Dev tools · 2023 · resend.com

• 
  STORI AI▲1,316

  Your ideas become visually compelling branded social posts

  AI · 2023 · storiai.com

• 
  Kombai▲1,079

  A new AI model that you can prompt with UI designs

  AI · 2023 · kombai.com

• 
  User Persona Generator▲1,014

  Understand your audience without 50 interviews

  AI · 2023 · founderpal.ai

• 
  Lottielab▲869

  Create and ship lottie animations to sites and apps faster

  Dev tools · 2023 · lottielab.com

• 
  LLMs can generate valid JSON 100% of the time▲854

  Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

  AI · 2023 · github.com