Chrome extension to run DeepSeek, LLMs and Whisper locally in browser

In plain words

This Chrome extension runs generative AI models directly in the browser's side panel without sending data to external servers. It supports multiple model types including language models like Llama 3 and Qwen 2.5, reasoning models like DeepSeek R1, multimodal models like Janus, and speech-to-text via Whisper. Built with Transformers.js, it's designed for users who want local AI processing within their browser, with performance around 30 tokens per second on M1 MacBooks. The project is open source and available on the Chrome Web Store.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Hi all, I open sourced my toy project that runs Generative AI models LOCALLY in the side panel of a Chrome extension. The Chrome extension uses Transformers.js to run models in browser under the hood. I've integrated and tested these models so far. \1. LLM: Llama 3, Phi 3.5, Qwen 2.5, SmolLM2 \2. Reasoning: DeepSeek R1 \3. Multimodal LLM: Janus \4. Speech-to-Text: Whisper On an M1 MacBook, DeepSeek R1 1.5B runs at ~30 tokens/sec If you're interested in, you can download the extension from chrome web store or clone my github repository. \1. chrome web store: https://chromewebstore.google.com/detail/private-ai-assistan... \2. github: https://github.com/tantara/transformers.js-chrome \3. demo: https://www.youtube.com/watch?v=MSCDdFG5Lls It's my first react project. Feedback is always welcome!

• 
  PlugThisJul 2026 · plugthis.ai · ▲448

  Create your own Chrome Extensions by chatting with AI

• IB
  I built a free in-browser Llama 3 chatbot powered by WebGPU2024 · github.com · ▲547

  I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…

• 
  LM Studio2025 · ▲209

  Discover, download, and run local LLMs (incl. DeepSeek R1)

• WE
  WebGPU enables local LLM in the browser – demo site with AI chat2025 · andreinwald.github.io · ▲145

  Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/ Code https://github.com/andreinwald/browser-llm - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github…

• BR
  BrowserAI – Run LLMs directly in browser using WebGPU (open source)2025 · github.com · ▲85

  Check out this impressive project that enables running LLMs entirely in the browser using WebGPU. Key features: - Zero token costs, no cloud infrastructure required - Complete data privacy through local processing - Simple 3-line code integration - Built on MLC and Transformer.js The benchmarks show smaller models can effectively handle many common tasks. Currently the project roadmap includes: - No-code AI pipeline builder - Browser-based RAG for document chat - Analytics/logging - Model fine-tuning interface

• 
  Apollo AI2025 · ▲280

  Run local models like Llama on iOS

• 
  I trained a 125M model to autocomplete piano on-device▲598

  I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

  AI · 17d ago · simedw.com

• 
  Astute▲585

  Automate your B2B brand going viral, with new media creators

  AI · 18d ago · company-app.joinastute.com

• 
  Grok Bot▲547

  AI teammates that you can give real work to

  AI · 25d ago · x.ai

• 
  Needle2: 14MB agentic LLM for phones, wearables, smart home and robots▲537

  Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

  AI · 27d ago · cactuscompute.com

• 
  Clara AI SDR▲460

  Turn website visitors into qualified pipeline

  AI · 19d ago · clarasdr.ai

• 
  Kane CLI▲446

  Natural language browser & mobile app tests from terminal

  AI · 24d ago · testmuai.com

• 
  Screen Studio 3.0▲1,833

  Beautiful screen recordings with instant shareable links

  Growth · 2025 · screen.studio

• 
  Tana▲1,666

  Put your notes to work with voice and AI

  AI · 2025 · tana.inc

• IG
  I got laid off from Meta and created a minor hit on Steam▲1,581

  I was at FB/Meta from late 2013 to early 2023, mostly working in the compiler/runtime spaces. I got hit in the spring 2023 layoff wave. I immediately started making games in my newfound free time (a lifelong interest, and I even worked in AA(A?) back ca. ~2000), and in October 2023 I stumbled upon the idea of a roguelike pachinko/plinko game inspired by Luck Be A Landlord. Things snowballed quickly, I started talking to publishers, then worked like crazy through all of 2024, almost the hardest I've ever worked in my career, and launched the game in December 2024. It's sold…

  Work · 2025

• 
  Tanka▲1,410

  AI Messenger with smart reply & long term memory for teams

  AI · 2025 · tanka.ai

• 
  Tool Finder▲1,327

  Your shortcut to better software

  AI · 2025 · toolfinder.com

• IB
  I built an app to stop me doomscrolling by touching grass▲1,203

  i wanted to change the habit of reaching for my phone in the morning and doomscrolling away an hour so i built an app to help me. now i have to literally touch grass before accessing my most distracting apps the app is built in swiftui, uses the screen time apis provided by apple and google vision to recognise grass or not i'd love to get your thoughts on the concept.

  Life & fun · 2025 · touchgrass.now