Work · alternatives · 2026
24 alternatives to Gemma 4 Multimodal Fine-Tuner for Apple Silicon
About six months ago, I started working on a project to fine-tune Whisper locally on my M2 Ultra Mac Studio with a limited compute budget. I got into it. The problem I had at the time was I had 15,000 hours of audio data in Google Cloud Storage, and there was no way I could fit all the audio onto my local machine, so I built a system to stream data from my GCS to my machine during training. Gemma 3n came out, so I added that. Kinda went nuts, tbh. Then I put it on the shelf. When Gemma 4 came out a few days ago, I dusted it off, cleaned it up, broke out the Gemma part from the Whisper…
Gemma 4 Multimodal Fine-Tuner for Apple Silicon is a tool for fine-tuning the Gemma 4 language model on Mac computers with Apple Silicon chips. It supports streaming training data from Google Cloud Storage, enabling… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier.
- 1
Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal. I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone. So I wanted to push the limits a bit and run a model whose weights don’t fit in memory. The model’s 4-bit quantized weights occupy roughly 14 GB, which makes running it with conventional inference tools almost impossible on an 8 GB or even 16 GB Mac once the OS, applications, and KV cache are…
Jul 2026 · github.com · its alternatives →
- 2
Gemma 3n▲199Run powerful multimodal AI right on your phone
2025 · developers.googleblog.com · its alternatives →
- 3
Hey HN! Braden here, creator of Whispering, an open-source speech-to-text app. I really like dictation. For years, I relied on transcription tools that were almost good, but they were all closed-source. Even a lot of them that claimed to be “local” or “on-device” were still black boxes that left me wondering where my audio really went. So I built Whispering. It’s open-source, local-first, and most importantly, transparent with your data. Your data is stored locally on your device, and your audio goes directly from your machine to a local provider (Whisper C++, Speaches, etc.) or your chosen…
2025 · github.com · its alternatives →
- 4
Hi HN, OpenAI recently released a model for automatic speech recognition called Whisper [0]. I decided to reimplement the inference of the model from scratch using C/C++. To achieve this I implemented a minimalistic tensor library in C and ported the high-level architecture of the model in C++. The entire code is less than 8000 lines of code and is contained in just 2 source files without any third-party dependencies. The Github project is here: https://github.com/ggerganov/whisper.cpp With this implementation I can very easily build and run the model - “make…
2022 · github.com · its alternatives →
- 5
Hey HN, Henry & Roman here from Cactus. A small, on-device model is fast and private, but sometimes wrong, but frontier models are getting expensive pretty fast. So, we post-trained Gemma 4 E2B post-trained to know when it's wrong. Every response comes with a confidence score between 0 and 1. Developers can accept the on-device when it's high, hand off to a bigger cloud model when it's low. By routing only 15-35% of queries to Gemini 3.1 Flash-Lite, Gemma-4-E2B matches Gemini 3.1 Flash-Lite on most benchmarks. - ChartQA: 15-20% - LibriSpeech: 25-30% - MMBench, GigaSpeech, MMAU: 30-35% -…
Jul 2026 · github.com · its alternatives →
- 6
- 7
Google Gemma 4▲437Google's most intelligent open models to date
Apr 2026 · blog.google · its alternatives →
- 8
Hi HN, I'm a longtime web dev, but this is my first macOS app. Feedback is very welcome <3 I built TongueType because every dictation app I tried failed at least one of three things: it sent my audio to someone's cloud, it charged me monthly fee, or it felt clunky or enterprisy. The cloud thing kills it for anything sensitive. The subscription thing is insulting for what amounts to "Whisper + a hotkey." TongueType runs Whisper locally on Apple Silicon via CoreML. It's built to feel like a second keyboard: tap the hotkey, talk, let go, words appear. It sits in the menu bar (no dock icon, no…
May 2026 · tonguetype.app · its alternatives →
- 9
Dictatofree tier, from $20.82/mo▲93I built a macOS dictation app where everything runs on-device. Transcription, auto-correct, translation. No audio or text leaves your machine. It ships with 4 transcription engines you can swap between: WhisperKit (99 languages), NVIDIA Parakeet TDT 0.6B (25 European languages, fastest of the bunch), Qwen3-ASR 0.6B (30 languages), and Apple Speech on macOS 26+. They all run through CoreML/Metal. Whisper is the most versatile, Parakeet wins on raw latency for European languages, Qwen3 does better with CJK. I went with a protocol-based architecture so you pick the engine that fits your…
Feb 2026 · dicta.to · its alternatives →
- 10
- 11
Gemma 2▲279Lightweight, state-of-the-art open models from Google
2024 · blog.google · its alternatives →
- 12
I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/update, and mac-native using MLX and Swift. It ships with auto-mode, which makes a good tradeoff between memory usage and speed. I'll be implementing and porting the MTP module for speculative decoding next Local models really are the future of computing!
Sep 2026 · github.com · its alternatives →
- 13
MacWhisper▲123High quality text transcription with OpenAI's whisper on Mac
2023 · goodsnooze.gumroad.com · its alternatives →
- 14
MacYaps▲88Hello HN! After having fun with SlapMac a few weeks ago, I wanted to take the idea further — so I built MacYaps, a menu bar app that makes your Mac talk back with funny sounds (or serious if you wish) for real events like low battery, WiFi drops, charger status changes, high CPU, and USB connections (more triggers to come). Multiple voice packs + full custom sound support included. Short demo found here: https://macyaps.com/demo. Would genuinely appreciate any feedback. Or let me know if you'd like any other triggers in the app. Discount Code: `HACKERNEWS` to get it for $4.49…
Apr 2026 · macyaps.com · its alternatives →
- 15
Silkwavefree tier, from $19.99/mo▲104AI transcription app and note taker for macOS. Record meetings, lectures, and podcasts or import audio files you already have, transcribe in 10+ languages using on-device Apple models, see who said what with on-device speaker identification, get ChatGPT-powered summaries, and chat with your recordin
Jan 2026 · silkwave.ai · its alternatives →
- 16
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. - MakazhanAlpamys/Soup
Aug 2026 · github.com · its alternatives →
- 17
Gemma Gem is a Chrome extension that loads Google's Gemma 4 (2B) through WebGPU in an offscreen document and gives it tools to interact with any webpage: read content, take screenshots, click elements, type text, scroll, and run JavaScript. You get a small chat overlay on every page. Ask it about the page and it (usually) figures out which tools to call. It has a thinking mode that shows chain-of-thought reasoning as it works. It's a 2B model in a browser. It works for simple page questions and running JavaScript, but multi-step tool chains are unreliable and it sometimes ignores its tools…
Apr 2026 · github.com · its alternatives →
- 18
My friend built this and I'm blown away with how much fun it is and the high level of polish. It renders 9 different strange attractors (Lorenz, Rössler, Aizawa, Chen, etc.) as particle systems — thousands of particles tracing chaotic paths in real time. You can rotate and zoom with touch/trackpad in 3D. The sound is the part that surprised me. It's not a soundtrack — the audio is generated from the motion itself using spatial audio, so tones shift as the attractor's behavior changes and the sound moves around you as you rotate the form. Put on headphones. The Playdate version uses the…
Jun 2026 · fieldbw.com · its alternatives →
- 19
Hey HN, I built superwhisper out of frustration with the native dictation capabilities of macOS. Inaccurate, required manual punctuation, didnt activate in some contexts or would have audio capture issues. I wanted a replacement that worked offline, had cross language support, was configurable and worked in any application. Under the hood the app is using whisper.cpp, which runs really well on the Apple Silicon chips. You can use the base and standard size models for free, larger models sizes and languages other than english are paid. Let me know what you think! For context, I launched this…
2023 · superwhisper.com · its alternatives →
- 20
- 21
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model can provide. It runs fine on CPU, but can also run on Apple Silicon GPU, although I did not notice any performance improvements with GPU (tested on a M5 chip). I think these local lightweight and multimodal models will open multiple possibilities for new software tools where privacy is essential.
May 2026 · snapname.app · its alternatives →
- 22
Vox ▲27On-device AI dictation for Mac and Windows. Press, speak, paste — no cloud round-trip, no app account, no waiting.
Jun 2026 · vox.rizenhq.com · its alternatives →
- 23
I wrote a small local tool to transcribe audio notes (Whisper/Parakeet). Code: https://github.com/bilawalriaz/lazy-notes I wanted to process raw transcripts locally without OpenRouter. Llama 3.2 3B with a prompt was decent but incomplete, so I tried SFT. I fine-tuned Llama 3.2 3B to clean/analyze dictation and emit structured JSON (title, tags, entities, dates, actions). Data: 13 real memos → Kimi K2 gold JSON → ~40k synthetic + gold; keys canonicalized. Chutes.ai (5k req/day). Training: RTX 4090 24GB, ~4h, LoRA (r=128, α=128, dropout=0.05), max seq 2048,…
2025 · bilawal.net · its alternatives →
- 24
Sayline▲83I built a voice dictation app for macOS mostly because I was tired of how awful Siri is and I didn't want to pay a subscription for cloud tools. The app uses NVIDIA's Parakeet v3 (TDT) as the primary engine. Inference is handled by the FluidAudio library. It's insanely fast on M-series chips. For Intel users, I added local Whisper support ranging from Tiny up to Large v3 Turbo (quantized to save space). The interesting part was the AI integration. I originally tried to pipeline the ASR output into Apple's Intelligence Foundation Model. It was a nightmare, because the content moderation…
Jan 2026 · sayline.app · its alternatives →
Also compare
- Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac alternatives
- Gemma 3n alternatives
- Whispering – Open-source, local-first dictation you can trust alternatives
- Port of OpenAI's Whisper model in C/C++ alternatives
- Cactus Hybrid: We taught Gemma 4 to know when it's wrong alternatives
- Gemma 3 alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →