AI · alternatives · 2026

24 alternatives to Xybrid – run LLM and speech locally in your app (no back end, Rust)

Hi HN, We built Xybrid, a Rust library for running LLM + speech pipelines directly inside your app, no server, no daemon, just one binary. We started building it while working on a privacy-focused LLM app with Tauri and realized there wasn’t a straightforward way to embed models directly into shipped applications without relying on a separate server process. Xybrid links into your process like any other library. It supports GGUF / ONNX / CoreML and integrates with Flutter, Swift, Kotlin, Unity, and Tauri, letting you run pipelines like speech → LLM → speech in a single call. On…

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

1
LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)▲45
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
2
ChattyUI▲149
Run open-source LLMs locally in the browser using WebGPU
2024 · its alternatives →
3
OpenWispr▲190
100% local open source AI speech-to-text model
2025 · openwhispr.com · its alternatives →
4
STT –> LLM –> TTS pipeline in C▲11
For speech-to-text, large-language-model inference and text-to-speech I created three wrapper libraries in C/C++ (using Whisper.cpp, Llama.cpp and Piper). Follow the URL to see an example that shows how to use these libraries for a speech-to-text, LLM inference, text-to-speech pipeline. Windows and Linux are supported.
2025 · github.com · its alternatives →
5
NobodyWho▲106
Hey, Hello, we are the team behind NobodyWho; an open-source plugin that embeds large language models functionality inside Unity and Godot games - completely locally and offline. We try to make it as easy and user friendly as possible to use our plugin, so feel free to create an issue on our GitHub if you have any inconveniences - and we will try to improve it! So why might this interest you: - Written in Rust with llama.cpp bindings and optional GPU back-ends (Vulkan / Metal) for fast inference. - Drop-in nodes / components: add a model asset and a chat or embedding node and get a…
Aug 2026 · github.com · its alternatives →
6
Open-source real-time transcription playground (React, Python, GCP)▲76
A real-time transcription project using React and socketio - GitHub - saharmor/realtime-transcription-playground: A real-time transcription project using React and socketio
2021 · github.com · its alternatives →
7
OpenBrief – Local-first video downloader/summarizer▲93
OpenBrief is basically a GUI for yt-dlp with some AI on top — paste a link, it downloads locally, and transcription and voice generation run with local AI on your machine. Summaries and chat over the transcript use an LLM, which is bring-your-own-key for now. It's open source and free.
May 2026 · github.com · its alternatives →
8
WebAssembly runtime embedded in Godot game engine▲32
A WebAssembly runtime embedded in Godot game engine projects. Interact with Wasm modules from GDScript. Accessing Wasm modules via GDScript provides the following benefits. - Sandboxed environment allows safely loading zero-trust mods/extensions to a project. - Single target means that Wasm modules can be built from any language e.g. Rust, Go, AssemblyScript and the single binary can be run on all platforms. - Fast execution compared to GDScript allows for offloading compute-heavy operations or running bots/mods/etc. at high FPS. This might be useful for loading mods, bot AI,…
2023 · github.com · its alternatives →
9CI
Can I run this LLM? (locally)▲42
One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.
2025 · can-i-run-this-llm-blue.vercel.app · its alternatives →
10
Speech To Markdown▲83
Harness local AI for notes
Jul 2026 · voice-to-md.xajik0.workers.dev · its alternatives →
11
LLM-Term – Simple Rust-based CLI assist tool▲32
Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.
2024 · github.com · its alternatives →
12
Voxabot▲67
Text to speech editor with SSML and API connections
2020 · voxabot.com · its alternatives →
13
Building an LLM from Scratch in TypeScript▲33
The from-scratch guide to building large language models in NodeJS.
10d ago · book.humanexperiences.io · its alternatives →
14MG
macOS GUI for running LLMs locally▲58
Hello HN, I've been working on this project for a while, and it has been in an "open" beta for some time. I finally believe it's ready for its first release. I hope you like it. Here are some potential questions that may arise: 1. How does it compare to LM Studio? It's likely that if you're already using LM Studio, you'll continue to do so. This project is designed to be more user-friendly. 2. Is it open-source? No, it is not. 3. Does it use any open-source libraries? Yes, it uses llama.cpp and a few others, as indicated in the license information included with the application. 4. Why is not…
2023 · avapls.com · its alternatives →
15
Verby▲72
Free text to speech converter with SSML editor
2019 · its alternatives →
16
Use LLMs to Interact with APIs▲35
Recently featured in a LangChain blog https://blog.langchain.dev/empowering-development-with-flowt... , use LLMs to construct an API first runnable workflow with an IDE experience.
2024 · github.com · its alternatives →
17
Chrome extension to run DeepSeek, LLMs and Whisper locally in browser▲10
Hi all, I open sourced my toy project that runs Generative AI models LOCALLY in the side panel of a Chrome extension. The Chrome extension uses Transformers.js to run models in browser under the hood. I've integrated and tested these models so far. \1. LLM: Llama 3, Phi 3.5, Qwen 2.5, SmolLM2 \2. Reasoning: DeepSeek R1 \3. Multimodal LLM: Janus \4. Speech-to-Text: Whisper On an M1 MacBook, DeepSeek R1 1.5B runs at ~30 tokens/sec If you're interested in, you can download the extension from chrome web store or clone my github repository. \1. chrome web store:…
2025 · github.com · its alternatives →
18
Gerbil – an open source desktop app for running LLMs locally▲37
Gerbil is an open source app that I've been working on for the last couple of months. The development now is largely done and I'm unlikely to add anymore major features. Instead I'm focusing on any bug fixes, small QoL features and dependency upgrades. Under the hood it runs llama.cpp (via koboldcpp) backends and allows easy integration with the popular modern frontends like Open WebUI, SillyTavern, ComfyUI, StableUI (built-in) and KoboldAI Lite (built-in). Why did I create this? I wanted an all-in-one solution for simple text and image-gen local LLMs. I got fed up with needing to manage…
Nov 2025 · github.com · its alternatives →
19
Local LLM Notepad – run a GPT-style model from a USB stick▲40
What it is A single 45 MB Windows .exe that embeds llama.cpp and a minimal Tk UI. Copy it (plus any .gguf model) to a flash drive, double-click on any Windows PC, and you’re chatting with an LLM—no admin rights, Cloud, or network. Why I built it Existing “local LLM” GUIs assume you can pip install, pass long CLI flags, or download GBs of extras. I wanted something my less-technical colleagues could run during a client visit by literally plugging in a USB drive. How it works PyInstaller one-file build → bundles Python runtime, llama_cpp_python, and the UI into a single PE. On first launch, it…
2025 · github.com · its alternatives →
20
Offeryn – Build Tools for LLMs in Rust, with Model Context Protocol▲7
Build tools for LLMs in Rust using Model Context Protocol - avahowell/offeryn
2025 · github.com · its alternatives →
21
Code interpreter with mixtral-8x7B-instruct▲35
Edge full-stack LLM platform. Written in Rust. Contribute to llm-edge/hal-9100 development by creating an account on GitHub.
2023 · github.com · its alternatives →
22
local-tts▲4
Make your coding agent talk to you! Offline!
Aug 2026 · github.com · its alternatives →
23
Use Apple Container with Gemini CLI▲5
We used Apple Containers to run LLM generated code locally. Leverage remote LLMs (like ChatGPT or Claude Sonnet 4) to work with your local files—such as videos—securely on your Mac. The LLM runs in a sandboxed environment where it can install external libraries, generate code, and execute it locally without uploading your data to the cloud.
2025 · github.com · its alternatives →
24
Motörhead, LLM Memory Server Built in Rust▲16
Motörhead is an open-source project aimed at helping developers build and manage LLM-based chat applications. We built Motörhead in Rust and it currently handles user sessions and context windows with the following features: -Short-term memory management: Motörhead maintains chat session histories for n users, keeping track of messages sent and received. -Incremental summarization: When the message buffer reaches a maximum window size, Motörhead incrementally summarizes the content into a context key. This process involves taking an existing summary and the messages removed from the list,…
2023 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →