AI · alternatives · 2026
24 alternatives to Osaurus – Ollama-Compatible Runtime for Apple Foundation Models
Osaurus is an open-source local inference runtime for macOS, written in Swift and optimized for Apple Silicon. It lets you run Apple Foundation Models locally — fully accelerated by the Neural Engine — while also exposing OpenAI- and Ollama-compatible endpoints, so you can connect your favorite apps, tools, or clients without any code changes. Key points: * Supports Apple Foundation Models natively * Compatible with OpenAI & Ollama APIs * ~7 MB binary, runs locally (no cloud, no telemetry) * MIT Licensed, open source Project: https://osaurus.ai Source:…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
Osaurus▲534Open source agents that run 100% locally on your Mac
Jul 2026 · osaurus.ai · its alternatives →
- 2
Ollama v0.19▲410Massive local model speedup on Apple Silicon with MLX
Apr 2026 · ollama.com · its alternatives →
- 3
Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal. I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone. So I wanted to push the limits a bit and run a model whose weights don’t fit in memory. The model’s 4-bit quantized weights occupy roughly 14 GB, which makes running it with conventional inference tools almost impossible on an 8 GB or even 16 GB Mac once the OS, applications, and KV cache are…
Jul 2026 · github.com · its alternatives →
- 4
Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…
2023 · github.com · its alternatives →
- 5
- 6
- 7
Ollama▲235The easiest way to run large language models locally
2023 · github.com · its alternatives →
- 8
1Code▲569Just to clarify the background a bit. This project wasn’t planned as a big standalone release at first. On January 16, Ollama added support for an Anthropic-compatible API, and I was curious how far this could be pushed in practice. I decided to try plugging local Ollama models directly into a Claude Code-style workflow and see if it would actually work end to end. Here is the release note from Ollama that made this possible: https://ollama.com/blog/claude Technically, what I do is pretty straightforward: - Detect which local models are available in Ollama. - When…
Jan 2026 · github.com · its alternatives →
- 9
Hey HN, Henry and Roman here - we've been building a cross-platform framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones. Deploying directly on phones facilitates building AI apps and agents capable of phone use without breaking privacy, supports real-time inference with no latency, we have seen personalised RAG pipelines for users and more. Apple and Google actively went into local AI models recently with the launch of Apple Foundation Frameworks…
2025 · github.com · its alternatives →
- 10
Hi Hackers, Excited to share a macOS app I've been working on: https://recurse.chat/ for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp / llamafile / ollama / llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver.…
2024 · recurse.chat · its alternatives →
- 11
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
- 12
Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference. - kossisoroyce/timber
Mar 2026 · github.com · its alternatives →
- 13
Run leading vision models locally with the new engine
2025 · ollama.com · its alternatives →
- 14
NativeMind▲468Your fully private, open-source, on-device AI assistant
2025 · nativemind.app · its alternatives →
- 15
We built SwiftAI, an open-source Swift library that lets you use Apple’s on-device LLMs when available (Apple opened access in June), and fall back to a cloud model when they aren’t available — all without duplicating code. SwiftAI gives you: - A single, model-agnostic API - An agent/tool loop - Strongly-typed structured outputs - Optional chat state Backstory: We started experimenting with Apple’s local models because they’re free (no API calls), private, and work offline. The problem: not all devices support them (older iPhones, Apple Intelligence disabled, low battery, etc.). That…
2025 · github.com · its alternatives →
- 16OS
Complete AI Platform: RAG Systems & Intelligent Agents for Local AI
2025 · rlama.dev · its alternatives →
- 17OO
Hello everyone. This is Yujong from the Hyprnote team (https://github.com/fastrepl/hyprnote). We built OWhisper for 2 reasons: (Also outlined in https://docs.hyprnote.com/owhisper/what-is-this) (1). While working with on-device, realtime speech-to-text, we found there isn't tooling that exists to download / run the model in a practical way. (2). Also, we got frequent requests to provide a way to plug in custom STT endpoints to the Hyprnote desktop app, just like doing it with OpenAI-compatible LLM endpoints. The (2) part is still kind of WIP, but…
2025 · docs.hyprnote.com · its alternatives →
- 18
Hi HN! I’m excited to share Orange Intelligence, an open-source alternative to Apple Intelligence for macOS. Orange Intelligence allows you to interact with any text on your macOS system in a more powerful and customizable way. It brings a floating text processor that integrates seamlessly with your workflow. Whether you’re a developer, writer, or productivity enthusiast, this tool can boost your efficiency. Key Features: Floating Text Processor: Trigger a floating window by double-tapping the Option key to process selected text. Run Any Python Function: From basic text manipulations to…
2025 · github.com · its alternatives →
- 19
Aspen▲190Blazing fast API tester with AI helper & no login required
2024 · getaspen.io · its alternatives →
- 20
iBrowsy▲92AI-powered macOS open source browser with Ai built in.
2025 · github.com · its alternatives →
- 21
This lets you talk to local LLMs in Apple Notes. I saw Obsidian Ollama (https://github.com/hinterdupfinger/obsidian-ollama) and thought it was handy, but I'm too lazy to migrate away from the Apple ecosystem, so I quickly hacked this together. I tend to use Notes as a scratchpad for prompts, so it's nice to do some quick inference without leaving the app. Notes doesn't really support plugins so I'm using the macOS accessibility API for reading selections and then stream responses using the clipboard (not ideal but it works).
2024 · smallest.app · its alternatives →
- 22
Hello everyone, I've built a simple macOS app for chatting with models downloaded by Ollama - https://github.com/sheshbabu/Chital It's written in Swift, consumes less memory and loads fast. It has these features: * Support for multiple chat threads * Switch between different models * Markdown support * Automatic chat thread title summarization It's my first time working with Swift and Xcode, and it has been an interesting journey. The performance of the application is a big plus when building native apps, but I wonder if I'll be able to add features like document…
2024 · github.com · its alternatives →
- 23
I’ve been building Oliphaunt, a native Mastodon client for macOS, as a solo project — designed to be fast, lightweight and feel right at home on the Mac. It’s not built with Catalyst or Electron framework. Key features: • Native macOS UI using AppKit with some SwiftUI integration (not a web wrapper) • Core Data for local caching • Responsive, keyboard-friendly interface • UX tailored for desktop-class Mac computers • Supports multiple accounts, cross-instance timelines and search You can try it via TestFlight (macOS 14+ Sonoma): https://testflight.apple.com/join/Epq1P3Cw…
2025 · testflight.apple.com · its alternatives →
- 24
Lekh AI▲80Run powerful AI models on your Mac:fully offline and private
Jan 2026 · apps.apple.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →