Alternatives
Products that do what Ollama does
The easiest way to run large language models locally
- 1
- 2
- 3
- 4
- 5
- 6
- 7IB
hey hn, I built an open-source Perplexity clone that can run local LLMs and cloud LLMs. It's fully self-hostable through Docker and uses ollama to support local LLMs. The demo video in the repository shows me running it locally with llama3 on my M1 Macbook Pro. I'm open to any suggestions or feedback, thanks!
2024 · github.com
- 8
- 9
- 10
- 11
- 12
- 13NM
Hello everyone, I've built a simple macOS app for chatting with models downloaded by Ollama - https://github.com/sheshbabu/Chital It's written in Swift, consumes less memory and loads fast. It has these features: * Support for multiple chat threads * Switch between different models * Markdown support * Automatic chat thread title summarization It's my first time working with Swift and Xcode, and it has been an interesting journey. The performance of the application is a big plus when building native apps, but I wonder if I'll be able to add features like document…
2024 · github.com
- 14LA
2023 · github.com
- 15OO
Osaurus is an open-source local inference runtime for macOS, written in Swift and optimized for Apple Silicon. It lets you run Apple Foundation Models locally — fully accelerated by the Neural Engine — while also exposing OpenAI- and Ollama-compatible endpoints, so you can connect your favorite apps, tools, or clients without any code changes. Key points: * Supports Apple Foundation Models natively * Compatible with OpenAI & Ollama APIs * ~7 MB binary, runs locally (no cloud, no telemetry) * MIT Licensed, open source Project: https://osaurus.ai Source:…
Oct 2025 · github.com
- 16LI
Excited to launch a side-project that I've been working on over the past few weeks, LlamaChat: an open-source SwiftUI app which allows you to chat with your local LLaMA models right on your Mac. Powered by the excellent llama.cpp (and Swift wrapper, llama.swift), LlamaChat allows you to import your local LLaMA models (and Alpaca, GPT4All, and soon, Vicuna and Koala) and interact with them locally.
2023 · github.com
- 17
- 18RA
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai
- 19
- 20
ChatOSS is built on Ollama. If you use Ollama, ChatOSS local works out of the box. ChatOSS is a GUI desktop app that has multiple agentic coding apps and a kanban board integrated into coding sessions. There's also a simple way to create your own AI powered apps that can run inside of ChatOSS.
18d ago · chatoss.ai
- 21PU
After seeing a cool demo of a hack on Twitter, I built a cross platform version of it that works well and uses streaming. From anywhere on Mac and Linux, trigger Ollama and optionally feed it your clipboard. I built it yesterday and it's already very useful to me. I'm pretty excited about it and wanted to share!
2024 · github.com
- 22AC
There's LLM Council and similar tools, but they use predefined model lineups. This one is different in a few ways that mattered to me: *Bring your own models.* Mix Ollama (local), OpenAI, Anthropic, Groq, Google — or any OpenAI-compatible endpoint — in whatever combination you want. A council of DeepSeek-R1 + llama2-uncensored + mistral-nemo is a very different deliberation than GPT-4o + Claude + Gemini. *Zero server, zero account, zero storage.* The app is purely static. API calls go directly from your browser to providers. Nothing touches a backend. No tokens, no sessions, no analytics.…
Feb 2026 · github.com
- 23OO
Hi HN, I built OpenHarness , an open-source terminal coding agent that works with any LLM: Ollama (free, local), OpenAI, Anthropic, Deepseek, Qwen or any OpenAI-compatible API. Install and run: npm install -g @zhijiewang/openharness oh # auto-detect local model oh --model ollama/qwen2.5:7b # specific model What it does: - 17 tools (file read/edit/write, bash, grep, glob, web search, task management, notebooks) - 16 slash commands (/diff, /undo, /commit, /cost, /compact, /plan, /review...) - Git integration: every AI edit auto-committed,…
Apr 2026 · github.com
- 24LA
Hi HN, I’m excited to share LocoStudio (http://locostudio.ai), a local-first AI chat app for Mac that lets you chat with AI models both locally and in the cloud—all in one place. Why I built it: I wanted a private, fast, and flexible way to use the latest AI models without sending my data to the cloud. Most AI chat apps are either cloud-only (raising privacy concerns) or have clunky interfaces for local models. LocoStudio aims to make local AI chat as easy and powerful as using ChatGPT, but with your data staying on your device. What it does: - Private, local-first: Run open models…
2025 · locostudio.ai
Ranked by how close each launch is in meaning, then by votes. Refine with a description →