nowfound

AI · free · 2026

24 free alternatives to BaseRT

6.4x faster than llama.cpp, 3.9x faster than MLX

BaseRT is free itself (its own site, checked November 2026). Below are 24 products that do a similar job and cost nothing to start: 23 free outright and 1 with a free plan and paid upgrades. Each price was read from the product's own site. They are ranked by how close each is in meaning, then by launch-day votes.

  1. 1

    This project provides an optimized implementation for finetuning Llama models using QLoRA and LoRA techniques on local GPUs.

    2023 · github.com · price checked November 2026

  2. 2
    LumeFree▲309

    We just open-sourced Lume - a tool we built after hitting walls with existing virtualization options on Apple Silicon. No GUI, no complex stacks - just a single binary that lets you spin up macOS or Linux VMs via CLI or API. Why we built Lume: - Run native macOS VMs in 1 command, using Apple Virtualization.Framework: `lume run macos-sequoia-vanilla:latest` - Prebuilt images on https://ghcr.io/trycua (macOS, Ubuntu on ARM) - API server to manage VMs programmatically `POST /lume/vms` - A python SDK on github.com/trycua/pylume Run prebuilt macOS images in just…

    2025 · github.com · price checked November 2026

  3. 3
    uzuFree▲186

    This is a Rust-based inference engine designed for Apple Silicon, built from scratch to run large language models.

    2025 · github.com · price checked November 2026

  4. 4

    TurboFieldfare is an inference engine built in Swift and Metal that enables M-series Macs to run the Gemma 4 26B model using approximately 2 GB of RAM.

    Jul 2026 · github.com · price checked November 2026

  5. 5
    Llama-dlFree▲343

    High-speed download of LLaMA, Facebook's 65B parameter GPT model

    2023 · github.com · price checked November 2026

  6. 6
    Alpaca.cppFree▲673

    Locally run an Instruction-Tuned Chat-Style LLM .

    2023 · github.com · price checked November 2026

  7. 7

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

    May 2026 · github.com · price checked November 2026

  8. 8
    Rapid-MLXFree▲9

    The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.

    Apr 2026 · github.com · price checked November 2026

  9. 9
    BifrostFree plan▲561

    The fastest LLM gateway in the market

    2025 · getmaxim.ai · price checked November 2026

  10. 10
    OllamaFree▲284

    Ollama lets users run large language models locally on Mac computers.

    2023 · github.com · price checked November 2026

  11. 11
    secret-llamaFree▲547

    This is a free in-browser chatbot that runs Llama 3 and Mistral 7B locally using WebGPU technology, eliminating the need for installations or external dependencies.

    2024 · github.com · price checked November 2026

  12. 12
    LlamaoFree▲496

    Private & offline alternative to ChatGPT on your device

    2025 · llamao.app · price checked November 2026

  13. 13
    OllamaFree▲235

    The easiest way to run large language models locally

    2023 · github.com · price checked November 2026

  14. 14

    This project provides tools and code for fine-tuning and serving Llama 3.1 on Google Cloud TPUs as an alternative to NVIDIA GPUs.

    2024 · github.com · price checked November 2026

  15. 15
    TurboPilotFree▲37

    TurboPilot is a code completion tool that runs a large language model on a CPU without requiring a GPU.

    2023 · github.com · price checked November 2026

  16. 16
    KVSplitFree▲272

    KVSplit is a modification to llama.cpp that enables independent quantization of keys and values in the KV cache for Apple Silicon processors.

    2025 · github.com · price checked November 2026

  17. 17

    Looking for the cheapest place to deploy llama 3.1 model? Don't worry we have found it so you don't have to.

    2024 · github.com · price checked November 2026

  18. 18
    LlamaGPTFree▲225

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    2023 · github.com · price checked November 2026

  19. 19
    Code ModeFree▲144

    🔌 Plug-and-play library to enable agents to call MCP and UTCP tools via code execution.

    Nov 2025 · github.com · price checked November 2026

  20. 20
    CaiFree▲179

    Free, open-source AI action layer for macOS.

    Apr 2026 · getcai.app · price checked November 2026

  21. 21

    Local LLM Notepad is a 45 MB Windows executable that runs GPT-style language models directly from a USB drive without requiring installation, admin rights, or internet access.

    2025 · github.com · price checked November 2026

  22. 22
    LLMFree▲45

    LLM is an open-source Rust crate and command-line tool for running large language models like LLaMA and GPT-NeoX on CPUs.

    2023 · github.com · price checked November 2026

  23. 23
    Soup CLIFree▲107

    Fine-tune an 8B LLM on a 4 GB laptop GPU

    Aug 2026 · trysoup.dev · price checked November 2026

  24. 24
    LLM-TermFree▲32

    LLM-Term is a Rust-based CLI tool that provides AI assistance directly from the command line.

    2024 · github.com · price checked November 2026

Free tools by topic

All alternatives to BaseRT, paid too →About BaseRT →

Free means the product’s own site says it is free or offers a free plan, as read on the date shown. Plans change; check the site before you rely on one.