nowfound

AI · free · 2026

24 free alternatives to TurboQuant

New LLM compression algorithm by Google

Below are 24 products that do a similar job and cost nothing to start: 22 free outright and 2 with a free plan and paid upgrades. Each price was read from the product's own site. They are ranked by how close each is in meaning, then by launch-day votes.

  1. 1
    TurboQuant-WASMFree▲165

    TurboQuant WASM SIMD vector compression — 3 bits/dim with fast dot product. Requires relaxed SIMD (Chrome 114+, Firefox 128+, Safari 18+, Node 20+)

    Apr 2026 · github.com · price checked November 2026

  2. 2

    A vector index built on TurboQuant, written in Rust with Python bindings

    Mar 2026 · github.com · price checked November 2026

  3. 3
    LLocalSearchFree▲669

    The video demo runs a 7b Model on a normal gaming GPU. I think it already works quite well (accounting for the limited hardware power). :)

    2024 · github.com · price checked September 2026

  4. 4

    This project documents efforts to run GLM 5.2, a large language model comparable to Claude or GPT, on standard consumer hardware with limited resources.

    Jul 2026 · github.com · price checked November 2026

  5. 5

    This project provides an optimized implementation for finetuning Llama models using QLoRA and LoRA techniques on local GPUs.

    2023 · github.com · price checked November 2026

  6. 6

    This project replicates mechanistic interpretability research on large language models using sparse autoencoders, building on published work from Anthropic, OpenAI, and DeepMind.

    2024 · github.com · price checked November 2026

  7. 7
    guppylmFree▲915

    Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.

    Apr 2026 · github.com · price checked November 2026

  8. 8
    TensorZeroFree▲307

    TensorZero is an open-source platform for building LLM applications at scale.

    2025 · github.com · price checked November 2026

  9. 9
    Context GatewayFree▲219

    Context Gateway is an open-source proxy that sits between AI coding agents and language models, compressing tool outputs to reduce token usage and improve quality.

    Mar 2026 · github.com · price checked November 2026

  10. 10
    Tiny-vLLMFree▲205

    Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

    May 2026 · github.com · price checked November 2026

  11. 11

    LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

    2025 · github.com · price checked November 2026

  12. 12

    Min.js Style Compression of Tech Docs for LLM Context

    2025 · github.com · price checked November 2026

  13. 13

    GUI Based on the implementation of Google's TurboQuant

    Apr 2026 · github.com · price checked November 2026

  14. 14
    LLMrefsFree plan, paid from $79/mo▲314

    AI SEO Keyword Rank Tracker for LLM Search Engines

    2025 · llmrefs.com · price checked November 2026

  15. 15
    LlamaGymFree▲239

    Fine-tune LLM agents with online reinforcement learning

    2024 · github.com · price checked November 2026

  16. 16
    MarvinFree▲127

    Marvin is an open-source Python library for building AI-powered applications that use large language models as a runtime.

    2023 · github.com · price checked November 2026

  17. 17

    Finetuning Hub is a benchmarking resource for evaluating publicly available large language models on finetuning tasks.

    2023 · github.com · price checked November 2026

  18. 18

    This tool helps developers systematically test and evaluate different combinations of language models, prompts, and retrieval architectures for LLM applications.

    2024 · github.com · price checked November 2026

  19. 19
    FinetuneDBFree plan▲152

    FinetuneDB is an LLM fine-tuning platform that helps teams create and manage high-quality datasets for training custom language models.

    2024 · finetunedb.com · price checked November 2026

  20. 20

    This framework provides fine-grained stylistic control of language model outputs by combining multiple models and system prompts using mathematical formulas.

    2023 · github.com · price checked November 2026

  21. 21
    LLMFree▲45

    LLM is an open-source Rust crate and command-line tool for running large language models like LLaMA and GPT-NeoX on CPUs.

    2023 · github.com · price checked November 2026

  22. 22
    TuneTrain.aiFree▲79

    Fine-tune language models with your data

    2025 · tunetrain.ai · price checked November 2026

  23. 23
    CodeRLMFree▲81

    CodeRLM is a code indexing tool that helps LLM coding agents navigate and understand large codebases more efficiently.

    Feb 2026 · github.com · price checked November 2026

  24. 24

    The Emotion Engine has 32 MB of RAM total, so the trick is streaming weights from CD-ROM one matrix at a time during the forward pass — only activations, KV cache and embeddings live in RAM. This means models bigger than the RAM can still run, they just read more from disc. Had to build a custom quantized format (PSNT), hack endianness, write a tokenizer pipeline, and most of the PS2 SDK from scratch (releasing that separately). The model itself is also custom — a 10M param Llama-style architecture I trained specifically for this. And it works. On real hardware.

    Mar 2026 · github.com · price checked November 2026

Free tools by topic

All alternatives to TurboQuant, paid too →About TurboQuant →

Free means the product’s own site says it is free or offers a free plan, as read on the date shown. Plans change; check the site before you rely on one.