nowfound

AI · alternatives · 2026

24 alternatives to MLX.fast

Open research network accelerating Poolside's Laguna on Mac

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

  1. 1
    Apple MLX▲138

    An array framework for machine learning on Apple silicon

    2023 · pypi.org · its alternatives →

  2. 2

    Massive local model speedup on Apple Silicon with MLX

    Apr 2026 · ollama.com · its alternatives →

  3. 3

    The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider. - raullenchai/Rapid-MLX

    Apr 2026 · github.com · its alternatives →

  4. 4

    A few months ago, I benchmarked FastAPI on an i9 MacBook Pro. I couldn't believe my eyes. A primary REST endpoint to `sum` two integers took 6 milliseconds to evaluate. It is okay if you are targeting a server in another city, but it should be less when your client and server apps are running on the same machine. FastAPI would have bottleneck-ed the inference of our lightweight UForm neural networks recently trending on HN under the title "Beating OpenAI CLIP with 100x less data and compute". (Thank you all for the kind words!) So I wrote another library. It has been a while since I have…

    2023 · github.com · its alternatives →

  5. 5
    Cai▲179

    Hi HN, Cai runs actions on your selection via ⌥C, pick an action (AI, shell, GitHub issue, Linear ticket), done. Bundled local model (MLX Community), create custom actions with prompts, scripts and more. Free, MIT. Built after my Raycast extension sat in review queue for 3+ months. Wanted no typing, no app switching, no cloud. Repo: https://github.com/cai-layer/cai Demo: https://youtu.be/LH2MYNQ_wsk

    Apr 2026 · getcai.app · its alternatives →

  6. 6
    BaseRT▲222

    6.4x faster than llama.cpp, 3.9x faster than MLX

    Jul 2026 · basecompute.co · its alternatives →

  7. 7
    Daytona ▲453

    Secure and elastic infra for running your AI-generated code.

    2025 · daytona.io · its alternatives →

  8. 8
    LTX.bio▲164

    Hey HN, after our 13B release we've been working on a faster version of our open-source video model and we're excited to share it. We started with a 13B base model that already had competitive generation speeds (e.g. 55s for a 5s video on an H100 — faster than any other model out there). But we wanted to push it further to allow everyone to quickly iterate over their video generations. So we built a distilled version focused on speed without sacrificing temporal or spatial coherence. With the Distilled model, you can now generate 5-second 720p videos in about 9.5 seconds on an H100, and…

    2021 · lightricks.com · its alternatives →

  9. 9

    Here's a project I've been working on for the last few months. It's a new (I think) algorithm, that allows to adjust smoothly - and in real time - how many calculations you'd like to do during inference of an LLM model. It seems that it's possible to do just 20-25% of weight multiplications instead of all of them, and still get good inference results. I implemented it to run on M1/M2/M3 GPU. The mmul approximation itself can be pushed to run 2x fast before the quality of output collapses. The inference speed is just a bit faster than Llama.cpp's, because the rest of implementation…

    2024 · asciinema.org · its alternatives →

  10. 10

    Host LLMs across devices sharing GPU to make your AI go brrr

    Oct 2025 · github.com · its alternatives →

  11. 11

    Hi HN! I'm just sharing a project I've been working on during the LLM Efficiency Challenge - you can now finetune Llama with QLoRA 5x faster than Huggingface's original implementation on your own local GPU. Some highlights: 1. Manual autograd engine - hand derived backprop steps. 2. QLoRA / LoRA 80% faster, 50% less memory. 3. All kernels written in OpenAI's Triton language. 4. 0% loss in accuracy - no approximation methods - all exact. 5. No change of hardware necessary. Supports NVIDIA GPUs since 2018+. CUDA 7.5+. 6. Flash Attention support via Xformers. 7. Supports 4bit and 16bit…

    2023 · github.com · its alternatives →

  12. 12

    I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/update, and mac-native using MLX and Swift. It ships with auto-mode, which makes a good tradeoff between memory usage and speed. I'll be implementing and porting the MTP module for speculative decoding next Local models really are the future of computing!

    Sep 2026 · github.com · its alternatives →

  13. 13

    Contribute to xadrianzetx/fullstack.ai development by creating an account on GitHub.

    2019 · github.com · its alternatives →

  14. 14MP
  15. 15

    The fastest way to run databases in AWS or GCP

    2025 · planetscale.com · its alternatives →

  16. 16

    Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference. - kossisoroyce/timber

    Mar 2026 · github.com · its alternatives →

  17. 17

    High-performance AI model loader

    2024 · its alternatives →

  18. 18
    Comet.ml▲208

    Automatically track machine learning code and experiments

    2018 · comet.com · its alternatives →

  19. 19

    Accelerate your machine learning experimentation

    2020 · docs.voxel51.com · its alternatives →

  20. 20

    The easiest way to use cloud GPUs

    2025 · tensorpool.dev · its alternatives →

  21. 21
    Ocean ▲123

    World's fastest ai search engine and assistant

    2025 · its alternatives →

  22. 22
    OpenClix▲148

    Agent-driven retention flows for mobile apps.

    Mar 2026 · openclix.ai · its alternatives →

  23. 23HP
  24. 24

    The ultimate Saas boilerplate for the phoenix framework

    2025 · fastphoenix.pro · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →