AI · alternatives · 2026

24 alternatives to Distributed Inference,Apply DL to WebRTC Video Frames via Redis Streams

Hi HN! I’m so excited to show my another open-source project here. It is a PoC project. Distributed Inference is a project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams. This project consists of multiple services, which are written in Go, Python, and TypeScript, running on Docker. It allows setting up multiple inference services in multiple host machines, in a distributed manner. It does RPC-like calls and service discovery via my other open-source projects, go-inventa and…

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Distributed Inference,Apply DL to WebRTC Video Frames via Redis Streams launched in 2023; newer entries below may have overtaken it.

1
Pip install inference, open source computer vision deployment▲71
Deploying vision models is time consuming and tedious. Setting up dependencies. Fixing conflicts. Configuring TRT acceleration. Flashing (and re-flashing) NVIDIA Jetsons. A streamlined, developer-friendly solution for inference is needed. We, the Roboflow team, have been hard at work open sourcing Inference, an open source vision deployment solution. Our solution is designed with developers in mind, offering a HTTP-based interface. Run models on your hardware without having to write architecture-specific inference code. Here's a demo showing how to go from a model to GPU inference on a video…
2023 · github.com · its alternatives →
2
Trieve Vector Inference▲168
Deploy fast, unmetered embedding inference in your own VPC
2024 · its alternatives →
3
General Compute▲315
AI models that run on an inference cloud optimized for speed
May 2026 · generalcompute.com · its alternatives →
4
ZeroGPU▲298
The compute efficient layer for AI inference
Jun 2026 · zerogpu.ai · its alternatives →
5
WebRTC Nuts and Bolts, A holistic way of understanding how WebRTC runs▲124
Hi HN! I’m so excited to show my first open-source project and first post here. I initially started this project to learn Go language, it is an experimental project. The main goal is to track the adventure of a WebRTC stream from start to finish, by debugging the project or tracking the output at console. By trying out this project, you will deep dive into the steps which are taken while starting up a WebRTC session, and more. It consists of a web UI (TypeScript) and a server back-end (Golang) projects. They can run on Docker containers, in development mode or production mode, you can find…
2022 · github.com · its alternatives →
6
Inference Engine by GMI Cloud▲180
Fast multimodal-native inference at scale
Dec 2025 · gmicloud.ai · its alternatives →
7
I put an AI agent on a $7/month VPS with IRC as its transport layer▲340
The stack: two agents on separate boxes. The public one (nullclaw) is a 678 KB Zig binary using ~1 MB RAM, connected to an Ergo IRC server. Visitors talk to it via a gamja web client embedded in my site. The private one (ironclaw) handles email and scheduling, reachable only over Tailscale via Google's A2A protocol. Tiered inference: Haiku 4.5 for conversation (sub-second, cheap), Sonnet 4.6 for tool use (only when needed). Hard cap at $2/day. A2A passthrough: the private-side agent borrows the gateway's own inference pipeline, so there's one API key and one billing relationship…
Mar 2026 · georgelarson.me · its alternatives →
8PT
Peer-to-peer mini r/place with Proof of Work▲122
Hi HN, This is a site where users can submit content and the shortest SHA256 value of nonce+content among them will make the site display the content. Very basic, without a blockchain. It's a static site with WebRTC and peer-to-peer. Why? I wanted r/place (Reddit canvas where users collaborate on a pixel grid), but with proof of work. This is my progress so far. It's a WebRTC app with peer to peer connectivity that forwards the best hashed values to other users, which verify them, display them and pass them on. There are many many improvements to be done (especially I should probably…
2024 · tropical.pages.dev · its alternatives →
9
ytcast – cast YouTube videos to your smart TV from command-line▲227
hi, this is a project I've been working on and off for the last three months, it's my first non-trivial, non-hello-world, actually useful (at least to me) go project. it would be very nice if you could just try the program and see if it works on your setup! the readme[0] explains how it works, why I wrote it and how it fits in my "command-line centric" computing environment (there is also a video demo[1] :)). if you know go, feel free to take a look at the code and review it! I'm still pretty much new to go and I'd love to hear opinions, feedback and tips from more seasoned go developers :)…
2022 · github.com · its alternatives →
10
We made our own inference engine for Apple Silicon▲186
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
11
I built a tensor library from scratch in C++/CUDA▲119
Hi HN, Over the past few months, I've been building `dsc`, a tensor library from scratch in C++/CUDA. My main focus has been on getting the basics right, prioritizing a clean API, simplicity, and clear observability for running small LLMs locally. The key features are: - C++ core with CUDA support written from scratch. - A familiar, PyTorch-like Python API. - Runs real models: it's complete enough to load a model like Qwen from HuggingFace and run inference on both CUDA and CPU with a single line change[1]. - Simple, built-in observability for both Python and C++. Next on the roadmap is…
2025 · github.com · its alternatives →
12
gRPC over WebRTC▲102
gRPC over WebRTC. Contribute to jsmouret/grpc-over-webrtc development by creating an account on GitHub.
2020 · github.com · its alternatives →
13
Initial release of the distributed TensorFlow runtime▲85
An Open Source Machine Learning Framework for Everyone - tensorflow/tensorflow/core/distributed_runtime at master · tensorflow/tensorflow
2016 · github.com · its alternatives →
14
AI-powered web service combining FastAPI, Pydantic-AI, and MCP servers▲46
Hey all! I recently gave a workshop talk at PyCon Greece 2025 about building production-ready agent systems. To check the workshop, I put together a demo repo: (I will add the slides too soon in my blog: https://www.petrostechchronicles.com/) https://github.com/Aherontas/Pycon_Greece_2025_Presentation_... The idea was to show how multiple AI agents can collaborate using FastAPI + Pydantic-AI, with protocols like MCP (Model Context Protocol) and A2A (Agent-to-Agent) for safe communication and orchestration. Features: - Multiple agents running in containers -…
2025 · github.com · its alternatives →
15
AV1 and WebRTC▲72
Pure Go implementation of the WebRTC API. Contribute to pion/webrtc development by creating an account on GitHub.
2022 · github.com · its alternatives →
16
Open source machine learning inference accelerators on FPGA▲57
Tom from Tensil here - happy to answer questions! We developed Tensil to bring custom ML accelerators to people who don't have the resources of companies like Google, Facebook and Tesla. Currently, we're focused on supporting convolutional neural network inference on edge FPGA (field programmable gate array) platforms, but we aim to support all model architectures on a wide variety of fabrics for both training and inference. Tensil is different from other ML accelerators in that it is open source and really easy to use. For example, you can generate a custom accelerator with one command: $…
2022 · tensil.ai · its alternatives →
17
Distributed Llama – Run LLMs on multiple devices in parallel▲12
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference. - b4rtaz/distributed-llama
2024 · github.com · its alternatives →
18
Ghostlink ▲11
Run local LLMs across heterogeneous clusters
Jul 2026 · github.com · its alternatives →
19
OpenCV over WebRTC (in Go)▲57
Examples of WebRTC applications that are large, or use 3rd party libraries - example-webrtc-applications/gocv-to-webrtc/README.md at main · pion/example-webrtc-applications
2025 · github.com · its alternatives →
20
An RDMA/Infiniband Distributed Cache for Fast Inference and Training▲13
A high-performance RDMA distributed file system for fast LLM Inference and GPU Training. - GitHub - blackbird-io/blackbird: A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.
2025 · github.com · its alternatives →
21
Visual inference exploration and experimentation playground▲46
Most inference UIs that I've come across pretty much just give us a chat-like interface to toy around with models in a single visual conversation thread. Given the fact that we are limited to seeing only one output at a time, it's kind of hard to compare outputs from different models, adjustments made to the prompting, and sampler settings. But even when keeping the generation parameters the same (e.g., to test for reliability in the output) and just going for multiple passes, there is no easy way to have a side-by-side comparison to keep track of the outputs from the multiple "rounds". I…
2024 · github.com · its alternatives →
22
OpenInfer▲19
Keep your OpenClaw agents running. Free beta, no code change
Apr 2026 · openinfer.io · its alternatives →
23
Covalent – distributed computing for ML, HPC and Quantum (open source)▲5
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments. - AgnostiqHQ/covalent
2022 · github.com · its alternatives →
24
Standalone Implementation of WebRTC DataChannels in C++17▲13
C/C++ WebRTC network library featuring Data Channels, Media Transport, and WebSockets - paullouisageneau/libdatachannel
2019 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →