Radio LLM
Off-grid, disaster-proof LLM platform using Meshtastic
Radio LLM launched on December 17, 2024 with 141 votes, #307 of 5,365 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 1 year on.
What it does
An off-grid LLM platform deployed and accessible through 868Mhz LoRa mesh network. Requires no internet or whatever. Super long range. Useful in disaster/emergency situations. Supports user sessions, chat contextand even tools i.e calling emergency service.
LLM Platform with Meshtastic. Contribute to pham-tuan-binh/radio-llm development by creating an account on GitHub.
This repository provides a platform for integrating Large Language Models (LLMs) or Old-school Bots with the Meshtastic mesh communication network. It allows users on the mesh network to interact with an LLM for concise, automated responses. Note: Currently the only supported tool is a demo for emergency service. More tools are coming soon. You can add your own tool using the guide below git clone < repo_url > cd < repo_name > Install dependencies: pip install -r requirement.txt Run the script: python main.py To talk with the LLM, you can use normal message or "/tool your_message" to activate tool use. Ollama performace with Tool Use on small model (llama 3.2:3b) is not exactly correct.…from github.com
Does a similar job
all alternatives →
TensorZero2025 · github.com · ▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
OpenLLMetry – OpenTelemetry-based observability for LLMs2023 · github.com · ▲154Hey HN, Nir, Gal and Tomer here. We’re open-sourcing a set of extensions we’ve built on top of OpenTelemetry that provide visibility into LLM applications - whether it be prompts, vector DBs and more. Here’s the repo: https://github.com/traceloop/openllmetry. There’s already a decent number of tools for LLM observability, some open-source and some not. But what we found was missing for all of them is that they were closed-protocol by design, vendor-locking you to use their observability platform or their proprietary framework for running your LLMs. It’s still early in the…
Open-source real time data framework for LLM applications2024 · getindexify.ai · ▲92Hey HN, I am the founder of Tensorlake. Prototyping LLM applications have become a lot easier, building decision making LLM applications that work on constantly updating data is still very challenging in production settings. The systems engineering problems that we have seen people face are - 1. Reliably process ingested content in real time if the application is sensitive to freshness of information. 2. Being able to bring in any kind of model, and run different parts of the pipeline on GPUs and CPUs. 3. Fault Tolerance to ingestion spike, compute infrastructure failure. 4. Scaling compute,…
LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)2023 · github.com · ▲45G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
