We built a knowledge hub for running LLMs on edge devices
Hey HN! Alex and Zack from Nexa AI here. We are excited to share a project our team has been passionately working on recently, in collaboration with Jiajun from Meta, Qun from San Francisco State University, and Xin and Qi from the University of North Texas. Running AI models on edge devices is becoming increasingly important. It's cost-effective, ensures privacy, offers low-latency responses, and allows for customization. Plus, it's always available, even offline. What's really exciting is that smaller-scale models are now approaching the performance of large-scale closed-source models for…
We built a knowledge hub for running LLMs on edge devices launched on September 5, 2024 with 13 votes, #1,020 of 5,281 launches that month and more than 75% of that year's launches. The site was not reachable when checked in September 2026.
In plain words
Nexa AI provides a knowledge hub for deploying large language models on edge devices such as smartphones, IoT gadgets, and Raspberry Pi systems. The platform enables cost-effective, private, and low-latency AI inference while maintaining offline availability. It targets developers and organizations seeking to run smaller-scale models that approach the performance of larger closed-source alternatives for applications like writing assistance and email classification.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hey HN! Alex and Zack from Nexa AI here. We are excited to share a project our team has been passionately working on recently, in collaboration with Jiajun from Meta, Qun from San Francisco State University, and Xin and Qi from the University of North Texas. Running AI models on edge devices is becoming increasingly…
Does a similar job
all alternatives →
Nexa SDK – Build powerful and efficient AI apps on edge devices2024 · github.com · ▲27Hey HN! Alex and Zack here from Nexa AI. We're excited to share something we've been working on. Our journey began with the Octopus series --- action models for mobile AI agents (https://huggingface.co/NexaAIDev/Octopus-v2). We focused on making sub-billion parameter models excel at function calling, making high accurate and fast function-calling possible on mobile and edge devices. But as we delved into developing full-fledged on-device applications, we hit a roadblock. We realized that optimizing for function calling (tool-use) alone wasn't enough. Building powerful…
Use functional tokens for AI agents to simplify app workflows2024 · nexa4ai.com · ▲80Hi HN! I want to share our latest project at NEXA AI. We developed AI agent foundation models designed to transform how developers create AI agent powered apps. One major challenge we've observed with current human-computer interactions is that many simple, one-step tasks become unnecessarily complex, multi-step workflows due to limitations of current GUIs. AI agents can solve this, but existing AI agent models are slow and costly. To tackle these issues, we built lightweight AI agent models based on our Octopus V2, small language models for function calling (You can learn more about our…
Cactus – Ollama for Smartphones2025 · github.com · ▲231Hey HN, Henry and Roman here - we've been building a cross-platform framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones. Deploying directly on phones facilitates building AI apps and agents capable of phone use without breaking privacy, supports real-time inference with no latency, we have seen personalised RAG pipelines for users and more. Apple and Google actively went into local AI models recently with the launch of Apple Foundation Frameworks…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, September 2024
the whole month →
BeforeSunset AI 2.0▲1,267Personalized AI daily planning that suits your life
AI · 2024 · beforesunset.ai
