Open LLM AI

What it does

OpenLLM is your gateway to powerful and affordable LLMs. We host top open-source models like Ollama, offering them at a fraction of the cost of the price compared to Other providers. Try it for free, and unlock the potential of AI without breaking the bank.

• 
  LLM Gateway2025 · ▲296

  Use any AI model with just one API

• OS
  Open-Source Alternative to OpenAI Platform, for Local Models2025 · github.com · ▲93

  Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.

• 
  Lemonfox.ai2023 · ▲157

  The fast, easy and cheap OpenAI alternative

• 
  Taylor AI2023 · ▲118

  Fine-tune open source LLMs in minutes

• IB
  I built an OSS alternative to Azure OpenAI services2023 · github.com · ▲200

  Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…

• WM
  We made glhf.chat – run almost any open-source LLM, including 405B2024 · glhf.chat · ▲161

  Try it out! https://glhf.chat/ Hey HN! We’ve been working for the past few months on a website to let you easily run (almost) any open-source LLM on autoscaling GPU clusters. It’s free for now while we figure out how to price it, but we expect to be cheaper than most GPU offerings since we can run the models multi-tenant. Unlike Together AI, Fireworks, etc, we’ll run any model that the open-source vLLM project supports: we don’t have a hardcoded list. If you want a specific model or finetune, you don’t have to ask us for it: you can just paste the Hugging Face link in and…

• 
  I trained a 125M model to autocomplete piano on-device▲598

  I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

  AI · 18d ago · simedw.com

• 
  Astute▲585

  Automate your B2B brand going viral, with new media creators

  AI · 20d ago · company-app.joinastute.com

• 
  Grok Bot▲547

  AI teammates that you can give real work to

  AI · 27d ago · x.ai

• 
  Needle2: 14MB agentic LLM for phones, wearables, smart home and robots▲537

  Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

  AI · 28d ago · cactuscompute.com

• 
  Monid▲479

  One wallet, every paid tool your agent needs

  AI · 8d ago · monid.ai

• 
  Clara AI SDR▲460

  Turn website visitors into qualified pipeline

  AI · 21d ago · clarasdr.ai

• 
  Wordware▲9,866

  Your tool for building AI agents with natural language

  AI · 2024 · wordware.ai

• IY
  If YouTube had actual channels▲2,741

  Life & fun · 2024 · ytch.xyz

• 
  Me.bot▲1,628

  The inspiring companion for your life

  AI · 2024 · me.bot

• 
  Upmetrics AI▲1,197

  Business plan & financial forecast using AI

  Work · 2024 · upmetrics.co

• 
  Jupitrr AI▲1,196

  Auto-generate B-roll visuals for content marketing videos

  AI · 2024 · jupitrr.com

• IA
  InstantDB – A Modern Firebase▲1,145

  Hey there HN! We’re Joe and Stopa, and today we’re open sourcing InstantDB, a client-side database that makes it easy to build real-time and collaborative apps like Notion and Figma. Building modern apps these days involves a lot of schleps. For a basic CRUD app you need to spin up servers, wire up endpoints, integrate auth, add permissions, and then marshal data from the backend to the frontend and back again. If you want to deliver a buttery smooth user experience, you’ll need to add optimistic updates and rollbacks. We do these steps over and over for every feature we build, which can…

  Dev tools · 2024 · github.com