Umbra

What it does

Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them. Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token. Try it: https://tryumbra.dev Quickstart: https://tryumbra.dev/docs/quickstart Host a Mac: https://tryumbra.dev/setup

Private-prompt inference on Apple Silicon. An OpenAI- and Anthropic-compatible API for open-weight, uncensored, and community GGUF models, with live Apple hardware and APNs running-code attestation for admitted providers.

Uncensored models and community fine-tunes on independent Apple Silicon. Prompts are decrypted in-process and never logged. Apple hardware and running-code attestation are live. # keep your SDK — swap the base URL client = OpenAI( base_url= "https://api.tryumbra.dev/v1" , api_key= "umbra-…" ) What you send 000000 27 06 85 95 cd e6 97 dc |'.......| 000008 c2 7f e5 a6 45 40 d6 da |....E@..| 000010 87 98 ef 14 8e 77 b1 10 |.....w..| 000018 a7 91 0a 98 f8 74 70 12 |.....tp.| 000020 e4 a1 19 6a 1d 69 00 b4 |...j.i..| 000028 a6 33 c3 8c 7f fb d3 19 |.3......| 000030 91 78 7c 38 63 3a 61 38 |.x|8c:a8| 000038 7d 0b 8b 56 d0 8d 0c 8b |}..V....| … 59 further sealed bytes cipher ChaCha20-Poly1305…from tryumbra.dev

• 
  I built an OSS alternative to Azure OpenAI services2023 · github.com · ▲200

  Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…

• 
  Open source alternative to ChatGPT and ChatPDF-like AI tools2023 · github.com · ▲234

  Hey everyone, We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools. It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf/ggml models. Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features. Here are some quick demos: * Chat with documents using OpenAI's GPT3.5 model: https://www.youtube.com/watch?v=Br2D3G9O47s * Chat with documents…

• 
  Clevrr Computer2024 · github.com · ▲195

  Computer use but with OpenAI and Gemini models

• 
  MCP Server with HTTP support instead of stdio/sse2025 · twitter.com · ▲11

  Admittedly I work on this, but I anthropic's decision to finally embrace http, auth (at least a little), and other RFCs that are coming out is just great. With OpenAI behind it too, this ecosystem will be built around projects like this. Not saying it's MCP or not, but it'll be one of them

• 
  Maki2022 · maki.sh · ▲84

  An efficient AI coding agent. Native Rust TUI. Immediate startup, 60 FPS, low memory. Indexes files instead of reading them, chains tools in a sandbox interpreter. Anthropic, OpenAI, Google, Z.AI, OpenRouter, Synthetic, or any OpenAI / Anthropic compatible API.

• 
  Open Responses – Self-hosted OpenAI Responses API, works with any model2025 · github.com · ▲23

  Self-hosted alternative to OpenAI's Responses API compatible with Agents SDK and works with all model providers (Claude/R1/Qwen/Ollama etc) - open-responses/open-responses

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 30d ago · hemory.com

• IR
  I replaced a $120k bowling center system with $1,600 in ESP32s▲2,935

  I might be the only SRE on Earth with his own bowling center. It's a more in-depth gig than you'd think. My family and I bought an abandoned 8-lane bowling center in the rural mid-west. In our small town there weren't many recreation options for families. You've heard of a food desert? This is an R&R desert. It had been abandoned for a good reason. The roof leaks, the electrical system was constantly surging, and my 70-year-old bowling equipment (still) doesn't work perfectly. The system that keeps your score is particularly interesting to me. It's the thing you watch during your game, but…

  Life & fun · Jul 2026

• 
  Elevators▲1,680

  How elevators push your buttons

  Life & fun · Jul 2026 · john.fun

• 
  18 Words▲1,160

  Play 18 Words, the free daily word puzzle. The official home is 18words.com. Tap Play now to open today

  Life & fun · Jul 2026 · 18words.com

• BA
  Bento - An entire PowerPoint in one HTML file (edit+view+data+collab)▲1,033

  Over the past few months, our team has been building more and more slidedecks using web frontend technologies with coding harnesses like Claude Code, but a common complaint is to make even small edits we need to edit the code either manually or via the harness. To avoid this loop, I ended up creating Bento, a single HTML file with everything you need in a slide tool including animations and shared editing. There's no install or cloud login, everything works offline. The default deck is around 560 KB and it doesn't need to fetch anything once you got it. Open it in a browser and then you can…

  Dev tools · Jul 2026 · bento.page

• 
  Getting GLM 5.2 running on my slow computer▲937

  A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context.…

  AI · Jul 2026 · github.com

• 
  OpenSEO▲928

  Hello! For the last 2 months, I've been building OpenSEO. It's a user friendly UI wrapping the DataForSEO API which has high quality SEO data for keywords, backlinks, AI SEO and competitor research. Instead of paying $100+ per month, you buy DataForSEO credits and pay only for usage. The coolest thing about the project so far has been hearing about what people are building on top of it. People are using coding agents to quickly integrate with Google Search Console, Google Ads and building their own AI SEO and reporting features. Many were already building their own custom solutions around…

  Dev tools · Jul 2026 · openseo.so