Mix – Open-source multimodal agents SDK
Why we built it: • Claude Code: great for coding, but no video/audio support, localhost only • OpenAI SDK: single-model, no native multimedia tools • Both: no integrated DevTools for debugging agent reasoning So, we built Mix as an alternative for multimodal applications. • Native video/audio/PDF analysis tools (via Gemini for vision, Claude for reasoning) • Multi-model routing instead of single-provider lock-in • One-command Supabase setup for cloud deployment (vs localhost-only) • HTTP architecture that enables visual DevTools alongside agent workflows • Go backend: 50-80%…
What it does
In the maker’s words, at launch
Why we built it: • Claude Code: great for coding, but no video/audio support, localhost only • OpenAI SDK: single-model, no native multimedia tools • Both: no integrated DevTools for debugging agent reasoning So, we built Mix as an alternative for multimodal applications. • Native video/audio/PDF analysis tools (via Gemini for vision, Claude for reasoning) • Multi-model routing instead of single-provider lock-in • One-command Supabase setup for cloud deployment (vs localhost-only) • HTTP architecture that enables visual DevTools alongside agent workflows • Go backend: 50-80% lower memory footprint than Node.js—efficient for concurrent agent sessions. Python and typescript clients are available Example use cases in the demo video: portfolio analyzer that reads Excel and generates charts, YouTube search agent that finds and edits video clips. GitHub: https://github.com/recreate-run/mix Demo video: https://youtu.be/IwgKt68wQSc Would appreciate feedback, especially from folks building multimodal agents.
Does the same job
all alternatives →- IBI built Mix – an opensource, local agent for multimodal tasks2025 · github.com · ▲7
Mix is an open-source, local agent for multimodal claude code. Claude code users will feel at home. - Uses ffmpeg and local apps like blender instead of clunky cloud based editors - All project data is stored plain text and native media files - absolutely no lock-in. - The backend is an HTTP server, meaning that the frontend is just one of possible clients. - - Our SDK with stdio interface (similar to claude code SDK) is launching soon.
- WBWe Built Mix, a Multimodal Agents SDKSep 2025 · github.com · ▲7
Mix is a multimodal agents SDK. It comes with a GUI playground for testing and debugging SDK workflows. • Built for multimodal workflows instead of code based workflows • The GUI playground is built from the typescript SDK • All project data is stored plain text and native media files - absolutely no lock-in. • The backend is an HTTP server, check out our python and typescript SDK's
- OAOpen-agent-SDK – Claude Code's internals, extracted and open-sourcedApr 2026 · github.com · ▲7
Claude Code's source map leaked last month. Instead of just reading it, I fed the entire source into Claude Code itself and asked it to extract the core agent loop logic. The result: open-agent-sdk — a drop-in replacement for claude-agent-sdk that's fully open source and doesn't spawn a CLI subprocess. Why this matters if you've built with claude-agent-sdk: claude-agent-sdk is just a thin wrapper around the Claude Code binary. It works, but it's a black box — when something breaks, you're stuck. Every query creates a new Claude Code process. That's fine on a laptop, not fine when you're…
- IMI made a VS Code extension where you can use Mixtral 8x7B for free2023 · marketplace.visualstudio.com · ▲8
Hey guys, I made a VS Code extension, within which you can use the Mixtral 8x7B AI model for free. Mixtral 8x7B is a new AI model from the Mistral family, which outperforms GPT-3 in many benchmarks, a fact that I have personally confirmed in daily coding tasks, where Mistral 8x7B was the clear winner. You can use all the AI features, such as AI Lens with custom instructions and similar. I'm pretty sure some of features will be useful to you. I'd appreciate both, positive and negative feedback!
- WCWorkplane – collaborative files for agents (and humans)Jun 2026 · workplane.co · ▲8
A friend and I built this as a side project to help us collaborate on files with our agents. Claude / Codex kept outputting .md and .html files which are great until we needed to share them, so we built this small website to help with that. Agent can either use an HTTP + Skill or an MCP which also uses MCP Apps to add widgets to Claude Desktop / Mobile chat. Would love any feedback and hopefully this helps someone else as it did us!
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com
Launched alongside, October 2025
the whole month →
- SA
I went down the rabbit hole on a side project and ended up building this: Strange Attractors(https://blog.shashanktomar.com/posts/strange-attractors). It’s built with three.js. Working on it reminded me of the little "maths for fun" exercises I used to do while learning programming in early days. Just trying things out, getting fascinated and geeky, and being surprised by the results. I spent way too much time on this, but it was extreme fun. My favorite part: someone pointed me to the Simone Attractor on Threads. It is a 2D attractor and I asked GPT to extrapolate it to…
AI · Oct 2025 · blog.shashanktomar.com
- ASAutism Simulator▲779
Hey all, I built this. It’s not trying to capture every autistic experience (that’d be impossible). It’s based on my own lived experience as well as that of friends on the spectrum. I'm trying to give people a feel for what masking, decision fatigue, and burnout can look like day-to-day. That’s hard to explain in words, but easier to show through choices and stats. I'm not trying to "define autism". I’ve gotten good feedback here about resilience, meds, and difficulty tuning. I’ll keep tweaking it. If even a few people walk away thinking, "ah, maybe that’s why my coworker struggles in those…
Life & fun · Oct 2025 · autism-simulator.vercel.app
