nowfound

AI · October 30, 2024

MS

Modus, serverless framework for intelligent APIs powered by WebAssembly

Modus is an open-source, serverless framework for building APIs powered by WebAssembly. It simplifies integrating AI models, data, and business logic with sandboxed execution. We built Modus to put code back at the heart of development. You write a function. export function sayHello(name: string): string { return `Hello, ${name}!`; } Then, Modus: - extracts the metadata of your functions - compiles your code with optimizations based on the host environment - caches the compiled module in memory for fast retrieval - prepares an invocation plan for each function - extracts connections, models,…

In plain words

Modus is an open-source, serverless framework that builds APIs using WebAssembly. Developers write functions that Modus automatically compiles, optimizes, and deploys with sandboxed execution environments. It streamlines integrating AI models, data, and business logic into APIs by handling metadata extraction, module caching, and endpoint generation. The framework targets developers who want to focus on writing code while Modus manages the infrastructure and compilation layers.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Modus is an open-source, serverless framework for building APIs powered by WebAssembly. It simplifies integrating AI models, data, and business logic with sandboxed execution. We built Modus to put code back at the heart of development. You write a function. export function sayHello(name: string): string { return `Hello, ${name}!`; } Then, Modus: - extracts the metadata of your functions - compiles your code with optimizations based on the host environment - caches the compiled module in memory for fast retrieval - prepares an invocation plan for each function - extracts connections, models, and other configuration details from the app’s manifest - generates an API schema and activates the endpoint You query the endpoint. query SayHello { sayHello(name: "world") } In a few milliseconds, Modus: - loads your compiled code into a sandboxed execution environment with a dedicated memory space - runs your code, aided by host functions that power the Modus APIs - securely queries data and AI models as needed, without exposing credentials to your code - responds via the API result and releases the execution environment Now you have a production ready scalable endpoint for your AI-enabled app. AI-ready when you’re ready. Launch and iterate. Read more in the announcement blog post: https://hypermode.com/blog/introducing-modus-code-first-inte... Come join our Discord, we’d love to hear your feedback: https://discord.hypermode.com Follow us on GitHub: https://github.com/hypermodeinc/modus Modus docs: https://docs.hypermode.com/modus Modus quickstart video: https://youtu.be/3CcJTXTmz88

More ai this month

the category →
  • I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 17d ago · simedw.com

  • Astute585

    Automate your B2B brand going viral, with new media creators

    AI · 18d ago · company-app.joinastute.com

  • Grok Bot547

    AI teammates that you can give real work to

    AI · 25d ago · x.ai

  • Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 27d ago · cactuscompute.com

  • Make your software self-driving

    AI · 30d ago · coldtea.ai

  • Soloop472

    Approval-first Agent OS for solo founders

    AI · 30d ago · soloop.io

Launched alongside, October 2024

the whole month →
  • buzzabout1,267

    Audience insights from 1B+ online discussions in 2 mins

    AI · 2024 · buzzabout.ai

  • bolt.new1,233

    Prompt, run, edit & deploy full-stack web apps

    AI · 2024 · bolt.new

  • Feta1,217

    Run smarter stand-ups, build better products

    AI · 2024 · feta.io

  • Trag955

    AI code review companion

    AI · 2024 · usetrag.com

  • Turn Notion databases into portals & apps with no code

    Dev tools · 2024 · softr.io

  • One inbox for all your work discussions

    Work · 2024 · generalcollaboration.com