Alternatives
Products that do what A generative audio VST plugin using Gemini API, JUCE, and React does
Hey folks! I've spent the last 8 months building a VST plugin called "The Infinite Crate" on top of Magenta's Lyria RealTime music model on the Gemini API. Doug Eck's research group has been building MusicLM and variants since 2017 (https://www.youtube.com/watch?v=yz-fHidp1M8) I bridged a JUCE/C++ audio processing foundation with a React/Typescript UI, using Zustand to sync state. The plugin streams down generated audio from the Lyria RealTime model in the Gemini API via websockets You can try it as a VST3 on Mac/Windows or AU/Standalone on Mac. It works in…
- 1
- 2
- 3
- 4
- 5
- 6G4
About six months ago, I started working on a project to fine-tune Whisper locally on my M2 Ultra Mac Studio with a limited compute budget. I got into it. The problem I had at the time was I had 15,000 hours of audio data in Google Cloud Storage, and there was no way I could fit all the audio onto my local machine, so I built a system to stream data from my GCS to my machine during training. Gemma 3n came out, so I added that. Kinda went nuts, tbh. Then I put it on the shelf. When Gemma 4 came out a few days ago, I dusted it off, cleaned it up, broke out the Gemma part from the Whisper…
Apr 2026 · github.com
- 7AP
I'm building a video conferencing app designed to facilitate better remote piano lessons. My hope is to solve a lot of the challenges piano tutors and new students deal with when taking lessons through Skype/Zoom. It leverages WebRTC's data transmission to send media, MIDI state, and (eventually) send sheet music files and other musical data. I'm surprised with how well the MVP has worked and would love to hear any feedback or suggestions!
2024 · keyboardconnect.com
- 8
- 9RA
Hey HN. I built this quick and dirty component to render audio waveforms using WebGPU. I just published it to NPM. It's the first time I use WebGPU and it's been a while since I write shaders. Feedback is very welcome! GitHub: https://github.com/mrkev/webgpu-waveform Examples: https://aykev.dev/webgpu-waveform
2024
- 10IB
Hey HN, I’m an ex-Google engineer trying to get back into music production. I needed a way to sequence my hardware synths using AI contexts without constantly switching windows, so I built this. It runs entirely in the browser using WebMIDI. No login required. It connects to your local MIDI devices (if you're on Chrome/Edge) and lets you generate patterns. Tech stack: [React / WebMIDI API / etc]. Link: www.simplychris.ai/droplets Code is a bit messy, but it works. Feedback welcome.
Dec 2025 · simplychris.ai
- 11
- 12KA
This is part of my journey on pybind11. I wrote a tiny FM Synthesis library in C++ and a Python wrapper for that using pybind11. There is a command-line piano app in the examples directory if you want to play with it. Here is the link: https://github.com/charstorm/koelsynth/tree/main/examples/si... My next target is to attach this to some kind of physics simulation - like a bunch of balls moving around in a box with some internal walls. When the ball hits certain trigger points, it produces the sound.
2023 · github.com
- 13WA
Hi, I'm the author of this little Web Audio toy which does physical modeling synthesis using a simple spring-mass system. My current area of research is in sparse, event-based encodings of musical audio (https://blog.cochlea.xyz/sparse-interpretable-audio-codec-pa...). I'm very interested in decomposing audio signals into a description of the "system" (e.g., room, instrument, vocal tract, etc.) and a sparse "control signal" which describes how and when energy is injected into that system. This toy was a great way to start learning about physical modeling synthesis, which seems…
2025 · blog.cochlea.xyz
- 14WA
Hi HN, I’ve been working on a browser-based tool for exploring and debugging Web Audio API graphs. Web Audio Studio lets you write real Web Audio API code, run it, and see the runtime graph it produces as an interactive visual representation. Instead of mentally tracking connect() calls, you can inspect the actual structure of the graph, follow signal flow, and tweak parameters while the audio is playing. It includes built-in visualizations for common node types — waveforms, filter responses, analyser time and frequency views, compressor transfer curves, waveshaper distortion, spatial…
Mar 2026 · webaudio.studio
- 15DM
Hi HN! We just launched our drum machine vst this month! We will be updating it with many new synthesis models and unique features. Check it out, join our discord and show us what you made!
Jan 2026 · okaysynthesizer.com
- 16FA
I'm Sam, I make sample libraries (as FrozenPlain). These sample libraries run inside Floe, my audio plugin for Linux, macOS and Windows. It's designed for musicians, composers and producers - typically people involved with film/TV/game scoring or ambient music. I open-sourced it primarily because I'm very fond of this philosophy and I want to open the door for serving a wider audience than just my own libraries. It's totally free, no sign-ups. You'll need a DAW. To try it: - Download and install Floe: https://floe.audio - Download your choice of free packages:…
6d ago · floe.audio
- 17SW
Chrome now includes a native on-device LLM (Gemini Nano) starting in version 138. I've been building with it since it was in origin trials, it's powerful but the official Prompt API is still a bit awkward: - Enforces sessions even for basic usage - Requires user-triggered downloads - Lacks type safety or structured error handling So I open-sourced a small TypeScript wrapper I originally built for other projects to smooth over the rough edges: github: https://github.com/kstonekuan/simple-chromium-ai npm: https://www.npmjs.com/package/simple-chromium-ai…
2025 · github.com
- 18IJ
Hey all. For the last few years, I have been developing a software synthesizer as a side project. It's taken longer than I both hoped and feared, but earlier this week I finally shipped 1.0. Details about the synth itself are up on my website, https://lhiaudio.com/. For those who are unfamiliar, in music production, there are host applications (such as Logic Pro, Ableton Live, or REAPER) in which most of the work (such as recording or sequencing MIDI data) is done. These applications generally have some built-in tools for the actual generation and processing of audio data, but…
2018
- 19DR
Hi HN, I find that many are interested in writing VST plugins but found C++ quite tricky to work with. So I made this VST plugin to show how Rust can be used to write VST plugins. I did it by combining egui-baseview-vst template[1] and glicol_synth audio lib[2]. Source code: https://github.com/chaosprint/dattorro-vst-rs [1] https://github.com/DGriffin91/egui_baseview_test_vst2 [2] https://github.com/chaosprint/glicol
2022
- 20VC
Built this over the weekend to bridge the gap between "can hum a melody" and "can code algorithmic music patterns" (Strudel/TidalCycles) for live coding and live dj'ing. What it does: Real-time pitch detection in browser using multiple algorithms: CREPE (deep learning model via TensorFlow.js) YIN (autocorrelation-based fundamental frequency estimation) FFT with harmonic product spectrum AMDF (average magnitude difference function) Outputs: visual piano roll, MIDI files, Strudel/TidalCycles code All client-side, nothing leaves your machine Why multiple algorithms: Different pitch…
Jan 2026 · dioptre.github.io
- 21AT
LTX-2 is an open-source diffusion model that combines video and audio. Visually it's not at the level of Seedance 2.0, Veo 3.1, or Sora 2, but it’s open-weights, so anyone can play with it. I wanted to see how good it is at generating video from just audio. Off-the-shelf, it's not very good, but I found that if you run the audio through Gemini to generate a prompt, then feed that into LTX-2, in addition to the audio, the output matches the audio much more often. Foley sounds work particularly well, and one fun use case is uploading audio of yourself to see what AI thinks you look like.…
Mar 2026 · magichour.ai
- 22LT
Hey HN, I've used Generative.fm for years and love it, but I always wanted to just describe what I was in the mood for instead of scrolling through presets. So I built this. You type a text description of anything - from "mountain sunrise" to "neon city" - and it generates a procedural/ambient stream matching that mood. It runs locally, no account, no tracking, no ads. Under the hood it's a custom synthesizer driven by sentence embeddings, not a generative AI model (although you can choose to use one!) — so there's no GPU, no API calls, and it starts playing almost instantly. The whole…
Feb 2026 · latentscore.com
- 23AV
I built a free and open-source, high-resolution, real-time audio visualizer on the web. Try it out here: https://audiovisualizer.org The main feature is a very high resolution frequency domain visualizer. It even works in realtime with the microphone. The application also features a synthesizer that can be played with the keyboard or MIDI files and allows for adjustable harmonics and ADSR envelopes. I used React.JS as the framework, P5.JS for rendering the visualizations, the WebAudio API for audio analysis, Meyda.JS and Essentia.JS for feature extraction, Tone.JS for synthesis,…
2025 · audiovisualizer.org
- 24MR
Last Thursday, Deepmind released Magenta Realtime 2 , an open source music generation model. They said it could run on Mac, but not iPhone. As a v̵i̵b̵e̵ ̵c̵o̵d̵i̵n̵g̵ ̵a̵d̵d̵i̵c̵t̵ agentic AI maxxi and person who has melted iPhones before (link at bottom), I took that as a personal challenge and made it my weekend project. On Saturday, I got it to run for 10min straight on an iPhone 12 Pro from 2020 without melting the phone or - shockingly - touching the GPU. How? I chopped the model up into 5 pieces and set them each to run on different parts of Apple's system on a chip (SoC). My past…
Jun 2026 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →