Controlling 3D models with voice and hand gestures
I'm sharing my project to control 3D models with voice commands and hand gestures: - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported for now) Created using threejs, mediapipe, web speech API, rosebud AI, and Quaternius 3D models Githhub repo: https://github.com/collidingScopes/3d-model-playground Demo: https://xcancel.com/measure_plan/status/1929900748235550912 I'd love to get your feedback! Thank you
Controlling 3D models with voice and hand gestures launched on June 3, 2025 with 98 votes, #440 of 7,999 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
This web application lets users manipulate 3D models using voice commands and hand gestures. Users can speak to switch between interaction modes like dragging, rotating, scaling, and animating, then use hand gestures detected by a camera to control the model. The tool supports importing custom 3D models in GLTF format via drag-and-drop. Built with Three.js, MediaPipe, and the Web Speech API, it's designed for anyone wanting hands-free, gesture-based 3D model interaction in a browser.
written from the facts on this page · September 2026
From the sources
Control 3D models using hand gestures and voice commands in real-time. Threejs / mediapipe computer vision - collidingScopes/3d-model-playground
Does a similar job
all alternatives →
Conversational Replicas by Tavus2024 · tavus.io · ▲694Hey there, I’m Brian. I've been shipping conversational models over here at Tavus for the past two years. I want to tell you about our new audio-understanding model: Sparrow-2! It’s a new category of model and a unique new approach to conversational audio. Earlier this year we launched Sparrow-1, (at the time) our SoTA turn taking model. Since our Sparrow-1 launch, I’ve spent a lot of time listening to humans talking and trying to really understand how people know when to talk, when to listen, and when to wait. I’ve also been hunting down failure modes of the current SoTA models. And while…
ChatAvatar2024 · hyper3d.ai · ▲386Most 3D AI tools force you to start from scratch every time you want to make a change. Anyone who’s used 3D AI has seen this: fix the hands, the toes break. Or you download a model and only need to tweak one part, not redo the entire asset. That’s the problem we’re trying to solve. We just launched an editing feature in our 3D AI tool, Rodin. It lets you edit existing 3D models by selecting an area and typing your prompt, without rebuilding everything. You can upload any model, or generate one from Rodin, and change only the part you want. For example: “Replace the head of this Gundam model…
An ASCII 3D Rendering EngineJun 2026 · glyphcss.com · ▲211Render 3D models (OBJ, glTF, GLB, STL, .vox) as ASCII art — in the browser, in React or Vue, or straight in your terminal. A three.js-style API with no WebGL and no canvas: just text in a single <pre>.
- A3Add 3D gestures to your applications2012 · threegearsystems.blogspot.com · ▲28
We're a three-person team based out of San Francisco trying to fundamentally change the way people interact with computers.
How to use ChatGPT+ARKit to script experiences with natural language2022 · github.com · ▲54Video demonstration: https://youtu.be/bJFa5HOmhl4 I created a demo involving ChatGPT, OpenAI's Whisper running on-device for speech-to-text (because why not?), and ARKit. By defining a custom JavaScript environment with JavaScriptCore and describing it to ChatGPT, I was able to get it to produce functioning scripts that instantiate and manipulate 3D objects. Sketchfab is used to import 3D assets on the fly. Google Poly had a much better catalog of assets for this sort of thing but sadly, it's no longer available. The README.md describes how it all works but the gist of it is…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, June 2025
the whole month →- IM
Hey HN! Pilots everywhere are required to keep a logbook of all their flying hours, aircraft, airports, and so on. Since I track everything digitally (some people still just use paper logbooks!), I put together some data visualizations and a few 3D globes to show my flying history. This globe is probably my favourite so far: https://jameshard.ing/pilot/globes/all If you’ve got ideas for other graphs or ways to show this kind of data, I’d love to hear them!
Life & fun · 2025 · jameshard.ing
Stunning presentations with AI. No design skills required.
AI · 2025 · chroniclehq.com
Build native mobile apps for iOS and Android without code.
Dev tools · 2025 · bble.io
All your connections, across all your socials.
AI · 2025 · pally.com
I was the main contributor to workout.lol, an open-source fitness app to easily build a workout routine. The project had traction (1.4k GitHub stars, 95 forks, ~20K visits/month), but was eventually sold due to video licensing hurdles. The new owner stopped maintaining it, and the repo went abandoned. Over the next 9 months, I sent 15 emails to try to save it : no replies. Feature requests & issues were ignored. The community was left with a "broken" tool let's say. I couldn't just let it die So I built the new version from scratch with the same open-source spirit, but a better…
Dev tools · 2025 · github.com