Sign language translation with smart glasses
Hi! I have relatives that speak sign language, and always found it odd that despite unbelievable advances in AI in recent years, the problem still felt somewhat neglected. Especially with the advent of wearable tech; to my knowledge, this is the first project that integrates the meta glasses w/ fingerspelling translation software. As for the technical aspect, I trained a neural net on Google's FSboard dataset modeling a CNN + GRU temporal encoder architecture (trained with CTC), and then decoded the output with CTC beam search and a KenLM language model to solve some of the deficiencies…
Sign language translation with smart glasses launched on August 4, 2026 with 26 votes, #699 of 23,274 launches that month and more than 95% of that year's launches.
In plain words
This software translates fingerspelling into text using smart glasses and AI. Built for deaf and hard-of-hearing users and their hearing relatives, it runs on Meta glasses as well as web and iOS platforms without special hardware. The system uses a neural network trained on Google's fingerspelling dataset with a language model decoder to improve accuracy. The entire project is open source and available cross-platform, though on-device performance on lower-end devices requires optimization.
written from the facts on this page · September 2026
From the sources
Turning sign language (fingerspelling) into speech w/ smart glasses and a neural net - aadisang/hand-wave
Sign recognition for web and iOS, backed by a small Python inference service. Requirements: pnpm 10.33+, Node 22+, Python 3.11/3.12, uv, and moon. cp .env.example .env pnpm install uv sync --project apps/inference Don't forget to set VITE_INFERENCE_URL in .envfrom github.com
In the maker’s words, at launch
Hi! I have relatives that speak sign language, and always found it odd that despite unbelievable advances in AI in recent years, the problem still felt somewhat neglected. Especially with the advent of wearable tech; to my knowledge, this is the first project that integrates the meta glasses w/ fingerspelling…
Does a similar job
all alternatives →
Pinch2025 · startpinch.com · ▲535Hey HN! I’m Christian, daily lurker and some might remember our original launch post (https://news.ycombinator.com/item?id=42935355). Today we're launching Pinch for Mac, which we believe is a step-change improvement in real-time AI translation. Our vision is to make cross-lingual conversations feel as natural as regular conversations. TL:DR During an online meeting, the app instantly transcribes and translates all audio you hear, and allows you to decide when you translate your voice and when you don't. It's invisible to others (like Granola), and works everywhere without any…
- ADAI dub tool I made to watch foreign language videos with my 7-year-old2024 · speakz.ai · ▲348
Hey HN! I love watching YouTube with my 7-year-old daughter. Unfortunately, the best stuff is often in English (we're German). So I made an AI tool that translates videos directly, using the original voices. All other sounds, as well as background music, are preserved, too. Turns out that it works for many other language pairs, too. So far, it can create dubs in English, Mandarin Chinese, Spanish, Arabic, French, Russian, German, Italian, Korean, Polish and Dutch. The main challenge in building this was to get the balance right between translating the original meaning and getting the timing…
I made an open source and local translation app2024 · github.com · ▲236A few years ago, right after high school, I decided to try to make a simultaneous translation app for Android as a side project, it took longer than expected (about 2 years) and I had to make a lot of compromises (I had to use Google's API and therefore make users use a developer key because at the time there were no free solutions for speech recognition and translation that had good quality). At the end of university, I decided to pick it up again and finally, using OpenAi's Whisper for speech recognition and Meta's NLLB for translation (with both running locally on the phone), I managed to…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, August 2026
the whole month →- TL
Life & fun · Aug 2026 · louisabraham.github.io
Clipto MCP▲655Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…
Work · Aug 2026 · clipto.com
Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…
Life & fun · Aug 2026 · toneyalexander.github.io
Astute▲606Automate your B2B brand going viral, with new media creators
AI · Aug 2026 · company-app.joinastute.com