Hey HN — I’m Gaurav, one of the founders of Captions. We work on applied AI research for talking videos. Our foundation model, Lipdub, captures how humans speak, and matches full face movement to what’s being said. The model is zero-shot and can generate videos in under a minute, without person-specific training. Building on Lipdub, we’re releasing a few APIs that can generate and translate talking videos in bulk. Here are some ways they could be used: * Translating videos with matching lip movement * Creating personalized videos that include someone’s name or company, like what’s shown in…
