Banuba, a leading innovator in augmented reality (AR) technologies, has unveiled a groundbreaking AI-powered lip sync video generation feature for its Video Editor SDK. The new capability represents a major advancement in creating lifelike AI-generated videos, enabling individuals in a video frame to accurately mimic spoken or sung words with natural, realistic facial movements. “We are moving into the realm of interactive AI-driven storytelling,” said Anton Liskevich, CPO and co-founder at Banuba. “This lip sync video generation feature dramatically reduces production time and cost while unlocking new levels of creative potential.” The technology uses advanced neural networks to analyze audio input—whether speech or music—breaking down phonemes, rhythm, and intonation. It then generates precise facial animations, including lip shapes, tongue movements, jaw motion, and subtle micro-expressions. By eliminating the uncanny valley effect common in synthetic avatars, the result is a highly believable and immersive performance. What sets Banuba’s solution apart is its deep level of creative control. Users can go beyond lip movements by inputting text prompts to influence other aspects of the performance. For example, a prompt like “speak confidently with open hand gestures” or “sing sadly while looking downward” can dynamically adjust body language, emotional tone, and head movement—all in real time—without requiring manual animation. This innovation is poised to transform how developers build applications in areas such as virtual influencers, interactive education, personalized marketing, and immersive social media content. The ability to generate high-quality, expressive AI avatars quickly and affordably opens new doors for creators and brands alike. The Banuba Video Editor SDK is a comprehensive, developer-friendly toolkit designed for fast integration—often in under eight minutes. It empowers app creators to offer users a full suite of video editing and AR effects, from real-time filters and virtual try-ons to advanced AI-driven content creation. Key features of the SDK include face tracking, virtual backgrounds, real-time AR effects, multi-face detection, and now, AI-powered lip sync video generation. The platform supports both mobile and web applications, making it ideal for a wide range of industries. Banuba has been at the forefront of AR and AI innovation for over nine years, specializing in face tracking, virtual try-on for face, hair, and hands, and intelligent video processing. The company provides SDKs and plug-and-play solutions that enable businesses to integrate cutting-edge AR experiences into their apps with minimal effort. With this latest enhancement, Banuba continues to push the boundaries of what’s possible in AI-driven video creation, bringing hyper-realistic, interactive storytelling within reach for developers worldwide.