Google's AI Platform Makes Virtual Meetings Better with 3D Video

Project Starline, a pioneering 3D video communication technology developed by Google, is set to transition into a commercial product under the new name Google Beam. Initially unveiled in 2021, Project Starline aimed to revolutionize remote meetings by creating an immersive, lifelike 3D experience that doesn’t require VR headsets or special glasses. Now, Google is preparing to bring this advanced technology to a select number of workplaces later in 2023. Google Beam combines a light field display and multiple cameras to generate a real-time, volumetric 3D image of the person on the other end of the call. During a demo at Google's headquarters the day before its annual I/O conference, I experienced the technology firsthand. The setup includes a sizable display, a compact Chrome OS-powered compute unit about the size of a DVD player, and a sophisticated AI model that processes and integrates the data in the cloud. This cloud-based approach has allowed Google to streamline the hardware, making it more affordable and accessible compared to earlier prototypes that required extensive local computing power. The technology's evolution from a room-filling experiment to a sleek, office-friendly device is a testament to Google’s ingenuity and commitment to user experience. HP is one of the first companies to adopt Google’s reference design to produce commercial Beam units. Pricing and availability details for HP’s Beam device are expected to be released in the coming months. Google has identified a significant issue with traditional 2D video conferencing: user fatigue and decreased engagement. Studies conducted by the company have shown that participants in Beam calls feel more attentive, remember more of their conversations, and exhibit more natural behaviors, such as making eye contact and engaging in nonverbal communication. These elements contribute to a stronger sense of presence and improve overall meeting effectiveness. During the demo, I noticed several improvements thanks to the latest AI model and commercial hardware. Colors were more vibrant, and the spatial audio was notably clearer and more precise. The platform also features a screen-mirroring function that displays a browser window alongside the 3D image, enhancing collaboration. Additionally, Beam supports live translation, as demonstrated in a call where Spanish was translated to English in real time. While Beam currently supports one-on-one calls, Google plans to introduce group calling capabilities and the option to integrate regular 2D video calls. Andrew Nartker, the general manager of Project Starline, emphasized that the core value of Beam lies in its ability to create a seamless, presence-rich communication experience rather than in the specific hardware. “The devices aren’t really the point,” he said. “The point is that we can beam things anywhere we need to with the infrastructure that we built.” This infrastructure includes robust cloud processing and integration with existing workflows, ensuring enterprise-grade reliability and compatibility. Salesforce, Deloitte, Duolingo, and several other prominent organizations have already committed to installing Beam units in their offices. T-Mobile even successfully tested the system over LTE, although I did observe slight lag during some parts of the demo at Google’s headquarters. Despite this, the overall experience was compelling and highlighted the potential of Beam to enhance remote interactions. Google’s long-term vision for Beam extends beyond the workplace. Nartker envisions a future where Beam is a household technology, enabling personal connections that transcend geographical boundaries. “We’re going to build a bunch of devices,” he stated, indicating that Google is dedicated to expanding Beam’s reach and capabilities. In addition to HP, Google is collaborating with industry giants like Zoom and key channel partners such as Diversified and AVI-SPL to widely distribute Beam. The first commercial Beam products from HP will be showcased at InfoComm in just a few weeks. Other notable companies ready to implement Beam include Citadel, NEC, Hackensack Meridian Health, and Recruit. Industry insiders praise Google Beam for its innovative use of AI and cloud technology in addressing the shortcomings of 2D video conferencing. The platform's ability to reduce user fatigue and enhance engagement could make it a game-changer in the remote collaboration space. Google’s expertise in cloud computing and AI, combined with the practicality of its hardware designs, positions the company strongly to lead this next frontier in communication technology. The introduction of Google Beam marks a significant step forward in making remote meetings more effective and less draining. As more organizations adopt this technology, the potential benefits for productivity and team cohesion are substantial, making it a promising solution for the modern, distributed workforce. Google’s commitment to refining and expanding Beam underscores its dedication to transforming how people connect and collaborate across distances.