At its annual I/O developer conference on Tuesday, Google unveiled a rebranding of its Project Starline, introducing a new 3D video communication platform named Beam. This innovative platform aims to enhance user connectivity by transforming standard 2D video streams into immersive 3D interactions. Built on the Google Cloud platform and powered by advanced AI, Beam promises enterprise-level reliability and seamless integration into existing workflows. Google also announced plans for real-time speech translation support, with availability expected on HP devices later this year.
Features of Google Beam
Detailed in a recent blog post, Beam utilizes multiple webcams to capture users from various angles. Through AI technology, these video streams are combined to render a 3D light field display. Google highlighted the platform’s head tracking features, which are accurate to within a millimeter and operate at 60 frames per second (fps).
The AI volumetric video model utilized by Google Beam effectively converts traditional 2D video streams into lifelike 3D experiences, allowing viewers to perceive scenes from different perspectives. The combination of this technology and the light field display enhances the sense of depth and dimensionality, facilitating eye contact and the interpretation of subtle social cues.
This new platform emerges from the original concept of Project Starline, first presented at Google I/O in 2021. While the initial vision aimed to provide a superior video communication experience featuring 3D visuals, eye contact, and spatially accurate audio, the project underwent repurposing to give rise to the Beam platform.
Photo Credit: Google
To further enhance communication capabilities, Google is considering the integration of real-time speech translation into Beam, as well as into Google Meet, which is rolling out the feature today.
In partnership with HP, Google is set to launch the first Beam devices for select customers later this year. The initial products from this collaboration are anticipated to be showcased at InfoComm 2025, scheduled for June.