5G platform enables a new era of AR and VR experiences
According to the company, the Qualcomm Snapdragon XR2 Platform is the world’s first 5G-supported extended reality (XR) platform. It unites Qualcomm’s 5G and AI innovations with XR technology to usher in a new era of mobile computing. This platform unveils custom features and boasts multiple firsts that can be scaled across Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR).
The Snapdragon XR2 Platform is packed with significant performance improvements compared to the current widely adopted premium-tier XR platform to deliver two times more the CPU and GPU performance, four times more video bandwidth, six times higher resolution and 11 times AI improvement.
The Snapdragon XR2 Platform is the first XR platform to support seven concurrent cameras and a dedicated computer vision processor. Additionally, this is the first XR platform to enable low latency camera pass-through to unlock true MR, which allow users to see, interact and create a hybrid of the virtual and real world while wearing a VR device.
To meet the demands of truly immersive XR, the platform has customised visuals, interactivity and audio technologies, all of which utilise the foundational technology of AI and option of 5G connectivity.
- Visuals: In order to experience a heightened sense of realism in XR, it is imperative to close the visual gap between the real and virtual world. This requires display and graphics. The Snapdragon XR2 Platform takes a leap in core GPU processing by supporting 1.5x the pixel rate and 3x the texel rate for efficient, high graphics rendering. XR specific features like foveated rendering with eye tracking and enhanced variable rate shading for smoother refresh rates help render heavy workloads, while maintaining low power consumption. The Snapdragon XR2 display panel offers up to 3K by 3K resolution per eye at 90fps and is the first XR platform to support 8K 360o videos at 60fps for photorealistic visuals in streaming and local playback. Custom silicon was developed for AR displays to help reduce overall system latencies to maintain immersive AR experiences.
- Interactivity: With XR, for the first time a user can be virtually teleported to a new environment. To do this accurately and efficiently, the Snapdragon XR2 introduces support for seven concurrent cameras and a custom computer vision processor. Multiple concurrent cameras enable real-time and highly accurate tracking of the head, lips and eyes together with 26-point skeletal hand tracking. Computer vision provides highly efficient scene understanding and 3D reconstruction. Together, these features allow users to be transported to new environments where they can intuitively interact within a digital world.
- Audio: In an augmented or virtual world, sound is the key to every immersive encounter. The Snapdragon XR2 Platform offers next-level audio layers in a rich, 3D spatial sound while providing crystal-clear voice interactions to deepen immersion. The platform has a custom built always-on, low power Qualcomm Hexagon DSP to support hardware accelerated features like voice activation and context detection to help keep users’ head in the digital world, while having an ear in the real world.
- AI & 5G: Two technologies shaping the future of communications and computing are AI and 5G. Qualcomm Technologies is leading the way in driving these technologies across mobile computing, including XR. Multiple Snapdragon XR2 features have been improved using AI, including visuals, interactivity and audio in order to immerse users in a smarter reality. The Snapdragon XR2 Platform is the world’s first XR platform to support 5G connectivity, which has the potential to unleash a tidal wave of innovative XR experiences that require low latency and ultra-fast data speeds. For example, 5G enables truly boundless XR using split processing between a device and edge cloud to present photorealistic and high quality experiences without cords or being confined to any room.
The Snapdragon XR2 Platform delivers innovation that the new digital era requires. Multiple OEMs are committed to commercialising devices with the Snapdragon XR2 Platform and other customers are in various stages of prototyping and evaluation.