AMD's AI processing at the Edge for Canon Free Viewpoint Video System to transform live sports broadcasts

Versal AI Core devices deliver powerful machine learning (ML)-based video processing at the edge for Canon camera systems.

The Canon Free Viewpoint video system consists of a ring of high-resolution cameras that surround a stadium or arena to allow broadcast viewers to see the action on the field from any position or angle in the stadium. The revolutionary technology dramatically changes how sports are viewed, putting viewers in the middle of the action. The Canon Free Viewpoint system is expected to be deployed at multiple professional basketball arenas in the US and other premier sports venues around the world.

“This single-chip Versal solution allows our system to do more in real-time than we ever envisioned possible,” said Masanori Yamada, Senior Managing Executive Officer, Head of Imaging Group, Canon. “Versal AI Core’s powerful edge-processing capabilities enable our system to handle multiple functions simultaneously so broadcasters can deliver new and immersive viewing experiences.”

The high performance and ultra-low latency processing enabled by Versal AI Core series significantly shortens image processing time, allowing live replays to be produced in near real-time, compared to several minutes with traditional architectures. The technology will provide broadcast viewers from around the world with images that have never been experienced before. Live broadcast networks can also monetise live event metrics such as game and player statistics.

Canon technology will move the intelligence of AI-based video processing to the edge, thereby reducing the workload in the data center. Versal AI Core will power the image-processing system that sits behind each of the Canon cameras deployed around a venue and implements proprietary Canon algorithms for image detection, segmentation, and more using ML at the edge.

“The implementation of machine learning at the edge during a live broadcast is an exciting first in the industry,” said Yousef Khalilollahi, Vice President, Asia Pacific, at AMD. “The Canon camera system really puts the viewer in the game like never before. At the heart of Canon’s cutting-edge systems is the Versal AI Core series delivering the low latency edge-processing that is key to heralding this new era in live sports broadcasts.”