Smart Eye and Texas Instruments next-generation automotive interior sensing

Running on TI’s new AM62A7-Q1 automotive qualified vision processor, Smart Eye’s Automotive Interior Sensing AI provides critical safety features to upcoming car models going into production in 2023 and 2024. Fully compliant with new General Safety Regulations (GSR) and European New Car Assessment Programme (Euro NCAP) requirements, the solution enables higher performance and more cost-effective implementations in vehicles, to realise a collision-free future.

As GSR and Euro NCAP requirements make advanced sensing features mandatory in new vehicles in Europe, automakers now require advanced processing chips that deliver the right performance without sacrificing critical system resources, such as power, size, weight, and cost. Smart Eye’s Automotive Interior Sensing AI combines its industry-leading Driver Monitoring System (DMS) software with Cabin Monitoring System (CMS) software to bring deep, human-centric insight into what is happening with all occupants inside a vehicle.

Smart Eye’s software solution supports the new AM62A7-Q1 vision processor and family of devices as well as the TDA4VM-Q1 automotive processor and family of devices for different use cases. Automakers are able to easily scale their designs and optimise performance from one car model to the next by reusing TI’s device IP and single software development kit across their vehicle lineup.

The AM62A7-Q1 device offers an integrated ISP that can handle 5 MP at 30 frames per second, support for up to two RGB-IR cameras and a highly efficient 2 TOPS deep learning accelerator. With a high level of system integration, the TI systems on chip (SoCs) enable scalability and lower costs for advanced automotive platforms supporting multiple sensor modalities in centralized ECUs or stand-alone sensors, such as infrared cameras. Using these cameras, Smart Eye’s AI-based software detects various levels of driver distraction and drowsiness as well as the attention, emotions, and activities of all occupants in the vehicle, including the objects they use. This data lets automakers adapt safety measures and advanced driver assistance systems (ADAS) in real-time – improving road safety and enhancing the mobility experience for the driver and all other occupants in a vehicle.

“Smart Eye’s Interior Sensing AI is designed to run on a large variety of automotive SoCs,” said Martin Krantz, Founder and CEO of Smart Eye. “We are especially excited to collaborate with TI to combine their state-of-the-art chipsets with our deep learning expertise and deliver advanced safety and mobility features that run with the highest power efficiency and performance accuracy.”

“The collaboration of TI with Smart Eye allows automakers to design best-in-class driver and occupant monitoring systems, increasing the overall safety of the vehicle,” said Sameer Wasson, vice president and general manager of Processors at TI. “By leveraging our new family of vision processors—coupled with Smart Eye’s advanced AI software—automakers are able to create a powerful interior sensing solution that supports multiple modalities and runs at the highest levels of reliability and efficiency.”

Smart Eye’s Automotive Interior Sensing AI running on TI’s new vision processor family will be demonstrated by TI in hall 3A, booth 215 during the embedded world Exhibition & Conference in Nürnberg, Germany, on 14^th to 16^th March 2023.