Smart Eye and Cerence demo AI in-car assistant

With a deep focus on human behaviour, AI expertise, and decades of experience delivering production-ready automotive solutions, the two companies are well positioned to provide car makers with the next generation of human to machine interaction.

On display at CES 2024, Smart Eye’s driver monitoring system (DMS) software is integrated with Cerence Assistant, the company’s core in-car assistant offering. Using a rearview mirror camera, the multi-modal system analyses a driver’s face and eye gaze to determine where a driver is looking, as well as whether they are speaking or expressing reactions and emotions. This integrated offering also supports drowsiness detection, which is becoming increasingly mandatory through new driver monitoring regulations worldwide.

With this human-centric insight combined with context from the vehicle, Cerence Assistant adapts its reaction in real-time to provide more natural, personalised, and relevant interactions with the driver. With increased emotional intelligence, Cerence Assistant will react differently if a driver is tired, distracted, or in a bad mood, than if the driver is alert, attentive, energetic, or joyful, enhancing safety and providing a comfortable and engaging driving experience that is more personalised than ever before.

“Drivers and passengers want to interact with vehicle HMI in a more natural, personalised, and relevant manner,” said Martin Krantz, Smart Eye Founder and CEO. “We are excited to collaborate with Cerence to deliver the next generation of immersive in-vehicle AI companions, that are emotionally aware and take engagement far beyond a basic voice command & control.”

“As we advance toward the AI-powered immersive companion, it’s critical that we integrate expanded driver awareness and intelligence that empowers the assistant to serve the driver through a range of needs and situations,” said Stefan Ortmanns, CEO, Cerence. “By partnering with Smart Eye, we’re delivering a well-integrated, seamless solution that will enhance safety and comfort for drivers.”

Smart Eye and Cerence’s integrated solution will be demonstrated at CES 2024 in the Cerence booth in the West Hall of the Las Vegas Convention Centre, booth number 6627.