Seeing Machines, Ambarella & Autobrains offer combined front ADAS & driver monitoring solution

Autobrains is an AI-pioneer mobility company that develops revolutionary self-learning AI technology and products covering all levels of advanced driver assistance systems (ADAS) and autonomous driving (AD); Ambarella is an edge AI semiconductor company; and Seeing Machines Limited is a supplier of AI-powered driver and occupant monitoring systems (DMS and OMS) technology to improve transport safety.

The companies’ joint offering provides automakers with a streamlined, single-box, multi-camera solution, including a forward-facing camera up to 8MP and an in-cabin camera up to 5MP. This solution enables OEMs to increase vehicle safety and meet both front ADAS and DMS industry standards, including Euro NCAP and the European Commission General Safety Regulation (GSR).

This open-platform solution combines Seeing Machines’ embedded Driver Monitoring Engine (e-DME) software stack with Autobrains’ patented signature-based AI software stack on a single, power efficient, high-performance Ambarella CV2FS/CV22FS AI perception SoC. Additionally, this joint solution provides the flexibility to add multiple subsystems and stacks on a single CV2FS/CV22FS SoC, as well as sensors with different color filter arrays, and advanced features such as DVR functionality.

Ambarella’s CV2FS/CV22FS SoCs provide high AI performance, as well as great image quality for operation in challenging lighting conditions. In combination with the highly efficient software from both Autobrains’ proven self-learning AI and Seeing Machines, this integrated solution provides low power consumption, which reduces thermal-management requirements and enables both the ADAS and DMS cameras to be packaged in a single box, lowering system cost and complexity. This low power and heat allow one-box, single-ECU solutions to be placed in high-temperature areas that are optimal for both cameras, such as the dashboard or near the rearview mirror.

The joint solution provides a rapid and power-efficient path to meeting industry standards and regulations. Additionally, it enables tier-1s and OEMs to easily scale the implementation of these systems across vehicle models using Ambarella’s large portfolio of CVflow AI SoCs that share a common software development kit (SDK) platform. This allows designers to preserve their development investments while tailoring the selected SoC’s processing power to the needs of each car model’s features, from basic ADAS and DMS to full domain control using the 5nm CV3 family for level 2+ to L4 autonomy and beyond.

Likewise, the features of Seeing Machines’ in-cabin DMS and OMS, and Autobrains’ modular ADAS and AD software can scale from the baseline for current regulations and standards, to L2+ and L3 semi-autonomous vehicles, for fusion between driver state detection and self-driving system handoffs, through to the highest levels of autonomy. Additional capabilities such as Autobrians’ advanced set of ADAS and AD functionalities, including edge-case coverage, hazard detection and freespace detection, along with digital video recording via the Ambarella CV2FS/CV22FS SoCs’ on-chip encoder, enable OEMs to provide value-added features.

“Autobrains’ self-learning Perception AI for ADAS and autonomous driving is transforming the next generation of mobility, responding to the industry’s limitations,” said Autobrains CEO Igal Raichelgauz. “Incumbent market solutions are unable to cover unpredictable edge cases without more advanced, self-learning-based algorithms. Autobrains’ self-learning applications, designed to learn like the human brain through neural networks and process information the same way as humans, thwart these challenges.

"Our hardware-agnostic AI Perception, which requires less data and computing power, combined with the offerings of Ambarella and Seeing Machines, allowed this joint offering to come to fruition, and can help automakers and suppliers to more easily and affordably scale these robust safety systems across vehicle lines.”

“Our open CVflow AI processing platform not only allowed Autobrains and Seeing Machines to easily port their stacks onto our SoCs, but it will also enable our mutual tier-1 and OEM automotive customers to readily add their own ADAS and human interface layers to this joint solution,” said Fermi Wang, President and CEO of Ambarella. “The CV2FS/CV22FS SoCs combine the processing power for multiple perception stacks with the industry-leading efficiency required to reduce power consumption and thermal management for single-box DMS and ADAS camera implementations.”

“Automakers are looking for a way to reliably meet both DMS and ADAS regulatory and safety-standard requirements for all of their car models in the very near term. Due to these requirements, the DMS market alone is expected to grow to nearly 70 million units, per annum, by 2028, according to Semicast and ABI Research,” said Paul McGlone, CEO of Seeing Machines. “Our industry-leading interior cabin sensing solutions, focused on driver and occupant monitoring, in combination with Ambarella’s AI SoCs and Autobrains’ ADAS/AD software, provides that integration path while enabling an optimized implementation that can scale across the feature sets of today’s models, along with higher levels of autonomy for the future.”

Live demonstrations of this joint solution are offered by invitation-only during CES 2023.