Renesas Electronics and Renesas Mobile Introduce Single Chip Solution for Top View System with Image Recognition Capabilities

The new SH7766 SoC retains compatibility with Renesas’ existing SH77650 image recognition SoC while delivering improved performance. In particular, the display functions such as viewpoint conversion and dynamic range control (brightness compensation, etc.) have been enhanced. These new functions make it possible to develop applications with clear top-view virtual camera visualization. These can use different viewpoints to display the changing surroundings in real time and provide monitoring functionalities such as advanced driver assistance systems (ADAS).

ADAS applications, such as lane deviation warning systems (see Note 2), are becoming more widespread. Related trends include display applications that enable drivers to monitor their vehicle’s surroundings while parking. These applications include rear-view monitor and top view systems which are gaining in popularity. Advances have been made in seamless safety support systems that provide uninterrupted coverage of the area in front of the vehicle as well as its surroundings. For this reason, there is growing demand for improved image recognition technology, to underpin sensing and extended functions that provide a clear and easily understandable display to the driver.

At the same time, image recognition systems are diversifying beyond lane recognition to include simultaneous recognition of multiple objects such as signs and markings, pedestrians, and vehicles. This has led to a demand for increased performance in image recognition engines, which must perform multiple processing tasks in parallel. An efficient architecture using a combination of CPU and specialized IP is necessary to handle the different recognition algorithms in order to distinguish objects of different shapes and sizes as well as people.

In response to these demands, Renesas' next-generation SH7766 image recognition SoC improves on the performance of its predecessor, the SH77650, and delivers enhanced view functions and higher image recognition engine performance.

Key features of the SH7766 SoC
(1) Viewpoint conversion engine and dynamic range control for improved view functions
The SH7766 SoC integrates a hardware engine that enables new view functions such as a viewpoint conversion engine and dynamic range control. For each video input, the image renderer (IMR) viewpoint conversion engine generates in real time top view images in which the viewpoint changes with the surroundings. The dynamic range control (DRC) function adjusts the composite video brightness to compensate for indistinctness in both very bright and very dark portions, even when handling multiple video feeds with large brightness differences due to sunlight and shade. As a result, the driver with a display that is easy to see in all lighting conditions.
The SH7766 SoC also implements 2-D graphics capabilities (optionally a 3-D graphics engine, see Note 3), making it possible to develop an exceptionally high-level user interface by overlaying sophisticated graphical elements onto the video from the cameras.

(2) IMP-X2 next-generation image recognition engine
The SH7766 SoC features the IMP-X2 next-generation image recognition engine. The IMP-X2 retains library compatibility with Renesas’ existing image processing engine (IMP) while boosting processing performance more than fourfold. This enables it to perform multiple processing tasks in parallel, such as tracking lanes, signs and markings, pedestrians, and vehicles. It adds new functions such as integral image generation, which makes extensive use of image recognition algorithms for distinguishing pedestrians, vehicles, etc. It shares determination processing with the CPU on the same chip, making possible a high level of image recognition performance while keeping power consumption low.

(3) Six video input channels, including four channels with integrated NTSC ADCs, for reduced system cost
The SH7766 SoC has six video input channels. Of these, four channels incorporate NTSC analogue -to-digital converters (ADCs). This means that the capabilities necessary for an NTSC camera system are provided on a single chip. It is also possible to make use of the six video input channels to implement multiple applications using the capabilities provided on a single chip. For example, two digital channels could be used during normal driving, switching as necessary to four NTSC channels at intersections, when parking, etc.

The new SH7766 SoC shares its architecture, IP, and software with the Renesas R-Car series of SoCs for vehicle information terminals. It can be extended to applications such as navigation systems and vehicle information terminals equipped with image recognition and viewpoint conversion functions.