Why multi-camera synchronisation is a key feature in cameras

Embedded vision is a fundamental component of autonomous mobility systems, ensuring that they achieve undeniable levels of accuracy, reliability, and safety. Hence, it is no surprise that more autonomous robots and vehicles are getting equipped with high-resolution cameras. When paired with advanced processors, these cameras help the robots navigate and interact with their environments effectively.

The selection of these cameras is based on specific criteria such as sensor type, resolution, and frame rate. The primary function of these systems is to capture, process, and analyse visual data for tasks like object recognition, obstacle detection, and navigation. At the core of this autonomous innovation lies multi-camera synchronisation.

Understanding multi-camera synchronisation

Strategic placement

As you can imagine, camera placement is critical in autonomous vehicles. Cameras are installed at predetermined points around the vehicle, selected based on the vehicle’s design and the intended use case. This arrangement ensures comprehensive coverage, enabling the system to gather visual data from all angles, providing a complete 360° field of view.

The strategic placement also takes into account the field of view of each camera, ensuring minimal overlap and maximum coverage. This is especially demanding in complex environments where capturing spatial data is the backbone of navigation and obstacle avoidance.

Synchronisation

Synchronisation in multi-camera systems is a complex process that ensures all cameras operate in unison, capturing images at precisely the same moment. This synchronisation is achieved through a combination of hardware and software mechanisms.

Hardware synchronisation often involves using a common clock signal to trigger image capture simultaneously. Software synchronisation may involve time-stamping each image frame and aligning them in post-processing. This precise synchronisation is essential for creating a cohesive and accurate representation of the vehicle’s surroundings, which is necessary for real-time decision-making and navigation.

Applications of multi-camera synchronisation in ADAS

360° surround-view

Multi-camera synchronisation creates a 360° surround-view, enhancing driver awareness and vehicle safety. This system integrates images from multiple cameras positioned around the vehicle to provide a bird’s-eye view of the surrounding area. It is invaluable in various driving scenarios, such as parking, navigating tight spaces, or manoeuvring in busy traffic.

Image stitching

Image stitching is a direct application of multi-camera synchronisation, where images from different cameras are combined to create a single, coherent visual. This is useful in providing extended lateral and rear views, which are required for performing tasks like safe lane changes and merging. The synchronised cameras capture overlapping fields of view, which are then digitally stitched together, ensuring smooth transitions.

Remote driving assistance

Multi-camera synchronisation enhances remote driving assistance systems, where an operator remotely controls or assists the vehicle. The system can provide the operator with a clear visual representation of the vehicle’s surroundings. This is crucial for remote decision-making in unforeseen driving conditions. The operator, with access to real-time visual information, can better assess situations and provide accurate guidance.

Benefits of multi-camera synchronisation in autonomous mobility

Situational awareness

Multi-camera synchronisation provides autonomous vehicles with a comprehensive and cohesive view of their surroundings. This synchronised 360° coverage ensures that the vehicle is aware of its environment from all angles, significantly reducing blind spots and enhancing situational awareness.

Accurate spatial perception/depth estimation

The ability to accurately gauge distances and understand the objects’ spatial relationships is a key advantage. Autonomous systems analyse images from multiple synchronised cameras to better estimate depth and perceive the 3D structure of the environment. It is required for tasks like safe lane navigation, obstacle avoidance, and precise parking manoeuvres.

Reduced blind spots and false alarms

Multi-camera synchronisation minimises blind spots and reduces false alarms by strategically positioning and synchronising multiple cameras around the vehicle to create a comprehensive 360° view. This view ensures that potential hazards are identified accurately from all angles, reducing the likelihood of false alarms. Synchronised multi-camera systems also provide real-time information to enable these systems to make informed decisions.

Precise mapping and localisation

Each camera captures different aspects and angles of the environment, and when these perspectives are synchronised, they create a detailed spatial map. This helps the system to understand its surroundings accurately. Furthermore, the synchronised data from multiple cameras ensures accurate localisation, enabling the vehicle to pinpoint its exact position within the map. It can be important for path planning and manoeuvring, especially in complex environments.

e-con Systems’ multi-camera solutions for autonomous systems

e-con Systems has a track record of multi-camera system integration in various industries. Its advantage lies in its partnerships with sensor manufacturers like Sony, onsemi, and OmniVision, and as a key partner of NVIDIA, it delivers advanced technology solutions.

The company specialises in streamlining camera evaluations, offering a range of multi-camera solutions for two to eight camera systems with in-depth customisation capabilities to meet specific needs.