STMicroelectronics and eYs3D Microelectronics collaborate

3rd January 2023

Beth Floyd

0 0

STMicroelectronics, a global semiconductor company serving customers across the spectrum of electronics applications, and eYs3D Microelectronics, a fabless semiconductor design house that focuses on end-to-end hardware and software systems for computer vision, including advanced vision-processing System-on-Chip (SoC) devices, will reveal the results of their collaboration on high-quality machine vision at CES 2023 in Las Vegas on January 5-8.

Using live demonstrations, the companies will show how stereo video and depth camera made from advanced active-coded infrared technology can enhance capabilities like feature recognition and autonomous guidanceat mid-to-long working range.

“STMicroelectronics’ advanced image sensors, using proprietary process technologies, offer class-leading pixel size while offering both high sensitivity and low crosstalk,” said James Wang, Chief Strategy & Sales Officer, eYs3D Microelectronics. “Such high-performance image sensors at a competitive price point enable usto achieve extremely compact system size while ensuring outstanding machine-vision performance. The strong connection we have established with ST increases our confidence to develop new products that will lead the machine vision market.”

“The collaboration with eYs3D Microelectronics, throughtheir expertise in capture, perception understanding, and 3D-fusion,offers ST additional business opportunities, use cases, and ecosystems addressing demands for stereo vision in applications such as robots, home-automation, home appliances, and many others,” said David Maucotel, Business Line Manager at ST’s Imaging Sub-Group. “While the reference designs showcased at CES are using monochromatic sensors, we can already foresee exciting enhancements and further use-cases using the RGB and RGB-IR versions of our sensors.”

The CES demonstrations highlight two jointly developed reference designs, the Ref-B6 and Ref-B3ASV (Active Stereo Vision) video and depth cameras. Both combine the eYs3D CV processor and eSP876 stereo 3D Depth-Map chipset with ST’s global shutter image sensors that provide enhanced near-infrared (NIR) sensitivity. The embedded eYs3D chipsetenhances object edge detection, optimises depth de-noising, and outputs HD-quality 3D depth data up to 60fps frame rate. ST’s image sensors enable the cameras to output data streams in various combinations of video/depth resolution and frame rate for the best quality depth sensing and point-cloud creation.In addition, optimised lenses, filters and a VCSEL active-IRprojector source optimise the infrared optical path and maximize immunity to ambient light noise. A specially developed control algorithm turns the IR projector on and oﬀ alternately to permit capturing artifact-free gray scale images. Leveraging this advanced hardware design, the Ref-B6 stereo-video camera achieves a 6-centimetre baseline and 85deg(H) x 70deg(V) depth field of view. Both eYs3D reference designs include the SDK (Software Development Kit) supporting Windows, Linux and Android OS environments with multiple different programming languages and wrapper APIs.

eYs3D will showcase the joint development Ref-B6 Depth Camera at two booth locations:

LVCC, Booth #15769, Central Hall and Venetian, Eureka Park, Booth #62500, AT1, Hall G.