STMicroelectronics reveals STGesture recognition for touchless control in diverse applications

The solution comprises free engineering software to be used with ST’s VL53L5CXFlightSense time-of-flight (ToF) multizone ranging sensor. Gesture recognition with ToF sensors is a breakthrough technology that enables sophisticated interactions with a wide variety of devices.

Initially a feature of high-end vehicles, gesture-based interaction can enhance numerous types of equipment, including kitchen appliances, thermostats, smart-home and smart-lighting controls, laptops, AR/VR headsets, tablets, and smartphones. Also, in today’s world, user interfaces able to interpret touchless gestures can help prevent infections from spreading through equipment like vending and ticketing machines, elevator controls, and interactive signage.

ST is now making gesture detection simpler and more affordable for mass-market applications with this latest companion software for its VL53L5CX multi-zone ToFranging sensor. Together, the sensor and software calculate in real-time the X/Y/Z coordinates of the hand, enabling hand tracking and thus recognition of gestureslike tapping, swiping and level control.

Conventional gesture-recognition systems typically use more expensive and intrusive camera-based machine vision. ST’s solution lets designers build systems that benefit from greater user privacyand lower power consumption, and thatwork in the dark without needing external illumination, unlike vision-based solutions. The lightweight gesture algorithm can run on a low-power microcontroller and demands minimal system resources, so is easily integrated in an existing application.

“Current trends are driving so-called edge devices to become more affordable and energy efficient, as well as more advanced and powerful,” said Eric Aussedat, ST’s Executive VP, Imaging Sub-Group General Manager. “ST is setting the pace with technologies such as ourFlightSenseimaging product portfolio, which now adds free and ready-to-use software that helps integrate gesture sensing for touchless control in all kinds of consumer and industrial equipment.”

The STSW-IMG035 software package is specially designed for the VL53L5CX multi-zone direct time-of-flight (dToF) ranging sensor and can be used with all STM32 microcontrollers. The VL53L5CX is ST’s latest-generation ToF sensor, providing 64 zones with high-accuracy ranging up to 400cm with a wide, square-edged 63°-diagonal field of view.

ST’s imaging team will present a webinar about gesture recognition, covering the principles, benefits, and real-life gesture applications, on April 26.

The VL53L5CX sensor is in production now, in a 6.4mm x 3.0mm x 1.5mm 16-pin optical LGA package, priced from $3.90 for orders of 1,000 pieces. The turnkey STSW-IMG035 gesture package includes resources including a GUI, example code, and libraries.  Associated software packages and hardware evaluation boards are also available.