Bosch IMUs enable gesture control in wearables

Many of these devices rely on camera-based or Time-of-Flight (ToF) systems to capture gestures, but these technologies have notable limitations – they demand a clear line of sight and substantial processing power to function effectively. In this context, Bosch Sensortec’s inertial measurement units (IMUs) offer a powerful alternative.

Advantages of IMU-based gesture control

Enhanced power efficiency:

IMUs, especially smart IMUs like Bosch Sensortec’s BHI360 programmable smart sensor system, excel in power efficiency. Unlike camera-based gesture control systems, which require continuous image capture and processing, IMUs track motion through acceleration and orientation changes. On-sensor processing software achieves gesture recognition with minimal latency and energy use. This extends battery life and increases the time between charges for the end device.

No line-of-sight or environmental limitations:

Bosch Sensortec’s IMU-based systems offer robust gesture control regardless of environmental conditions. They are not affected by lighting, obstacles, or the need for line-of-sight, unlike camera-based solutions often found in devices like augmented reality headsets. Additionally, they eliminate the need for expensive and bulky camera-based systems, offering utmost application flexibility. 

Compact, seamless integration:

IMUs from Bosch Sensortec are compact, lightweight, and ideal for integration into small wearable devices. The BHI360 smart IMU sensor, for instance, easily fits into smartwatches, allowing manufacturers to deliver sleek, unobtrusive designs without sacrificing functionality. By embedding AI and advanced algorithms directly on the sensor, the BHI360 enables ultra-low latency, real-time gesture recognition, elevating the user experience with faster, more responsive interactions. Its programmability allows manufacturers to customise gesture recognition algorithms for specific applications, offering exceptional flexibility across diverse wearable devices.

Additional information from signal amplitude:

Bosch Sensortec IMUs provide additional information by measuring the intensity of gestures, primarily through the accelerometer signal amplitude. This adds a useful dimension of information to event recognition, allowing for more nuanced and accurate gesture detection. For instance, the force of a pinch gesture or the acceleration profile of a hand wave can be quantified, enabling more sophisticated and context-aware interactions. This capability enhances the overall user experience by allowing devices to respond more intelligently to varying gesture intensities.

Lower cost:

IMU-based systems from Bosch Sensortec are generally significantly lower in cost compared to camera-based systems. This cost efficiency makes gesture control accessible for simpler devices, broadening the range of products that can benefit from advanced interaction capabilities. Additionally, for high-end devices that already incorporate cameras, IMUs can complement these systems to increase gesture recognition accuracy. By combining the strengths of both technologies, manufacturers can deliver superior performance without significantly increasing production costs.

A superior user experience

IMU-based gesture control systems elevate how users interact with wearables. With natural gestures like pinching or wrist flicks, users can adjust volume, control lighting, or navigate media effortlessly.  Bosh’s collaboration with Doublepoint, a company specialising in human-machine interface (HMI) technology based on MEMS sensors, is a great example. Their gesture recognition platform, deployed directly on Bosch Sensortec's programmable IMU-based sensor system BHI360, demonstrates a practical application of the technology. By processing AI-driven algorithms directly on the sensor, the solution delivers ultra-low latency while minimising power consumption, enabling always-on gesture detection in modern wearables.

“Together with Doublepoint, we empower manufacturers to accelerate product development by delivering a ready-to-implement micro-gesture control solution that enhances user interaction across connected devices, including AR/VR, robotics, IoT, wearables, TVs, automotive systems, and more”, says Marcellino Gemelli, Head of Global Business Development at Bosch Sensortec.