Gesture recognition bought to embedded virtual reality platforms

2^nd gen head-mounted-devices will include front-facing 3D sensors to improve realism, but component cost and power consumption are key concerns. Bringing together the Inuitive NU3000 multi-core imaging processor and gestigon gesture recognition algorithms, the collaboration between the two companies aims to address these concerns.

“Our unique technology and architecture uses input from standard, low-cost cameras to efficiently generate depth maps. Now, through our collaboration with gestigon, we can offer a complete one-stop solution to our customers, shortening the development cycle,” said Shlomo Gadot, CEO and Co-Founder, Inuitive.

Inuitive’s NU3000 processor incorporates two CEVA MM3101 high-performance, low-power imaging and computer vision vector DSP cores. In addition, it integrates a dedicated hardware accelerator capable of extracting real-time depth maps from stereo vision input. The gestigon gesture recognition algorithms, based on its Carnival AR/VR Interaction Suite, are customised and optimised to run directly on this processor to provide fingertip and hand tracking, as well as gesture recognition.

“gestigon is in the business of enabling 3D sensors for global OEMs; Inuitive provides a unique and attractive solution especially suited for embedded environments.” states Moritz v. Grotthuss. “This collaboration is a key step Inuitive is taking towards the goal of offering a complete reference design for VR and AR products,” adds Shlomo Gadot.

The CES 2016 demonstration consists of a depth sensing module utilising the Inuitive NU3000 processing engine and featuring gestigon’s gesture recognition software. For demo purposes, the unit is assembled on an Oculus Rift development kit.