Lensless computerised camera could assist autonomous vehicles

If a normal digital camera sensor such as one for a mobile phone or an SLR camera is pointed at an object without a lens, it results in an image that looks like a pixelated blob. However, within that blob is still enough digital information to detect the object if a computer programme is properly trained to identify it. You simply create an algorithm to decode the image.

Full-motion video as well as colour images
Through a series of experiments, University of Utah electrical and computer engineers took a picture of the university’s 'U' logo as well as video of an animated stick figure, both displayed on an LED light board.

An inexpensive, off-the-shelf camera sensor was connected to the side of a plexiglass window, but pointed into the window while the light board was positioned in front of the pane at a 90° angle from the front of the sensor.

The resulting image from the camera sensor, with help from a computer processor running the algorithm, is a low resolution picture but definitely recognisable. But the method also can produce full-motion video as well as colour images.

The process involves wrapping reflective tape around the edge of the window. Most of the light coming from the object in the picture passes through the glass, but just enough - about 1% - scatters through the window and into the camera sensor for the computer algorithm to decode the image.

Lensless camera for autonomous cars
While the resulting photo is not enough to win a Pulitzer Prize, it would be good enough for applications such as obstacle-avoidance sensors for autonomous cars. But more powerful camera sensors can produce higher resolution images.

Applications for a lensless camera can be almost unlimited. Security cameras could be built into a home during construction by using the windows as lenses. It could be used in augmented-reality goggles to reduce their bulk. With current AR glasses, cameras have to be pointed at the user’s eyes in order to track their positions, but with this technology they could be positioned on the sides of the lens to reduce size.

A car windshield could have multiple cameras along the edges to capture more information. And the technology also could be used in retina or other biometric scanners, which typically have cameras pointed at the eye.

From here, the team will further develop the system, including 3D images, higher colour resolution and photographing objects in regular household light. The current experiments involved taking pictures of self-illuminated images from the light board.

The innovation was detailed in a research paper, 'Computational Imaging Enables a ‘See-Through’ Lensless Camera', published in the newest issue of Optics Express.