Lensless Camera Creates 3D Images From a Single Exposure

A camera

Real-time 3D imaging method could improve robot navigation and content for 3D displays. (Image: via Pixabay)

Researchers have developed a lensless camera that uses a thin microlens array and new image processing algorithms to capture 3D information about objects in a scene with a single exposure. The lensless camera could be useful for a variety of applications such as industrial part inspection, gesture recognition, and collecting data for 3D display systems. Research team leader Weijian Yang from the University of California, Davis, said:

“We consider our camera lensless because it replaces the bulk lenses used in conventional cameras with a thin, lightweight microlens array made of flexible polymer. Because each microlens can observe objects from different viewing angles, it can accomplish complex imaging tasks such as acquiring 3D information from objects partially obscured by objects closer to the camera.”

Subscribe to our Newsletter!

Receive selected content straight into your inbox.

Weijian Yang and Feng Tian developed a camera that uses a thin microlens array and new image processing algorithms to capture 3D information about multiple objects in a single exposure.
Weijian Yang and Feng Tian developed a camera that uses a thin microlens array and new image processing algorithms to capture 3D information about multiple objects in a single exposure. The raw sub-images from the microarray are displayed on the monitor. (Image Credit: Savannah Luy, University of California – Davis)

In the Optica Publishing Group journal Optics Express, Yang and first author Feng Tian, a doctoral student in Yang’s lab, describe the new 3D camera. Because the lensless camera learns from existing data how to digitally reconstruct a 3D scene, it can produce 3D images in real time. Yang said:

“This 3D camera could be used to give robots 3D vision, which could help them navigate 3D space or enable complex tasks such as manipulation of fine objects. It could also be used to acquire rich 3D information that could provide content for 3D displays used in gaming, entertainment or many other applications.”

A lensless camera that learns

The new lensless camera grew out of previous work in which the researchers developed a compact microscope that can image 3D microscopic structures for biomedical applications, Yang said:

“We built the microscope using a microlens array and thought that a similar concept could be applied for imaging macroscopic objects.”

The individual lenses in the new camera allow it to see objects from different angles or perspectives, which provides depth information. Although other research groups have developed cameras based on single-layer microlens arrays, it has been difficult to make them practical because of extensive calibration processes and slow reconstruction speeds, Yang said:

“Many existing neural networks can perform designated tasks, but the underlying mechanism is difficult to explain and understand. Our neural network is based on a physical model of image reconstruction. This makes the learning process much easier and results in high quality reconstructions.”

Once the learning process is complete, it can reconstruct images containing objects that are at different distances away from the lensless camera at a very high speed. The new camera doesn’t need calibration and can be used to map the 3D locations and spatial profiles—or outlines—of objects.

Seeing through objects

After performing numerical simulations to verify the lensless camera’s performance, the researchers performed 2D imaging that showed perceptually pleasing results. They then tested the lensless camera’s ability to perform 3D imaging of objects at different depths. The resulting 3D reconstruction could be refocused to different depths or distances. The lensless camera also created a depth map that agreed with the actual object arrangement, Yang said:

“In a final demonstration, we showed that our camera could image objects behind the opaque obstacles. To the best of our knowledge, this is the first demonstration of imaging objects behind opaque obstacles using a lensless camera.”

The single-shot image acquired by the new lensless camera can be refocused and reconstructed to reveal object scenes at different distances.
The single-shot image acquired by the new lensless camera can be refocused and reconstructed to reveal object scenes at different distances. (Image: Feng Tian, University of California – Davis)

The researchers are currently working to reduce artifacts, or errors, that appear in the 3D reconstructions and to improve the algorithms to gain even higher quality and speed. They also want to miniaturize the overall device footprint so it can fit into a cellphone, which would make it more portable and enable more applications, Yang concluded saying:

“Our lensless 3D camera uses computational imaging, an emerging approach that jointly optimizes imaging hardware and object reconstruction algorithms to achieve desired imaging tasks and quality. With the recent development of low-cost, advanced micro-optics manufacturing techniques as well as advancements in machine learning and computational resources, computational imaging will enable many new imaging systems with advanced functionality.” 

Provided by Optica [Note: Materials may be edited for content and length.]

Follow us on TwitterFacebook, or Pinterest

Recommended Stories

Atrail through the woods in the fall.

As Our Planet Gets Greener, Plants Are Slowing Global Warming

An international team of researchers says findings reveal a daunting outlook for our changing climate. ...

The black plague.

The Great Plague Was a Prelude to a New Dynasty

A disease not only plays a role in the fate of an individual, but it ...

ITGC researchers retrieve the robotic submarine Icefin.

First-Ever Images at Foundation of Notorious Antarctic Glacier

During an unprecedented scientific campaign on an Antarctic glacier notorious for contributions to sea level, ...

The Thwaites Glacier.

Understanding How Quickly Massive Antarctic Glaciers Could Collapse

The collapse of the Thwaites Glacier in West Antarctica could significantly affect global sea levels. ...

Ballerina Aesha Ash.

The African-American Ballerina Bringing Ballet to the Streets of New York

Aesha Ash is a ballerina from the U.S. For most of her career, she was ...

A surveillance camera.

What Happens When a Communist Surveillance System Is Exported?

The Chinese government has installed over 200 million cameras throughout the country, making it the ...

Facial recognition equipment.

China Wants to Strengthen Xinjiang Surveillance Through World Bank Money

An exclusive scoop by the news website Axios claims that the Chinese government sought to ...

A reusable water bottle.

6 Eco-Friendly Ideas to Implement in 2020

As our needs grow and resources become more scarce, we need to pay attention to ...

A large container of laundry detergent.

Just Gone Viral: An Eco-Friendly Laundry Detergent Recipe

Laundry detergents often contain chemicals that can be harmful to you and your family. Why ...

Send this to a friend