COMPRESSIVE IMAGING USING STRUCTURED ILLUMINATION

• US 20180107095A1
• Filed: 10/17/2016
• Published: 04/19/2018
• Est. Priority Date: 10/17/2016
• Status: Active Grant

• Current Assignee: Nokia of America Corporation (Nokia Corporation)
• Original Assignee: Alcatel-Lucent USA, Inc. (Nokia Corporation)
• Inventors: Jiang, Hong, Huang, Gang, Yu, Victor, Wilford, Paul A., Yuan, Xin
• Granted Patent: US 10,345,681 B2
• Time in Patent Office: Days
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: H03M 7/3062 Compressive sampling or sensing
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof

Abstract

A plurality of lighting elements is configured to selectively illuminate a scene during a plurality of time intervals. The plurality of lighting elements forms a different illumination pattern in each of the plurality of time intervals. One or more sensors are configured to measure a plurality of intensities of light received from the scene during the plurality of time intervals. A processor is configured to generate an image of the scene based on the plurality of intensities. In some cases, the plurality of lighting elements are switched on or off to produce different illumination patterns during a plurality of time intervals that too short to be perceptible to the human eye.

Claims

1. A method comprising:

selectively illuminating a scene during a plurality of time intervals with different subsets of a plurality of lighting elements to form a different illumination pattern in each of the plurality of time intervals; and

measuring a plurality of intensities of light reflected by the scene and received by the sensor while the scene is illuminated by the different illumination patterns during the plurality of time intervals.

2. The method of claim 1, wherein selectively illuminating the scene comprises selectively illuminating the scene during a plurality of time intervals having durations that are too short to be perceptible to the human eye.

3. The method of claim 1, further comprising:

determining the different subsets of the plurality of lighting elements based on at least one of a target lighting level, a minimum degree of fluctuation of a lighting level, or properties of a sensing matrix that determines the different subsets of the plurality of lighting elements in the different illumination patterns.

4. The method of claim 1, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during a number of the plurality of time intervals that is less than a number of the plurality of lighting elements.

5. The method of claim 1, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during the plurality of time intervals using a plurality of sensors deployed at different locations relative to the scene.

6. The method of claim 1, further comprising:

generating an image of the scene based on the plurality of intensities, wherein generating the image of the scene comprises generating an image of the scene that is represented by a number of pixels equal to a number of the plurality of lighting elements.

7. The method of claim 6, wherein generating the image of the scene comprises performing joint reconstruction to create a common image from the plurality of intensities measured by a plurality of sensors.

8. The method of claim 7, wherein performing joint reconstruction comprises projecting images generated using measurements performed by each of the plurality of sensors onto a common image using a projection matrix.

9. An apparatus comprising:

a plurality of lighting elements configured to selectively illuminate a scene during a plurality of time intervals, wherein the plurality of lighting elements forms a different illumination pattern in each of the plurality of time intervals; and

at least one sensor configured to measure a plurality of intensities of light reflected by the scene and received by the sensor while the scene is illuminated by the different illumination patterns during the plurality of time intervals.

10. The apparatus of claim 9, wherein the plurality of lighting elements is configured to selectively illuminate the scene during a plurality of time intervals having durations that are too short to be perceptible to the human eye.

11. The apparatus of claim 9, wherein the at least one sensor is configured to measure the plurality of intensities during a number of the plurality of time intervals that is less than a number of the plurality of lighting elements.

12. The apparatus of claim 9, wherein the at least one sensor comprises a plurality of sensors deployed at different locations relative to the scene, and wherein each of the plurality of sensors is configured to measure a corresponding plurality of intensities during the plurality of time intervals.

13. The apparatus of claim 9, further comprising:

at least one processor configured to generate an image of the scene based on the plurality of intensities, wherein the at least one processor is configured to generate an image of the scene that is represented by a number of pixels equal to a number of the plurality of lighting elements.

14. The apparatus of claim 13, wherein the at least one processor is configured to determine different subsets of the plurality of lighting elements to form the different illumination patterns based on at least one of a target lighting level, a minimum degree of fluctuation of a lighting level, or properties of a sensing matrix that determines the different subsets of the plurality of lighting elements in the different illumination patterns.

15. The apparatus of claim 14, wherein the at least one processor is configured to perform joint reconstruction to create a common image from the plurality of intensities measured by a plurality of sensors.

16. The apparatus of claim 15, wherein the at least one processor is configured to project images generated using measurements performed by each of the plurality of sensors onto a common image using a projection matrix.

17. A method comprising:

measuring a plurality of intensities of light received from a scene during a plurality of time intervals during which the scene is selectively illuminated by different subsets of a plurality of lighting elements that form a different illumination pattern in each of the plurality of time intervals; and

generating an image of the scene based on the plurality of intensities.

18. The method of claim 17, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during a plurality of time intervals having durations that are too short to be perceptible to the human eye.

19. The method of claim 17, wherein generating the image of the scene comprises generating an image of the scene that is represented by a number of pixels equal to a number of the plurality of lighting elements.

20. The method of claim 17, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during a number of the plurality of time intervals that is less than a number of the plurality of lighting elements.