Compressive imaging using structured illumination

• US 10,345,681 B2
• Filed: 10/17/2016
• Issued: 07/09/2019
• Est. Priority Date: 10/17/2016
• Status: Active Grant

• Current Assignee: Nokia of America Corporation (Nokia Corporation)
• Original Assignee: Nokia of America Corporation (Nokia Corporation)
• Inventors: Jiang, Hong, Huang, Gang, Yu, Victor, Wilford, Paul A., Yuan, Xin
• Primary Examiner(s): Ye, Lin
• Assistant Examiner(s): Morehead, III, John H.
• Application Number:
  US15/295,512
• Publication Number:
  US 20180107095A1
• Time in Patent Office: 995 Days
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: H03M 7/3062 Compressive sampling or sensing
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof

Abstract

A plurality of lighting elements is configured to selectively illuminate a scene during a plurality of time intervals. The plurality of lighting elements forms a different illumination pattern in each of the plurality of time intervals. One or more sensors are configured to measure a plurality of intensities of light received from the scene during the plurality of time intervals. A processor is configured to generate an image of the scene based on the plurality of intensities. In some cases, the plurality of lighting elements are switched on or off to produce different illumination patterns during a plurality of time intervals that too short to be perceptible to the human eye.

Claims

1. A method comprising:

selectively illuminating a scene during a plurality of time intervals with different subsets of a plurality of lighting elements to form a different illumination pattern in each of the plurality of time intervals;

measuring a plurality of intensities of light reflected by the scene and received by a sensor while the scene is illuminated by the different illumination patterns during the plurality of time intervals; and

generating an image of the scene based on the plurality of intensities measured by the sensor during the plurality of time intervals, wherein generating the image of the scene comprises generating values of pixels that represent the image, and wherein a number of the pixels corresponds to a number of the plurality of lighting elements.

2. The method of claim 1, wherein selectively illuminating the scene comprises selectively illuminating the scene during a plurality of time intervals having durations that are too short to be perceptible to the human eye.

3. The method of claim 1, further comprising:

determining the different subsets of the plurality of lighting elements based on at least one of a target lighting level, a minimum degree of fluctuation of a lighting level, or properties of a sensing matrix that determines the different subsets of the plurality of lighting elements in the different illumination patterns.

4. The method of claim 1, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during a number of the plurality of time intervals that is less than a number of the plurality of lighting elements.

5. The method of claim 1, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during the plurality of time intervals using a plurality of sensors deployed at different locations relative to the scene.

6. The method of claim 1, wherein the number of pixels is equal to the number of the plurality of lighting elements.

7. The method of claim 6, wherein generating the image of the scene comprises performing joint reconstruction to create a common image from the plurality of intensities measured by a plurality of sensors.

8. The method of claim 7, wherein performing joint reconstruction comprises projecting images generated using measurements performed by each of the plurality of sensors onto a common image using a projection matrix.

9. An apparatus comprising:

a plurality of lighting elements configured to selectively illuminate a scene during a plurality of time intervals, wherein the plurality of lighting elements forms a different illumination pattern in each of the plurality of time intervals;

at least one sensor configured to measure a plurality of intensities of light reflected by the scene and received by the at least one sensor while the scene is illuminated by the different illumination patterns during the plurality of time intervals; and

at least one processor configured to generate an image of the scene based on the plurality of intensities measured by the at least one sensor during the plurality of time intervals, wherein the at least one processor is configured to generate values of pixels that represent the image, and wherein a number of the pixels corresponds to a number of the plurality of lighting elements.

10. The apparatus of claim 9, wherein the plurality of lighting elements is configured to selectively illuminate the scene during a plurality of time intervals having durations that are too short to be perceptible to the human eye.

11. The apparatus of claim 9, wherein the at least one sensor is configured to measure the plurality of intensities during a number of the plurality of time intervals that is less than a number of the plurality of lighting elements.

12. The apparatus of claim 9, wherein the at least one sensor comprises a plurality of sensors deployed at different locations relative to the scene, and wherein each of the plurality of sensors is configured to measure a corresponding plurality of intensities during the plurality of time intervals.

13. The apparatus of claim 9, wherein the number of pixels is equal to the number of the plurality of lighting elements.

14. The apparatus of claim 13, wherein the at least one processor is configured to determine different subsets of the plurality of lighting elements to form the different illumination patterns based on at least one of a target lighting level, a minimum degree of fluctuation of a lighting level, or properties of a sensing matrix that determines the different subsets of the plurality of lighting elements in the different illumination patterns.

15. The apparatus of claim 14, wherein the at least one processor is configured to perform joint reconstruction to create a common image from the plurality of intensities measured by a plurality of sensors.

16. The apparatus of claim 15, wherein the at least one processor is configured to project images generated using measurements performed by each of the plurality of sensors onto a common image using a projection matrix.

17. A method comprising:

measuring, using a sensor, a plurality of intensities of light received from a scene during a plurality of time intervals during which the scene is selectively illuminated by different subsets of a plurality of lighting elements that form a different illumination pattern in each of the plurality of time intervals; and

generating an image of the scene based on the plurality of intensities measured by the sensor during the plurality of time intervals, wherein the scene is represented by values of pixels, and wherein a number of the pixels corresponds to a number of the plurality of lighting elements.

18. The method of claim 17, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during a plurality of time intervals having durations that are too short to be perceptible to the human eye.

19. The method of claim 17, wherein the number of pixels is equal to the number of the plurality of lighting elements.

20. The method of claim 17, wherein measuring the plurality of intensities comprises measuring the plurality of intensities during a number of the plurality of time intervals that is less than a number of the plurality of lighting elements.