Simulated large aperture lens

• US 8,902,354 B2
• Filed: 11/25/2013
• Issued: 12/02/2014
• Est. Priority Date: 03/25/2011
• Status: Active Grant

• Current Assignee: Gary S. Shuster
• Original Assignee: Gary S. Shuster
• Inventors: Shuster, Gary Stephen
• Primary Examiner(s): SELBY, GEVELL V
• Application Number:
  US14/089,659
• Publication Number:
  US 20140078376A1
• Time in Patent Office: 372 Days
• Field of Search: 348/222.1, 348/349, 348/362
• US Class Current: 348/362
• CPC Class Codes: G01B 11/22 for measuring depth
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G02B 7/32 using active means, e.g. light emitter including both an active and a passive focus detecting device G02B7/285; using ultrasound G02B7/40
• CPC Class Codes: H04N 13/236 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/671 in combination with active ranging signals, e.g. using light or sound signals emitted toward objects
• CPC Class Codes: H04N 23/676 Bracketing for image capture at varying focusing conditions
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

A camera apparatus includes a photogrammetric range sensor, small aperture lens and a processor configured to carry out a method for simulating a large aperture lens. The method includes capturing a photographic image data of a scene using the camera with the lens set to a small aperture size. Simultaneously or near-simultaneously with capturing the image, the camera captures photogrammetric range data pertaining to depth of objects in a field of view of the camera, using the range sensor. The processor then processes the photographic image data using the photogrammetric range data to obtain second photographic data simulating an image captured using a lens set to an aperture size larger than the small aperture size.

Claims

1. A method, comprising:

capturing a photographic image data of a scene using a camera having a lens set to a first aperture size;

concurrently with capturing the image, capturing photogrammetric range data pertaining to depth of objects in a field of view of the camera at least in part by using the lens in combination with a stacked sensor array configured to detect photogrammetric measurement light at two or more defined points in a light path from photographed object to an image sensor of stacked sensor array distal from the photographed object; and

processing the photographic image data using the photogrammetric range data to obtain second photographic data simulating an image captured using a lens set to a second aperture size, wherein the second aperture size is wider than the first aperture size.

2. The method of claim 1, further comprising storing the photographic image data associated with the measurement data in an electronic memory.

3. The method of claim 1, wherein capturing the photogrammetric range data further comprises illuminating the scene using a narrow-band light adjacent to the lens, and measuring intensity of narrowband light reflected from objects in the scene.

4. The method of claim 3, further comprising illuminating the scene with multiple narrow-band lights spaced at different frequency bands, and measuring intensity of reflected light for each frequency band.

5. The method of claim 1, wherein capturing the photogrammetric range data further comprises using at least one additional image-capturing component coupled to the camera to capture stereo photogrammetric data.

6. The method of claim 1, wherein capturing the photogrammetric range data further comprises measuring time between emission of a signal from the camera and detection of a signal reflection at the camera.

7. The method of claim 1, wherein capturing the photogrammetric range data further comprises capturing additional photographs using an aperture wider than the first aperture and different focal points.

8. The method of claim 1, wherein capturing the photogrammetric range data further comprises illuminating the scene using a light source that spreads a known spectrum in a defined pattern.

9. The method of claim 1, wherein capturing the photogrammetric range data further comprises using a dual shutter trigger to capture separate photographs.

10. The method of claim 1, wherein capturing the photogrammetric range data further comprises detecting the photogrammetric measurement light at two or more defined points defined by an intersection of the light path with separate ones of the stacked sensors.

11. A camera apparatus comprising a processor and a memory coupled to the processor;

wherein the memory holds program instructions, that when executed by the processor, causes the apparatus to perform;

capturing a photographic image data of a scene using a camera having a lens set to a first aperture size;

concurrently with capturing the image, capturing photogrammetric range data pertaining to depth of objects in a field of view of the camera at least in part by using the lens in combination with a stacked sensor array configured to detect photogrammetric measurement light at two or more defined points in a light path from photographed object to an image sensor of stacked sensor array distal from the photographed object; and

processing the photographic image data using the photogrammetric range data to obtain second photographic data simulating an image captured using a lens set to a second aperture size, wherein the second aperture size is wider than the first aperture size.

12. The apparatus of claim 11, wherein the program instructions are further configured for storing the photographic image data associated with the measurement data in an electronic memory.

13. The apparatus of claim 11, wherein the program instructions are further configured for capturing the photogrammetric range data by illuminating the scene using a narrow-band light adjacent to the lens, and measuring intensity of narrowband light reflected from objects in the scene.

14. The apparatus of claim 13, wherein the program instructions are further configured for illuminating the scene with multiple narrow-band lights spaced at different frequency bands, and measuring intensity of reflected light for each frequency band.

15. The apparatus of claim 11, wherein the program instructions are further configured for capturing the photogrammetric range data by using at least one additional image-capturing component coupled to the camera to capture stereo photogrammetric data.

16. The apparatus of claim 11, wherein the program instructions are further configured for capturing the photogrammetric range data by measuring time between emission of a signal from the camera and detection of a signal reflection at the camera.

17. The apparatus of claim 11, wherein the program instructions are further configured for capturing the photogrammetric range data by capturing additional photographs using an aperture wider than the first aperture and different focal points.

18. The apparatus of claim 11, wherein the program instructions are further configured for capturing the photogrammetric range data by illuminating the scene using a light source that spreads a known spectrum in a defined pattern.

19. The apparatus of claim 11, wherein the program instructions are further configured for capturing the photogrammetric range data by using a dual shutter trigger to capture separate photographs.

20. The apparatus of claim 11, wherein the program instructions are further configured for detecting the photogrammetric measurement light at the two or more defined points defined by an intersection of the light path with separate ones of the stacked sensors.