Method of Controlling the Depth of Field for a Small Sensor Camera Using an Extension for EDOF

• US 20120200726A1
• Filed: 02/09/2011
• Published: 08/09/2012
• Est. Priority Date: 02/09/2011
• Status: Abandoned Application

• Current Assignee: Research In Motion Limited (Blackberry Limited)
• Original Assignee: Research In Motion Limited (Blackberry Limited)
• Inventors: Bugnariu, Calin Nicolaie
• Application Number:
  US13/023,684
• Publication Number:
  US 20120200726A1
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: G06T 2207/10052 Images from lightfield camera
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: H04N 23/959 by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics

Abstract

A system is provided for providing an adjustable depth of field in a photographic image. The system comprises a plurality of buffers, each configured to store an image associated with a different wavelength of light, each of the images having a different focal plane related to the associated wavelength. The system further comprises an algorithm configured to accept an input specifying the depth of field and a focal plane and further configured to produce a photograph with the specified depth of field and focal plane, wherein the algorithm applies the specified depth of field around the specified focal plane, the specified focal plane being associated with a focal plane of one of the images stored in one of the buffers.

Claims

1. A system for providing an adjustable depth of field in a photographic image, comprising:

a plurality of buffers, each configured to store an image associated with a different wavelength of light, each of the images having a different focal plane related to the associated wavelength; and

an algorithm configured to accept an input specifying the depth of field and a focal plane and further configured to produce a photograph with the specified depth of field and focal plane, wherein the algorithm applies the specified depth of field around the specified focal plane, the specified focal plane being associated with a focal plane of one of the images stored in one of the buffers.

2. The system of claim 1, wherein each of the plurality of buffers receives a respective image from one of a plurality of pixel elements, each of the pixel elements configured to detect a different wavelength of light.

3. The system of claim 2, wherein the different wavelengths of light detected by each of the pixel elements are produced by a lens having a controlled longitudinal chromatic aberration.

4. The system of claim 1, wherein the algorithm produces proper colors in the photograph by using at least one color from an image stored in at least one buffer other than the buffer associated with the specified focal plane.

5. The system of claim 4, wherein the algorithm produces the proper colors using at least one technique that is used in an extended depth of field procedure.

6. The system of claim 5, wherein the specified depth of field is smaller than a depth of field that can be achieved with the extended depth of field procedure.

7. The system of claim 1, further comprising a user interface configured to accept the input specifying the depth of field and focal plane and to provide the input to the algorithm.

8. The system of claim 1, wherein the system is implemented in a fixed-lens camera.

9. A method for providing an adjustable focal plane for a photographic image after the photographic image has been captured, comprising:

generating a depth map;

transporting sharpness to all color channels;

generating a digital image;

saving the digital image and the depth map;

accepting a user selection of a focal plane and a depth of field;

using the depth map to isolate a depth layer expected to be in focus; and

combining all the layers to create a final digital image.

10. The method of claim 9, wherein generating the depth map comprises:

assigning to each pixel of the final digital image a depth value that represents the position of the object to which the pixel belongs within the depth of field of the camera;

the depth map partitioning a scene into coarse depth layers that coincide with a depth of field for each color channel of a sensor by sorting the sharpness for each pixel in each color channel; and

computing the relative sharpness between channels based on the neighborhood of each pixel.

11. The method of claim 9, wherein transporting the sharpness to all color channels is performed at the pixel level and comprises:

copying the high frequencies of the sharpest color channel, as identified by the depth map, to the other color channels;

obtaining the final digital image by combining the color channels; and

based on the information from the depth map, putting every pixel in one of the depth layers.

12. The method of claim 9, wherein the specified depth of field is smaller than a depth of field that can be achieved with an extended depth of field procedure.

13. The method of claim 9, further comprising a user interface accepting the input specifying the depth of field and focal plane.

14. The method of claim 9, wherein the method is implemented in a fixed-lens camera.

15. A fixed-lens camera that allows adjustment of a focal plane and depth of field in a photographic image captured by the fixed-lens camera, comprising:

a lens having a controlled longitudinal chromatic aberration;

a plurality of pixel elements, each configured to detect a different wavelength of light emerging from the lens;

a plurality of buffers, each configured to receive and store an image produced by one of the pixel elements; and

an algorithm configured to accept an input specifying the focal plane and depth of field and further configured to produce a photograph with the specified focal plane and depth of field.

16. The camera of claim 15, wherein the specified focal plane is associated with a focal plane of one of the images stored in one of the buffers.

17. The camera of claim 16, wherein the algorithm produces proper colors in the photograph by using at least one color from at least one other image stored in at least one other buffer.

18. The camera of claim 17, wherein the algorithm produces the proper colors using at least one technique that is used in an extended depth of field technique for producing proper colors.

19. The camera of claim 15, wherein the specified depth of field is smaller than a depth of field that can be achieved with an extended depth of field procedure.

20. The camera of claim 15, further comprising a user interface configured to accept the input specifying the focal plane and depth of field and provide the input to the algorithm.