Methods and apparatus for facilitating selective blurring of one or more image portions

• US 9,749,549 B2
• Filed: 10/06/2015
• Issued: 08/29/2017
• Est. Priority Date: 10/06/2015
• Status: Active Grant

• Current Assignee: Blue River Technology Inc. (Deere & Company)
• Original Assignee: Light Labs Inc.
• Inventors: Shroff, Sapna A.
• Primary Examiner(s): Vieaux, Gary C
• Application Number:
  US14/876,163
• Publication Number:
  US 20170099443A1
• Time in Patent Office: 693 Days
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability

Abstract

Methods and apparatus provide for simulated, e.g., synthetic, aperture control. In some embodiments a user, after a camera autofocus or user selection of an object to focus on, sets a blur level and views the effect. Once the user controlled blur setting is complete, images are captured with the in-focus, e.g., autofocus, setting and other images are captured with the focus set to capture a blurred image based on the set blur level. In focus and out of focus images are captured in parallel using different camera modules in some embodiments. A composite image is generated by combining portions of one or more sharp and blurred images. Thus a user can capture portions of images with a desired level of blurriness without risking blurring other portions of an image while controlling how the captured images are combined to form a composite image with in-focus and blurred portions.

Claims

1. A method of operating a camera device, the method comprising:

capturing an image of a scene;

setting a blur level to a user selected blur level;

displaying a preview image of the scene showing an effect of the user selected blur level;

controlling a first set of camera modules to focus based on a user selected object or to focus based on an autofocus determined focus setting, said first set of camera modules being in-focus camera modules, wherein the focus of the in-focus camera modules is not based on the user selected blur level; and

controlling a second set of camera modules to focus based on the user selected blur level, said second set of camera modules being out of focus camera modules.

2. The method of claim 1, further comprising:

capturing one or more in-focus images using said first set of camera modules; and

capturing one or more blurry images using said second set of camera modules.

3. The method of claim 2, wherein capturing one or more blurry images includes operating said second set of camera modules in parallel with said first set of camera modules to capture images at the same time.

4. The method of claim 3, further comprising:

generating a composite image from one or more in-focus images and said one or more blurry images.

5. The method of claim 3, further comprising:

receiving user input indicating which portions of an image are to be subject to user selected blurring.

6. The method of claim 5, wherein generating a composite image includes using a portion of a blurry image for a composite image portion selected to be subject to blurring by the user and using a portion of an in-focus image for a portion of said composite image which was not selected by the user to be subject to blurring.

7. The method of claim 6, further comprising:

displaying said composite image on a display device included in said camera.

8. The method of claim 1, wherein the first set of camera modules includes a plurality of camera modules and wherein the second set of camera modules also includes a plurality of camera modules.

9. The method of claim 8, wherein a focus distance setting for the out of focus camera modules is intentionally different than a focus distance setting used for the in-focus camera modules.

10. The method of claim 1,

wherein the second set of camera modules which are out of focus camera modules includes a plurality of camera modules and wherein the user selects different blur levels to be applied to different portions of a scene, the method further comprising:

controlling different out of focus camera modules to focus at different depths based on the different user selected blur levels to be applied to the different user selected portions of the scene.

11. The method of claim 1,

wherein prior to setting the blur level presenting on a display a blur level control setting to a user;

and

wherein said preview image is an image captured by a camera module which is set to an out of focus level determined based on the user selected blur level or a preview image generated by simulating a blur corresponding to the user selected blur level.

12. A camera device comprising:

a first set of camera modules;

a second set of camera modules;

an input device for receiving a user selected blur level selection setting;

a display device configured to display a preview image of the scene showing an effect of the inputted blur level setting selection; and

a processor configured to;

control a camera module to capture an image of a scene;

control the first set of camera modules to focus based on a user selected object or to focus based on an autofocus determined focus setting, said first set of camera modules being in-focus camera modules, wherein the focus of the in-focus camera modules is not based on the user selected blur level selection setting; and

control the second set of camera modules to focus based on the user selected blur level selection setting, said second set of camera modules being out of focus camera modules.

13. The camera device of claim 12, wherein said processor is further configured to control said camera device to:

capture one or more in-focus images using said first set of camera modules; and

capture one or more blurry images using said second set of camera modules.

14. The camera device of claim 13, wherein said processor is further configured to control said camera device to operate said second set of camera modules in parallel with said first set of camera modules to capture images at the same time.

15. The camera device of claim 14, wherein said processor is further configured to control said camera device to generate a composite image from said one or more in-focus images and said one or more blurry images.

16. The method of claim 14, further wherein said processor is further configured to control said camera device to receive user input indicating which portions of an image are to be subject to user selected blurring.

17. The camera device of claim 16, wherein said processor is further configured to control said camera device to generate a composite image using a portion of a blurry image for a composite image portion selected to be subject to blurring by the user and using a portion of an in-focus image for a portion of said composite image which was not selected by the user to be subject to blurring.

18. A non-transitory computer readable medium including computer executable instructions which when executed by a processor control a camera device to:

capture an image of a scene;

set a blur level to a user selected blur level;

display a preview image of the scene showing an effect of the user selected blur level;

control a first set of camera modules to focus based on a user selected object or to focus based on an autofocus determined focus setting, said first set of camera modules being in-focus camera modules, wherein the focus of the in-focus camera modules is not based on the user selected blur level; and

control a second set of camera modules to focus based on the user selected blur level, said second set of camera modules being out of focus camera modules.

19. A method of operating a camera device, the method comprising:

capturing an image of a scene;

displaying a preview image;

receiving user input indicating a first user selected blur level;

controlling a first set of optical chains including one or more optical chains to focus based on a user selected object or to focus based on an autofocus determined focus setting, said first set of optical chains being in-focus optical chains, wherein the focus of the in-focus optical chains is not based on the first user selected blur level, each optical chain in the first set of optical chains including a sensor; and

controlling a second set of optical chains to focus based on the first user selected blur level, said second set of optical chains including multiple optical chains, each optical chain in the second set of optical chains including a sensor.

20. The method of claim 19, wherein controlling the first set of optical chains and the second set of optical chains includes controlling the first and second sets of optical chains to capture images in parallel.

21. The method of claim 20, further comprising:

receiving user input indicating an additional user selected blur level which is different from the first user selected blur level;

controlling a third optical chain to focus based on the additional user selected blur level; and

generating a composite image generated from an image captured by an optical chain in the first set of optical chains, an image captured by an optical chain in said second set of optical chains and an image captured by the third optical chain.