Digital image acquisition system with portrait mode

• US 7,692,696 B2
• Filed: 12/27/2005
• Issued: 04/06/2010
• Est. Priority Date: 12/27/2005
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Zamflr, Adrian, Steinberg, Eran, Capata, Adrian, Corcoran, Peter
• Primary Examiner(s): Chan; Jason
• Assistant Examiner(s): FOSSELMAN, JOEL W
• Application Number:
  US11/319,766
• Publication Number:
  US 20070147820A1
• Time in Patent Office: 1,561 Days
• Field of Search: 348/222.1, 348/239, 348/208.4
• US Class Current: 348/239
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A digital image acquisition system having no photographic film comprises an apparatus for capturing digital images and a flash unit for providing illumination during image capture. The system has a portrait mode for generating an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images (A, B and C) of nominally the same scene. One of the first and second images (A, B) is taken with flash and the other is taken without flash, and the third image (C) is blurred compared to the first and second images. The portrait mode is further operable to determine foreground and background regions of the scene using the first and second images (A, B), and to substitute the blurred background of the third image (C) for the background of an in-focus image of the scene. In one embodiment the in-focus image is one of the first and second images. In another embodiment the in-focus image is a fourth image.

Claims

1. A portable digital image acquisition apparatus having no photographic film (hereinafter “

portable apparatus”

), the portable apparatus comprising a housing that contains an image sensor and a lens for capturing digital images and a flash unit coupled with the housing for providing illumination during image capture, the portable apparatus having a portrait mode for generating in-camera an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, the portrait mode further being operable to determine foreground and background regions of the scene using the first and second images, and to substitute the blurred background of the third image for the background of an in focus image of the scene, thereby generating in-camera a digital image of an in-focus foreground object against a blurred background, wherein the in-focus image comprises one of the first and second images, wherein the first and second images have different pixel resolutions with the in-focus image having the higher resolution, and the apparatus is further configured to determine the foreground and background regions including matching pixel resolutions of the first and second images by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution.

2. A portable apparatus as claimed in claim 1, further being configured to determine the foreground and background regions for aligning two or more of the first, second and third images.

3. A portable apparatus according to claim 1, wherein the image of lower resolution comprises a pre- or post-view image.

4. A portable apparatus as claimed in claim 1, wherein the third image has a lower pixel resolution than the in-focus image.

5. A portable apparatus according to claim 4, wherein the third image comprises a pre- or post-view image.

6. A portable apparatus according to claim 1, wherein said digital image acquisition system comprises a digital camera.

7. A portable apparatus according to claim 1, wherein said digital image acquisition system is a combination of a digital camera and an external processing device.

8. A portable apparatus as claimed in claim 7, wherein portrait mode processing to determine foreground and background regions of the scene using the first and second images and to substitute the blurred background of the third image for the background of a in-focus image of the scene is performed in the external processing device.

9. A portable apparatus according to claim 1 wherein during determination of said foreground and background regions, exposure of the foreground region of the first or second image taken without flash is adjusted to be nominally the same as exposure of foreground region of the other of the first or second image taken with flash.

10. A portable apparatus as claimed in claim 1, in which said portrait mode is manually selectable by said user.

11. A portable apparatus as claimed in claim 1 operable to analyze one or more of said first, second and third images to determine the presence of a face, and responsive to detecting a face for selecting said portrait mode.

12. A portable digital image acquisition apparatus having no photographic film (hereinafter “

portable apparatus”

), the portable apparatus comprising a housing that contains an image sensor and a lens for capturing digital images and a flash unit coupled with the housing for providing illumination during image capture, the portable apparatus having a portrait mode for generating in-camera an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, the portrait mode further being operable to determine foreground and background regions of the scene using the first and second images, and to substitute the blurred background of the third image for the background of an in focus image of the scene, thereby generating in-camera a digital image of an in-focus foreground object against a blurred background, wherein the in-focus image comprises a fourth image captured in the portrait mode, wherein the first and second images have a lower pixel resolution than the fourth image, wherein the first and second images are pre- and/or post-view images, and the apparatus is further configured to provide the image of the in-focus foreground object against the blurred background including matching pixel resolutions of one or more images at the lower resolution of the first and/or second images with the third and/or fourth image by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution.

13. An in-camera method of generating a digital image of a foreground object against a blurred background within a portable digital image acquisition apparatus having no photographic film (hereinafter “

portable apparatus”

), the portable apparatus comprising a housing that contains an image sensor and a lens for capturing digital images and a flash unit coupled with the housing for providing illumination during image capture, the method comprising;

capturing with said portable apparatus first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images,

determining foreground and background regions of the scene using the first and second images, and

substituting the blurred background of the third image for the background of an in focus image of the scene, thereby generating in-camera a digital image of an in-focus foreground object against a blurred background,

wherein the in-focus image comprises one of the first and second images, wherein the first and second images have different pixel resolutions with the in-focus image having the higher resolution, and

wherein the apparatus is further configured to determine the foreground and background regions including matching pixel resolutions of the first and second images by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution.

14. An in-camera method of generating a digital image of a foreground object against a blurred background within a portable digital image acquisition apparatus having no photographic film (hereinafter “

portable apparatus”

), the portable adulates comprising a housing that contains an image sensor and a lens for capturing digital images and a flash unit coupled with the housing for providing illumination during image capture, the method comprising;

capturing with said portable apparatus first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images,

determining foreground and background regions of the scene using the first and second images, and

substituting the blurred background of the third image for the background of an in focus image of the scene, thereby generating in-camera a digital image of an in-focus foreground object against a blurred background, and

wherein the in-focus image comprises a fourth image, and

wherein the first and second images have a lower pixel resolution than the fourth image, and

wherein the first and second images have a lower pixel resolution than the fourth image,

wherein the first and second images are pre- and/or post-view images, and

wherein the method further comprises matching pixel resolutions of one or more images at the lower resolution of the first and/or second images with the third and/or fourth image by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution.

15. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform on in-camera method of generating a digital image of a foreground object against a blurred background within a portable digital image acquisition apparatus having no photographic film (hereinafter “

portable apparatus”

), the portable apparatus comprising a housing that contains an image sensor and a lens for capturing digital images and a flash unit coupled with the housing for providing illumination during image capture, the method comprising;

capturing with said portable apparatus first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images,

determining foreground and background regions of the scene using the first and second images, and

substituting the blurred background of the third image for the background of an in focus image of the scene, thereby generating in-camera a digital image of an in-focus foreground object against a blurred background,

wherein the in-focus image comprises one of the first and second images, wherein the first and second images have different pixel resolutions with the in-focus image having the higher resolution, and

wherein the apparatus is further configured to determine the foreground and background regions including matching pixel resolutions of the first and second images by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution.

16. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform an in-camera method of generating a digital image of a foreground object against a blurred background within a portable digital image acquisition apparatus having no photographic film (hereinafter “

portable apparatus”

), the portable apparatus comprising a housing that contains an image sensor and a lens for capturing digital images and a flash unit coupled with the housing for providing illumination during image capture, the method comprising;

capturing with said portable apparatus first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images,

determining foreground and background regions of the scene using the first and second images, and

substituting the blurred background of the third image for the background of an in focus image of the scene, thereby generating in-camera a digital image of an in-focus foreground object against a blurred background, and

wherein the in-focus image comprises a fourth image,

wherein the first and second images have a lower pixel resolution than the fourth image, wherein the first and second images are pre- and/or post-view images, and

wherein the method further comprises matching pixel resolutions of one or more images at the lower resolution of the first and/or second images with the third and/or fourth image by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution.