Modification of post-viewing parameters for digital images using image region or feature information

• US 9,129,381 B2
• Filed: 06/17/2008
• Issued: 09/08/2015
• Est. Priority Date: 06/26/2003
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Corcoran, Peter, Bigioi, Petronel
• Primary Examiner(s): DRENNAN, BARRY T
• Application Number:
  US12/140,950
• Publication Number:
  US 20090003708A1
• Time in Patent Office: 2,639 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability

Abstract

A method of generating one or more new digital images using an original digitally-acquired image including a selected image feature includes identifying within a digital image acquisition device one or more groups of pixels that correspond to the selected image feature based on information from one or more preview images. A portion of the original image is selected that includes the one or more groups of pixels. The technique includes automatically generating values of pixels of one or more new images based on the selected portion in a manner which includes the selected image feature within the one or more new images.

Claims

1. A method of automatically generating one or more new images using an original image, comprising:

acquiring one or more reference images that are temporally or spatially related to the original image;

determining sums of high-order DCT coefficients of one or more regions of the one or more reference images;

determining sums of high-order DCT coefficients of one or more regions in the original image;

performing comparisons of the sums of high-order DCT coefficients of one or more regions in the original image with the sums of high-order DCT coefficients of one or more regions of the one or more reference images;

based, at least in part, on the performed comparisons, automatically detecting and selecting, within a digital image acquisition device, one or more groups of pixels that correspond to a background region or a foreground region, or both within the original image; and

automatically generating values of pixels of one or more new images based on the selected one or more groups of pixels from the original image to cause the background region or foreground region, or both to be present in the one or more new images.

2. The method of claim 1, further comprising calculating a depth map of the background region or the foreground region or both.

3. The method of claim 1, wherein at least one of said new images comprises an independently processed background region or foreground region wherein each region is processed separately from another region.

4. The method of claim 1, further comprising determining a relevance or importance, or both, of the foreground region or the background region, or both.

5. The method of claim 1, wherein automatically detecting and selecting one or more groups of pixels comprises:

determining a difference between sums of high-order DCT coefficients of a first region in the original image and sums of high-order DCT coefficients of a second region in the one or more reference images;

determining whether the first region in the original image is foreground or background, or both.

6. The method of claim 5, wherein determining whether the first region in the original image is foreground or background, or both comprises:

if the difference between sums of high-order DCT coefficients increases, then determining that the first region is one of foreground or background;

if the difference between sums of high-order DCT coefficients decreases, the determining that the first region is the other of foreground or background.

7. One or more non-transitory processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of automatically generating one or more new images using an original digitally-acquired image including a background region or a foreground region, or both, the method comprising:

acquiring one or more reference images that are temporally or spatially related to the original image;

determining sums of high-order DCT coefficients of one or more regions of the one or more reference images;

determining sums of high-order DCT coefficients of one or more regions in the original image;

performing comparisons of the sums of high-order DCT coefficients of one or more regions in the original image with the sums of high-order DCT coefficients of one or more regions of the one or more reference images;

based, at least in part, on the performed comparisons, automatically detecting and selecting, within a digital image acquisition device, one or more groups of pixels that correspond to a background region or a foreground region, or both within the original image; and

automatically generating values of pixels of one or more new images based on the selected one or more groups of pixels from the original image to cause the background region or foreground region, or both to be present in the one or more new images.

8. One or more storage devices of claim 7, the method further comprising calculating a depth map of the background region or the foreground region or both.

9. One or more storage devices of claim 7, wherein at least one of said new images comprises an independently processed background region or foreground region wherein each region is processed separately from another region.

10. One or more storage devices of claim 7, the method further comprising determining a relevance or importance, or both, of the foreground region or the background region, or both.

11. One or more storage devices of claim 7, wherein automatically detecting and selecting one or more groups of pixels comprises:

determining a difference between sums of high-order DCT coefficients of a first region in the original image and sums of high-order DCT coefficients of a second region in the one or more reference images;

determining whether the first region in the original image is foreground or background, or both.

12. One or more storage devices of claim 11, wherein determining whether the first region in the original image is foreground or background, or both comprises:

if the difference between sums of high-order DCT coefficients increases, then determining that the first region is one of foreground or background;

if the difference between sums of high-order DCT coefficients decreases, the determining that the first region is the other of foreground or background.