Modification of post-viewing parameters for digital images using image region or feature information

• US 20160065861A1
• Filed: 09/04/2015
• Published: 03/03/2016
• Est. Priority Date: 06/26/2003
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Bigioi, Petronel, Prilutsky, Yury, Corcoran, Peter
• Granted Patent: US 9,692,964 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84

Abstract

A method of generating one or more new digital images using an original digitally-acquired image including a selected image feature includes identifying within a digital image acquisition device one or more groups of pixels that correspond to the selected image feature based on information from one or more preview images. A portion of the original includes automatically generating values of pixels of one or more new images based on the selected portion in a manner which includes the selected image feature within the one or more new images.

Claims

1. A method of generating one or more new digital images using an original digitally-acquired image including a selected image feature, comprising:

(a) identifying within a digital image acquisition device one or more groups of pixels that correspond to a selected image feature within an original digitally-acquired image based on information from one or more preview images;

(b) selecting a portion of the original image that includes the one or more groups of pixels; and

(c) automatically generating values of pixels of one or more new images based on the selected portion in a manner which includes the selected image feature within the one or more new images.

2. The method of claim 1, wherein said transformation is different between the selected portion and remaining portions of the image.

3. The method of claim 1, wherein said selected image feature comprises one or more faces.

4. The method of claim 1, wherein said selected image feature comprises a human subject.

5. The method of claim 1, wherein the selected image feature comprises a foreground region or a background region.

6. The method of claim 5, wherein the foreground region is determined by detection of a face.

7. The method of claim 5, wherein the foreground region is determined by defining said selected image feature within an original image to be local sharpness, relative exposure, local color clustering, or local saturation, or combinations thereof.

8. The method of claim 5, wherein the determining of the foreground region by defining said selected image feature within an original image comprises determining a depth of focus.

9. The method of claim 5, further comprising visually separating the foreground region and the background region within the one or more new images.

10. The method of claim 9, further comprising calculating a depth map of the background region.

11. The method of claim 5, further comprising independently processing the foreground region or the background region, or both.

12. A method as recited in claim 1, wherein said identifying one or more groups of pixels within a digital acquisition device is performed using nonimage data.

13. A method as recited in claim 12, wherein said non-image data comprises one or more acquisition parameters.

14. A method as recited in claim 1, wherein said generating values of pixels of one or more new images is performed within a digital acquisition device.

15. A method as recited in claim 1, wherein said generating values of pixels of one or more new images is performed by an external device to said digital acquisition device.

16. A method of generating one or more new digital images using an original digitally-acquired image including a background region or a foreground region, or both, comprising:

(a) identifying within a digital image acquisition device one or more groups of pixels that correspond to a background region or a foreground region, or both, within an original digitally-acquired image based on information from one or more preview images;

(b) selecting a portion of the original image that includes the one or more groups of pixels; and

(c) automatically generating values of pixels of one or more new images based on the selected portion in a manner winch includes the background region or the foreground region, or both, within each of the one or more new images.

17. The method of claim 16, further comprising separating the foreground region and the background region within the original image or the one or more new images or combinations thereof.

18. The method of claim 17, further comprising calculating a depth map of the background region or the foreground region or both.

19. The method of claim 16, further comprising independently processing the foreground region or the background region, or both.

20. The method of claim 19, wherein at least one of said new images comprises an independently processed background region or foreground region or both.

21. The method of claim 16, further comprising determining a relevance or importance, or both, of the foreground region or the background region, or both.

22. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of generating one or more new digital images using an original digitally-acquired image including a selected image feature, the method comprising:

(a) identifying one or more groups of pixels that correspond to a selected image feature within an original digitally-acquired image based on information from one or more preview images;

(b) selecting a portion of the original image that includes the one or more groups of pixels; and

(c) automatically generating values of pixels of one or more new images based on the selected portion in a manner which includes the selected image feature within the one or more new images.

23. One or more storage devices of claim 22, wherein said transformation is different between the selected portion and remaining portions of the image.

24. One or more storage devices of claim 22, wherein said selected image feature comprises one or more faces.

25. One or more storage devices of claim 22, wherein said selected image feature comprises a human subject.

26. One or more storage devices of claim 22, wherein the selected image feature comprises a foreground region or a background region.

27. One or more storage devices of claim 26, wherein the foreground region is determined by detection of a face.

28. One or more storage devices of claim 27, wherein the determining of the foreground region by defining said selected image feature within an original image comprises determining a depth of focus.

29. One or more storage devices of claim 26, the method further comprising visually separating the foreground region and the background region within the one or more new images.

30. One or more storage devices of claim 29, the method further comprising calculating a depth map of the background region.

31. One or more storage devices of claim 26, the method further comprising independently processing the foreground region or the background region, or both.

32. One or more storage devices of claim 31, wherein at least one of said new images comprises an independently processed background region or foreground region or both.

33. One or more storage devices of claim 32, the method further comprising determining a relevance or importance, or both, of the foreground region or the background region, or both.

34. One or more storage devices of claim 22, wherein the identifying comprises identifying one or more groups of pixels that correspond to two or more selected image features within the original digitally-acquired image;

and wherein the automatic generating is in a manner which includes at least one of the two or more selected image features within the one or more new images or a panning intermediate image between two of the selected image features, or a combination thereof.

35. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of generating one or more new digital images using an original digitally-acquired image including a background region or a foreground region, or both, the method comprising:

(a) identifying one or more groups of pixels that correspond to a background region or a foreground region, or both, within an original digitally-acquired image based on information from one or more preview images;

(b) selecting a portion of the original image that includes the one or more groups of pixels; and

(c) automatically generating values of pixels of one or more new images based on the selected portion in a manner which includes the background region or the foreground region, or both, within each of the one or more new images.

36. One or more storage devices of claim 35, the method further comprising separating the foreground region and the background region within the original image or the one or more new images or combinations thereof.

37. One or more storage devices of claim 36, the method further comprising calculating a depth map of the background region or the foreground region or both.

38. One or more storage devices of claim 35, the method further comprising independently processing the foreground region or the background region, or both.

39. One or more storage devices of claim 38, wherein at least one of said new images comprises an independently processed background region or foreground region or both.

40. One or more storage devices of claim 35, the method further comprising determining a relevance importance, or both, of the foreground region or the background region, or both.