SYSTEM AND METHOD FOR RENDERING AND SELECTING A DISCRETE PORTION OF A DIGITAL IMAGE FOR MANIPULATION

• US 20090110245A1
• Filed: 10/30/2007
• Published: 04/30/2009
• Est. Priority Date: 10/30/2007
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: THORN, Karl Ola
• Application Number:
  US11/928,128
• Publication Number:
  US 20090110245A1
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G03B 13/00 Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 1/00352 Input means H04N1/00411 takes precedence; input arrangements for computers G06F3/00
• CPC Class Codes: H04N 1/00381 Input by recognition or interpretation of visible user gestures manual input means, e.g. digitisers, writing tablets H04N1/00392; gesture input to computers G06F3/017; recognition algorithms G06V40/20
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability

Abstract

A system enables a user viewing a digital image rendered on a display screen to select a discrete portion of the digital image for manipulation. The system comprises the display screen and a user monitor digital camera having a field of view directed towards the user. An image control system drives rendering of the digital image on the display screen. An image analysis module determines a plurality of discrete portions of the digital image which may be subject to manipulation. A indicator module receives a sequence of images from a user monitor digital camera and repositions an indicator between the plurality of discrete portions of the digital image in accordance with motion detected from the sequence of images. Exemplary manipulations may comprise red eye removal and/or application of text tags to the digital image.

Claims

1. A system for enabling a user viewing a digital image rendered on a display screen to select a discrete portion of a digital image for manipulation, the system comprising:

the display screen;

an image control system driving rendering of the digital image on the display screen;

an image analysis module determining a plurality of discrete portions of the digital image which may be subject to manipulation;

a user monitor digital camera having a field of view directed towards the user; and

a indicator module receiving a sequence of images from the user monitor digital camera and driving repositioning an indicator between the plurality of discrete portions of the digital image in accordance with motion detected from the sequence of images.

2. The system of claim 1, wherein:

the user monitor digital camera has a field of view directed towards the user'"'"'s face; and

the indicator module drives repositioning of the indicator between the plurality of discrete portions of the digital image in accordance with motion of at least a portion of the user'"'"'s face as detected from the sequence of images.

3. The system of claim 1, wherein repositioning an indicator between the plurality of discrete portions comprises:

determining a direction vector corresponding to a direction of the detected motion; and

snapping the indicator from a first of the discrete portions to a second of the discrete portions wherein the second of the discrete portions is positioned, with respect to the first of the discrete portions, in the same direction as the direction vector.

4. The system of claim 3, wherein:

each of the discrete portions of the digital image comprises an image depicted within the digital image meeting selection criteria; and

determining the plurality of discrete portions of the digital image comprises initiating an image analysis function to identify, within the digital image, each image meeting the selection criteria.

5. The system of claim 4, wherein:

the selection criteria is facial recognition criteria such that each of the discrete portions the digital image includes a facial image of a person.

6. The system of claim 5, wherein the image control system further:

obtains user input of a manipulation to apply to a selected portion of the digital image, the selected portion of the digital image being the one of the plurality of discrete portions identified by the indicator at the time of obtaining user input of the manipulation; and

applying the manipulation to the digital image.

7. The system of claim 6, wherein the manipulation is correction red-eye on the facial image of the person within the selected portion.

8. The system of claim 6, wherein the manipulation comprises application of a text tag to the image of the person within the selected portion of the digital image.

9. The system of claim 6, wherein:

the digital image is a portion of a motion video clip; and

the manipulation applied to the image meeting selection criteria is remains associated with the same image in subsequent portions of the motion video, whereby such image meeting the selection criteria may be searched within the motion video clip.

10. The system of claim 1, wherein the image control system further:

obtains user input of a text tag to apply to a selected portion of the digital image, the selected portion of the digital image being the one of the plurality of discrete portions identified by the indicator at the time of obtaining user input of the manipulation; and

associates the text tag with the selection portion of the digital image.

11. The system of claim 10:

wherein the system further comprises;

an audio circuit for generating an audio signal representing words spoken by the user; and

a speech to text module receiving at least a portion of the audio signal and generating a text representation of words spoken by the user; and

the text tag comprises such text representation.

12. The system of claim 11:

wherein the system is embodied in a battery powered device which operates in both a battery powered state and a line powered state;

if the system is in the battery powered state when receiving at least a portion of the audio signal representing words spoken by the user, then such portion of the audio signal is saved in the database; and

when the system is in the line powered state;

the speech to text module obtains the portion of the audio signal from the database and generates a text representation of the words spoken by the user; and

the image control system 18 applies the text representation as the text tag.

13. A method of operating a system for enabling a user viewing a digital image rendered on a display screen to select a discrete portion of a digital image for manipulation, the method comprising:

rendering the digital image on the display screen;

analyzing the digital image to determine a plurality of discrete portions of the digital image which may be subject to manipulation;

receiving a sequence of images from a user monitor digital camera and repositioning an indicator between the plurality of discrete portions of the digital image in accordance with motion detected from the sequence of images.

14. The method of claim 13, wherein:

the sequence of images from the user monitor digital camera comprises a sequence of images of the user'"'"'s face; and

repositioning the indicator between the plurality of discrete portions of the digital image is in accordance with motion of at least a portion of the user'"'"'s face as detected from the sequence of images.

15. The method of claim 13, wherein repositioning an indicator between the plurality of discrete portions comprises:

determining a direction vector corresponding to a direction of the detected motion; and

snapping the indicator from a first of the discrete portions to a second of the discrete portions wherein the second of the discrete portions is positioned, with respect to the first of the discrete portions, in the same direction as the direction vector.

16. The method of claim 15, wherein:

each of the discrete portions of the digital image comprises an image depicted within the digital image meeting selection criteria; and

determining the plurality of discrete portions of the digital image comprises initiating an image analysis function to identify, within the digital image, each image meeting the selection criteria.

17. The method of claim 16, wherein:

the selection criteria is facial recognition criteria such that each of the discrete portions the digital image is a facial image of a person.

18. The method of claim 13, further comprising:

obtaining user input of a text tag to apply to a selected portion of the digital image, the selected portion of the digital image being the one of the plurality of discrete portions identified by the indicator at the time of obtaining user input of the manipulation; and

associating the text tag with the selection portion of the digital image.

19. The method of claim 18:

further comprising generating an audio signal representing words spoken by the user as detected by a microphone; and

,

wherein associating the text tag with the selected portion of the digital image comprises performing speech recognition on the audio signal to generate a text representation of the words spoken by the user; and

the text tag comprises the text representation of the words spoken by the user.

20. The method of claim 19, wherein the method is implemented in a battery powered device which operates in both a battery powered state and a line powered state, the method comprising:

if the system is in the battery powered state when receiving at least a portion of the audio signal representing words spoken by the user, then saving such portion of the audio signal; and

when the system is in the line powered state;

generating a text representation of the saved audio signal; and

associating the text representation with the selected portion of the digital image, as the text tag.