TAGGING USING EYE GAZE DETECTION

• US 20140354533A1
• Filed: 06/03/2013
• Published: 12/04/2014
• Est. Priority Date: 06/03/2013
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Swaminathan, Shivkumar
• Application Number:
  US13/908,889
• Publication Number:
  US 20140354533A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Various embodiments relating to tagging human subjects in images are provided. In one embodiment, an image including a human subject is presented on a display screen. A dwell location of a tagging user'"'"'s gaze on the display screen is received. The human subject in the image is recognized as being located at the dwell location. An identification of the human subject is received, and the image is tagged with the identification.

Claims

1. A method for tagging a human subject in an image presented on a display screen, the method comprising:

receiving a dwell location of a tagging user'"'"'s gaze on the display screen;

recognizing that the human subject in the image is located at the dwell location;

receiving an identification of the human subject; and

tagging the image with the identification.

2. The method of claim 1, wherein receiving the identification of the human subject includes receiving a name of the human subject from a voice recognition system that listens for the name being spoken.

3. The method of claim 1, wherein receiving the identification of the human subject includes displaying a set of previously recognized names on the display screen, receiving a different dwell location of the tagging user'"'"'s gaze on the display screen, recognizing that a name from the set of previously recognized names is located at the different dwell location, and selecting the name as the identification.

4. The method of claim 1, wherein receiving the dwell location includes tracking the tagging user'"'"'s gaze on the display screen, and establishing the dwell location responsive to the tagging user'"'"'s gaze remaining at a location on the display screen corresponding to the dwell location for greater than a threshold duration.

5. The method of claim 1, further comprising:

providing visual feedback that the human subject is recognized as being at the dwell location.

6. The method of claim 5, wherein providing visual feedback includes at least one of displaying a box surrounding a head of the human subject, graying out the image surrounding the head of the human subject, and enlarging the head of the human subject relative to a remainder of the image.

7. The method of claim 1, further comprising:

displaying a different image that potentially includes the human subject on the display screen; and

if a confirmation that the human subject is in the different image is received, tagging the different image with the identification.

8. The method of claim 1, further comprising:

displaying a set of previously recognized names on the display screen in response to the human subject being recognized as being located at the dwell location; and

if a new name is received as the identification of the human subject that is not included in the set of previously recognized names, adding the new name to the set of previously recognized names.

9. The method of claim 1, wherein tagging the image with the identification includes associating the identification with a portion of the image that includes the human subject.

10. A method for tagging a human subject in an image presented on a display screen, the method comprising:

receiving a dwell location of a tagging user'"'"'s gaze on the display screen;

recognizing that the human subject in the image is located at the dwell location;

receiving a name of the human subject from a voice recognition system that listens for the name being spoken; and

tagging the image that includes the human subject with the name.

11. The method of claim 10, wherein receiving the dwell location includes tracking the tagging user'"'"'s gaze on the display screen, and establishing the dwell location responsive to the tagging user'"'"'s gaze remaining at a location on the display screen corresponding to the dwell location for greater than a threshold duration.

12. The method of claim 10, further comprising:

providing visual feedback that the human subject is recognized as being at the dwell location.

13. The method of claim 12, wherein providing visual feedback includes at least one of displaying a box surrounding a head of the human subject, graying out the image surrounding the head of the human subject, and enlarging the head of the human subject relative to a remainder of the image.

14. The method of claim 10, further comprising:

displaying a different image that potentially includes the human subject on the display screen; and

if a confirmation that the human subject is in the different image is received, tagging the human subject in the different image with the name.

15. The method of claim 10, further comprising:

displaying a set of previously recognized names on the display screen in response to the human subject being recognized as being located at the dwell location; and

if a new name is received as an identification of the human subject that is not included in the set of previously recognized names, adding the new name to the set of previously recognized names.

16. The method of claim 10, wherein tagging the image with the name includes associating the name with a portion of the image that includes the human subject.

17. A method for tagging a human subject in an image presented on a display screen, the method comprising:

tracking a tagging user'"'"'s gaze on the display screen;

establishing a dwell location responsive to the tagging user'"'"'s gaze remaining at a location on the display screen corresponding to the dwell location for greater than a threshold duration;

recognizing that the human subject in the image is located at the dwell location;

receiving a name of the human subject from a voice recognition system that listens for the name being spoken; and

tagging a portion of the image that includes the human subject with the name.

18. The method of claim 17, further comprising:

providing visual feedback that the human subject is recognized as being at the dwell location including at least one of displaying a box surrounding a head of the human subject, graying out the image surrounding the head of the human subject, and enlarging the head of the human subject relative to a remainder of the image.

19. The method of claim 17, further comprising:

displaying a different image that potentially includes the human subject on the display screen; and

if a confirmation that the human subject is in the different image is received, tagging the human subject in the different image with the name.

20. The method of claim 17, further comprising:

displaying a set of previously recognized names on the display screen in response to the human subject being recognized as being located at the dwell location; and

if a new name is received as an identification of the human subject that is not included in the set of previously recognized names, adding the new name to the set of previously recognized names.