USER INTERFACE DEVICE AND INPUT METHOD

• US 20110298702A1
• Filed: 12/02/2010
• Published: 12/08/2011
• Est. Priority Date: 12/14/2009
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Sakata, Kotaro, Maeda, Shigenori
• Granted Patent: US 8,830,164 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

Provided is a user interface device (10) that estimates a user'"'"'s degree of interest, for performing an input process on the basis of the user'"'"'s degree of interest in a plurality of objects displayed on a screen (26). The device includes a gaze direction detection unit (11) that detects a gaze direction of the user; a gaze duration calculation unit (12) that calculates gaze duration during which the gaze direction has remained on each of the plurality of objects; an eye-attracting force calculation unit (13) that calculates eye-attracting force of each of the plurality of objects; and a degree of interest estimation unit (14) that estimates the user'"'"'s degree of interest in each of the plurality of objects, such that the longer the gaze duration is the higher the degree of interest becomes, and that the smaller the eye-attracting force is the higher the degree of interest becomes.

Claims

1. A user interface device configured to estimate a user'"'"'s degree of interest in a plurality of objects displayed on a screen, for performing an input process on the basis of the user'"'"'s degree of interest, said user interface device comprising:

a gaze direction detection unit configured to detect a gaze direction of the user;

a gaze duration calculation unit configured to calculate a gaze duration during which the gaze direction has remained on each of the plurality of objects;

an eye-attracting force calculation unit configured to calculate an eye-attracting force of each of the plurality of objects; and

a degree of interest estimation unit configured to estimate the user'"'"'s degree of interest in each of the plurality of objects such that the longer the gaze duration is the higher the degree of interest becomes, and that the smaller the eye-attracting force is the higher the degree of interest becomes.

2. The user interface device according to claim 1,

wherein said eye-attracting force calculation unit is configured to calculate the eye-attracting force of each of the objects on the basis of a physical feature of an image of the object.

3. The user interface device according to claim 2,

wherein said eye-attracting force calculation unit is configured to calculate the eye-attracting force of each of the objects on the basis of a degree of complexity of the image of the object, such that the higher the degree of complexity is the greater the eye-attracting force becomes.

4. The user interface device according to claim 2,

wherein said eye-attracting force calculation unit is configured to calculate the eye-attracting force of each of the objects on the basis of a degree of heterogeneity of the image of the object from images located around the object, such that the higher the degree of heterogeneity is the greater the eye-attracting force becomes.

5. The user interface device according to claim 1,

wherein said eye-attracting force calculation unit is configured to calculate the eye-attracting force of each of the objects such that the shorter the psychological distance between the object and the user is the greater the eye-attracting force becomes.

6. The user interface device according to claim 5,

wherein said eye-attracting force calculation unit is configured to calculate, for each of the objects, the psychological distance such that the greater the number of times that the user has so far viewed the object is the shorter the psychological distance becomes.

7. The user interface device according to claim 5,

wherein said eye-attracting force calculation unit is configured to calculate, for each of the objects, the psychological distance on the basis of whether the user is a producer of the object, such that the psychological distance becomes shorter in the case where the user is a producer of the object, than in the negative case.

8. The user interface device according to claim 5,

wherein said eye-attracting force calculation unit is configured to calculate, for each of the objects, the psychological distance on the basis of whether the user is a subject displayed in the object, such that the psychological distance becomes shorter in the case where the user is a subject displayed in the object, than in the negative case.

9. The user interface device according to claim 1,

wherein said eye-attracting force calculation unit is configured to calculate, for each of the objects, the psychological distance on the basis of a physical positional relationship between the user and the object.

10. The user interface device according to claim 9,

wherein said eye-attracting force calculation unit is configured to calculate the eye-attracting force of each of the objects on the basis of a distance between the user and the object, such that the shorter the physical distance is the greater the eye-attracting force becomes.

11. The user interface device according to claim 9,

wherein said eye-attracting force calculation unit is configured to calculate the eye-attracting force of each of the objects on the basis of an angle defined by a line connecting the user and the object and a normal of the screen, such that the smaller the angle is the greater the eye-attracting force becomes.

12. The user interface device according to claim 1,

wherein said degree of interest estimation unit is configured to compensate the gaze duration such that the greater the eye-attracting force is the shorter the gaze duration becomes, thus to calculate a compensated gaze duration, and to estimate the degree of interest such that the longer the compensated gaze duration is the higher the degree of interest becomes.

13. The user interface device according to claim 12,

wherein said degree of interest estimation unit is configured to calculate the compensated gaze duration by subtracting a time attributable to the eye-attracting force from the gaze duration.

14. The user interface device according to claim 12,

wherein said degree of interest estimation unit is configured to calculate the compensated gaze duration by dividing the gaze duration by a value attributable to the eye-attracting force.

15. The user interface device according to claim 1, further comprising:

a display control unit configured to control a display on the screen in accordance with the degree of interest estimated.

16. The user interface device according to claim 15,

wherein said display control unit is configured to cause the screen to display information on an object that has gained a highest estimated degree of interest among the plurality of objects.

17. The user interface device according to claim 15,

wherein said display control unit is configured to change a display mode of an object that has gained a highest estimated degree of interest among the plurality of objects, or the objects except for the object that has gained the highest estimated degree of interest among the plurality of objects.

18. The user interface device according to claim 1, constituted in a form of an integrated circuit.

19. An input method to be performed by a computer for estimating a degree of interest of a user in a plurality of objects displayed on a screen, on the basis of the user'"'"'s degree of interest, comprising:

detecting a gaze direction of the user;

calculating a time during which the gaze direction detected has remained on each of the plurality of objects, as gaze duration;

calculating an eye-attracting force for each of the objects; and

estimating the user'"'"'s degree of interest in each of the plurality of objects, such that the longer the gaze duration is the higher the degree of interest becomes, and that the smaller the eye-attracting force is the higher the degree of interest becomes.

20. A program recorded on a non-transitory computer-readable recording medium and causing a computer to execute said input method according to claim 19.