Information processing device, information processing method, and program

• US 10,180,717 B2
• Filed: 11/19/2015
• Issued: 01/15/2019
• Est. Priority Date: 02/20/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsukamoto, Takeo, Konami, Shuichi, Ito, Tomoyuki, Abe, Takashi
• Primary Examiner(s): Blouin, Mark S
• Application Number:
  US15/529,128
• Publication Number:
  US 20170262055A1
• Time in Patent Office: 1,153 Days
• Field of Search: 340 583
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G07C 9/257 electronically G07C9/26 takes precedence
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

There is provided an information processing device, information processing method, and program capable of realizing the authentication with high security using the movement of line of sight, the information processing device including: a line-of-sight movement identification unit configured to identify movement of line of sight of a user to a body of the user on a basis of an image of an eye of the user and an image of the body of the user positioned in a line-of-sight direction of the user, captured by an imaging unit; and a user authentication unit configured to authenticate the user on a basis of the identified movement of line of sight.

Claims

1. An information processing device comprising:

a line-of-sight movement identification unit configured to identify movement of line of sight of a user to a body of the user based on an image of an eye of the user and an image of the body of the user positioned in a line-of-sight direction of the user, wherein each image is captured by an imager; and

a user authentication unit configured to authenticate the user based on the identified movement of line of sight,

wherein the line-of-sight movement identification unit identifies movement of the line of sight of the user according to a shape of the body of the user positioned in the line-of-sight direction of the user, and

wherein the line-of-sight movement identification unit and the user authentication unit are each implemented via at least one processor.

2. The information processing device according to claim 1, further comprising:

a line-of-sight pattern comparison unit configured to compare a line-of-sight pattern registered with a database in association with the user with a line-of-sight pattern based on the movement of line of sight of the user identified by the line-of-sight movement identification unit,

wherein the user authentication unit authenticates the user based on a comparison result of the line-of-sight pattern comparison unit, and

wherein the light-of-sight pattern comparison unit is implemented via at least one processor.

3. The information processing device according to claim 2,

wherein the user authentication unit determines that the user is a valid user in a case where a matching degree of the line-of-sight pattern determined by the line-of-sight pattern comparison unit is a predetermined threshold or more.

4. The information processing device according to claim 2, further comprising:

a physical characteristics detection unit configured to detect physical characteristics on a part of the body of the user based on the image of the body of the user,

wherein the line-of-sight movement identification unit identifies the movement of line of sight of the user to the part of the body of the user based on the image of the eye of the user and the detected physical characteristics, and

wherein the physical characteristics detection unit is implemented via at least one processor.

5. The information processing device according to claim 2,

wherein the line-of-sight pattern is a pattern of a line-of-sight operation to one or more regions of the body of the user.

6. The information processing device according to claim 5,

wherein the line-of-sight pattern registered with the database is a pattern of a line-of-sight operation to each of one or more regions of the body of the user associated with an order of movement of the line of sight.

7. The information processing device according to claim 5,

wherein the line-of-sight pattern registered with the database is a pattern of a line-of-sight operation to each of one or more regions of the body of the user associated with an order of change of a posture of the body of the user.

8. The information processing device according to claim 5,

wherein the line-of-sight operation includes gaze to a region of the body of the user or a trace of line of sight.

9. The information processing device according to claim 4,

wherein the physical characteristics include a position or a shape of a mole, a wrinkle, or a vascular pattern.

10. The information processing device according to claim 1, further comprising:

a display control unit configured to cause a display to sequentially display indication of the identified movement of line of sight each time the line-of-sight movement identification unit identifies the movement of line of sight,

wherein the display control unit is implemented via at least one processor.

11. The information processing device according to claim 10, further comprising:

the display.

12. The information processing device according to claim 1,

wherein the imager includes a first imager configured to capture the image of the eye of the user and a second imager configured to capture the image of the body of the user positioned in the line-of-sight direction of the user.

13. The information processing device according to claim 1,

wherein the information processing device comprises an eyeglass-type device.

16. The information processing device according to claim 1,

wherein the line-of-sight movement identification unit identifies movement of the line of sight of the user in an order according to each shape of a plurality of shapes of the body of the user positioned in the line-of-sight direction of the user.

14. An information processing method, executed by at least one processor, the method comprising:

identifying movement of line of sight of a user to a body of the user based on an image of an eye of the user and an image of the body of the user positioned in a line-of-sight direction of the user, wherein each image is captured by an imager; and

authenticating the user based on the identified movement of line of sight,

wherein the movement of the line of sight of the user is identified according to a shape of the body of the user positioned in the line-of-sight direction of the user.

15. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer, causes the computer execute a method, the method comprising:

identifying movement of line of sight of a user to a body of the user based on an image of an eye of the user and an image of the body of the user positioned in a line-of-sight direction of the user, wherein each image is captured by an imager; and

authenticating the user based on the identified movement of line of sight,

wherein the movement of the line of sight of the user is identified according to a shape of the body of the user positioned in the line-of-sight direction of the user.