Eye movement traces authentication system, method, and non-transitory computer readable medium, the same which integrate with face recognition and hand recognition

• US 10,698,990 B2
• Filed: 12/28/2016
• Issued: 06/30/2020
• Est. Priority Date: 01/04/2016
• Status: Active Grant

• Current Assignee: Utechzone Co., Ltd.
• Original Assignee: Utechzone Co., Ltd.
• Inventors: Tsou, Chia-Chun
• Primary Examiner(s): King, John B
• Application Number:
  US15/392,444
• Publication Number:
  US 20170193213A1
• Time in Patent Office: 1,280 Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/11 Hand-related biometrics; Hand pose recognition
• CPC Class Codes: G06V 40/117 Biometrics derived from hands
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

An eye movement traces authentication system comprises an image capturing device, a display device, and a control unit. The image capturing device is for capturing a user'"'"'s image. The display device is for providing a display interface for the user to watch. The control unit includes a facial feature recognition module or hand feature recognition module, an eye-movement analyzing module, an eye movement traces unlocking module, and a volitional confirmation module. The eye movement traces authentication system uses the user'"'"'s facial features to confirm the user'"'"'s identity and determines the user'"'"'s watching direction and eye movement, by recording user'"'"'s eye movement traces from the user'"'"'s watching direction to verify the user'"'"'s identity and by analyzing the user'"'"'s eye movement to confirm, according to the user'"'"'s eye movement, whether the user is operating volitionally.

Claims

1. An eye movement traces authentication system, comprising:

an image capturing device for capturing a user'"'"'s image;

a display device for providing a display interface for the user to watch; and

a controller that obtains the user'"'"'s image from the image capturing device, and obtains the user'"'"'s watching direction whereby tracking an eye image of the user'"'"'s image,

wherein the controller provides a graphical interface to the display device for user to input an eye movement traces information whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information, and compares the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user, generates a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication,

wherein the controller also provides a graphical interface or a hidden interface to the display device for the user to obtain the user'"'"'s eye movement or watching direction, and presets a triggering condition of the user'"'"'s eye movement or watching direction to trigger a distress signal to a third party device to ensure whether the user is operating volitionally.

2. The eye movement traces authentication system of claim 1, wherein the controller provides an eye movement traces input interface to the display device for the user, so that the user inputs the eye movement traces information according to the user'"'"'s watching direction.

3. The eye movement traces authentication system of claim 2, wherein the eye movement traces input interface provides an auxiliary graphic for the user to watch, so that the user inputs the eye movement traces information according to the auxiliary graphic.

4. An eye movement traces authentication system which integrates with face recognition, comprising:

an image capturing device for capturing a user'"'"'s image;

a display device for providing a display interface for the user to watch; and

a controller that obtains the user'"'"'s image from the image capturing device, and captures facial features from the user'"'"'s image to compare with facial data of a database so as to verify the user'"'"'s identity,

wherein the controller also obtains the user'"'"'s watching direction according to an eye image of the user'"'"'s image, and provides a graphical interface to the display device for user to input an eye movement traces information whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information, and compares the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user, generates a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication.

5. The eye movement traces authentication system of claim 4, wherein the facial features include one of face feature images, iris images, and images of blood vessel distribution of a sclera region.

8. The eye movement traces authentication system of claim 4, wherein the controller also provides a graphical interface or a hidden interface to the display device for the user to obtain the user'"'"'s eye movement or watching direction, and preset a triggering condition of the user'"'"'s eye movement or watching direction to trigger a distress signal to a third party device to ensure whether the user is operating volitionally.

9. The eye movement traces authentication system of claim 4, wherein the controller provides an eye movement traces input interface to the display device for the user, so as to input the eye movement traces information according to the user'"'"'s watching direction.

10. The eye movement traces authentication system of claim 9, wherein the eye movement traces input interface provides an auxiliary graphic for the user to watch, so that the user inputs the eye movement traces information according to the auxiliary graphic.

6. An eye movement traces authentication system which integrates with hand recognition, comprising:

an image capturing device for capturing a user'"'"'s image;

a hand feature capturing device for capturing the user'"'"'s hand feature information;

a display device for providing a display interface for the user to watch; and

a controller that obtains the user'"'"'s hand feature information from the hand feature capturing device, and compares the hand feature information with data of a database, so as to verify the user'"'"'s identity,

wherein the controller also obtains the user'"'"'s watching direction according to an eye image of the user'"'"'s image, and provides a graphical interface to the display device for user to input an eye movement traces information whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information, and compares the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user, generates a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication.

7. The eye movement traces authentication system of claim 6, wherein the hand feature information includes one of fingerprint feature information and palm feature information.

11. An eye movement traces authentication method, comprising the steps of:

capturing a user'"'"'s image via an image capturing device;

obtaining the user'"'"'s image from an image capturing device via a controller, and obtaining the user'"'"'s watching direction by tracking an eye image of the user'"'"'s image;

wherein the controller provides a graphical interface to a display device for user to input an eye movement traces information whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information and compares the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user,

generating a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication; and

during the above steps, providing, via the controller, a graphical interface or a hidden interface for the user, obtaining the user'"'"'s eye movement or watching direction, and presetting a triggering condition of the user'"'"'s eye movement or watching direction to trigger a distress signal to a third party device to ensure whether the user is operating volitionally.

17. The eye movement traces authentication method of claim 11, further comprising:

providing, via the controller, an eye movement traces input interface for the user, so as to input the eye movement traces information according to the user'"'"'s watching direction.

18. The eye movement traces authentication method of claim 17, further comprising:

providing, via the controller, an auxiliary graphic for the user to watch, so that the user inputs the eye movement traces information according to the auxiliary graphic.

12. An eye movement traces authentication method which integrates with face recognition, comprising the steps of:

capturing a user'"'"'s image via an image capturing device;

obtaining, via a controller, the user'"'"'s image from the image capturing device, and capturing facial features from the user'"'"'s image to compare with facial data of a database so as to verify the user'"'"'s identity;

providing, via the controller, a graphical interface to a display device for user to input an eye movement traces information and whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information; and

comparing the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user, and generating a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication.

13. The eye movement traces authentication method of claim 12, wherein the facial features include one of face feature images, iris images, and images of blood vessel distribution of a sclera region.

16. The eye movement traces authentication method of claim 12, further comprising:

providing, via the controller, a graphical interface or a hidden interface for the user, obtaining the user'"'"'s eye movement or watching direction, and presetting a triggering condition of the user'"'"'s eye movement or watching direction to trigger a distress signal to a third party device to ensure whether the user is operating volitionally.

14. An eye movement traces authentication method which integrates with hand recognition, comprising the steps of:

capturing, via an image capturing device and a hand feature capturing device, a user'"'"'s images;

capturing, via a controller, hand feature information from the user'"'"'s image and comparing the hand feature information with hand data of a database, so as to confirm the user'"'"'s identity;

providing, via the controller, a graphical interface to a display device for user to input an eye movement traces information whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information; and

comparing the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user, and generating a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication.

15. The eye movement traces authentication method of claim 14, wherein the hand feature information includes one of fingerprint feature information and palm feature information.

19. A non-transitory computer readable medium, including computer executable instructions, wherein the instructions, when executed by a controller, cause the controller to perform the following method steps:

obtaining, via a controller, the user'"'"'s image from an image capturing device, and obtaining the user'"'"'s watching direction thereby tracking an eye image of the user'"'"'s image;

providing, via the controller, a graphical interface to a display device for user to input an eye movement traces information whereby the controller marks and connects the projection of eye movement based on the user'"'"'s watching direction to produce a display of a trace graphic in the graphical interface as the eye movement traces information, and compares the similarity between the trace graphic and a pre-stored graphic of traces data pre-stored in a database by the user, generates a control signal to an identity verification apparatus when the trace graphic matches the pre-stored graphic of the traces data, the control signal indicating successful authentication; and

during the above steps, providing, via the controller, a graphical interface or a hidden interface for the user, obtaining the user'"'"'s eye movement or watching direction, and presetting a triggering condition of the user'"'"'s eye movement or watching direction to trigger a distress signal to a third party device to ensure whether the user is operating volitionally.