HEAD-MOUNTED DISPLAY DEVICE, CONTROL METHOD FOR THE HEAD-MOUNTED DISPLAY DEVICE, AND AUTHENTICATION SYSTEM

• US 20140071041A1
• Filed: 08/26/2013
• Published: 03/13/2014
• Est. Priority Date: 09/10/2012
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: FUJIMAKI, Yutaka
• Granted Patent: US 9,317,126 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 21/316 by observing the pattern of computer usage, e.g. typical user behaviour
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A head-mounted display device that enables a user to simultaneously visually recognize a virtual image and an outside scene includes a photographing unit configured to photograph at least a part of a visual field direction of the user in a state in which the user wears the head-mounted display device and acquire a motion of the user; a track acquiring unit configured to acquire a track of the motion of the user from the motion photographed by the photographing unit; and an authentication processing unit configured to authenticate, using the track acquired by the track acquiring unit, whether the user is a proper user.

Claims

1. A head-mounted display device that enables a user to simultaneously visually recognize a virtual image and an outside scene, the head-mounted display device comprising:

a photographing unit configured to photograph at least a part of a visual field direction of the user in a state in which the user wears the head-mounted display device and acquire a motion of the user;

a track acquiring unit configured to acquire a track of the motion of the user from the motion photographed by the photographing unit; and

an authentication processing unit configured to authenticate, using the track acquired by the track acquiring unit, whether the user is a proper user.

2. The head-mounted display device according to claim 1, further comprising a guidance unit configured to inform the user of an overlapping region where a display region of the virtual image and a photographing region of the photographing unit overlap.

3. The head-mounted display device according to claim 1, wherein the photographing unit photographs, after the photographing unit detects a start trigger set in advance, the motion until the photographing unit detects an end trigger set in advance.

4. The head-mounted display device according to claim 3, wherein at least one of the start trigger and the end trigger is detection of stillness of the motion of the user for a predetermined time or more.

5. The head-mounted display device according to claim 3, wherein at least one of the start trigger and the end trigger is detection of passage of the motion of the user in a predetermined position.

6. The head-mounted display device according to claim 3, wherein at least one of the start trigger and the end trigger is detection of a predetermined shape of a part of the body of the user.

7. The head-mounted display device according to claim 1, further comprising a storing unit configured to store a track for authentication, which is the track registered in advance by the proper user of the head-mounted display device, wherein

the authentication processing unit determines that the user is the proper user when similarity between the track acquired by the track acquiring unit and the track for authentication is equal to or higher than a first threshold.

8. The head-mounted display device according to claim 7, wherein the authentication processing unit determines that the user is not the proper user when similarity between the track acquired by the track acquiring unit and a track obtained by converting the track acquired by the track acquiring unit in the past using at least any one method among non-magnification, lateral direction enlargement, longitudinal direction enlargement, lateral direction reduction, and longitudinal direction reduction is equal to or higher than a second threshold larger than the first threshold.

9. The head-mounted display device according to claim 1, wherein the track acquiring unit specifies the track of the motion according to changes in a moving direction and a movement amount of a part of the body of the user.

10. The head-mounted display device according to claim 1, wherein the track acquiring unit specifies the track of the motion according to changes in a moving direction and a movement amount of an arbitrary object held by the user.

11. The head-mounted display device according to claim 9, wherein the track acquiring unit sets, as a specific point, a part of the body of the user or an arbitrary place of the arbitrary object, repeatedly acquires a position of the specific point at a predetermined time interval, calculates, as the moving direction, a direction of a vector imaginarily connecting a position of the specific point acquired in n-th acquisition and a position of the specific point acquired in n+1th acquisition, and calculates, as the movement amount, magnitude of the vector imaginarily connecting the position of the specific point acquired in the n-th acquisition and the position of the specific point acquired in the n+1th acquisition.

12. A control method for a head-mounted display device that enables a user to simultaneously visually recognize a virtual image and an outside scene, the control method comprising:

(a) photographing at least a part of a visual field direction of the user in a state in which the user wears the head-mounted display device and acquiring a motion of the user;

(b) acquiring a track of the motion of the user from the motion photographed in (a); and

(c) authenticating, using the track acquired in (b), whether the user is a proper user.

13. An authentication system comprising:

a head-mounted display device that enables a user to simultaneously visually recognize a virtual image and an outside scene; and

an authentication server that performs authentication of the user, wherein

the head-mounted display device includes;

a photographing unit configured to photograph at least a part of a visual field direction of the user in a state in which the user wears the head-mounted display device and acquire a motion of the user; and

a transmitting unit configured to transmit the motion acquired by the photographing unit to the authentication server, and

the authentication server includes;

a track acquiring unit configured to acquire a track of the motion of the user from the motion received from the head-mounted display device;

an authentication processing unit configured to authenticate, using the track acquired by the track acquiring unit, whether the user is a proper user; and

a transmitting unit configured to transmit a result of the authentication by the authentication processing unit to the head-mounted display device.

14. The authentication system according to claim 13, wherein

the authentication server further includes a function providing unit configured to provide a predetermined function, and

the function providing unit limits the provision of the predetermined function to the user until the authentication processing unit determines that the user is the proper user.