HEAD MOUNTED DISPLAY DEVICE, CONTROL METHOD FOR HEAD MOUNTED DISPLAY DEVICE, INFORMATION SYSTEM, AND COMPUTER PROGRAM

• US 20160070101A1
• Filed: 08/19/2015
• Published: 03/10/2016
• Est. Priority Date: 09/09/2014
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: NISHIZAWA, Kazuo
• Application Number:
  US14/830,343
• Publication Number:
  US 20160070101A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/265 constructional aspects of navigation devices, e.g. housings, mountings, displays G01C21/3688 takes precedence
• CPC Class Codes: G01C 21/3697 Output of additional, non-guidance related information, e.g. low fuel level G01C21/3679 takes precedence
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/125 the stations being mobile

Abstract

A transmission type head mounted display device includes an imaging unit that images an outside scene, an image display unit that displays an image and is capable of transmitting the outside scene, an action detection unit that detects an action of a user, and a function determination unit that determines a function which can be executed by the head mounted display device in a case where an action situation which is a combination of the detected action and the imaged outside scene is a predetermined situation.

Claims

1. A transmission type head mounted display device comprising:

an imaging unit that images an outside scene;

an image display unit that displays the image and is capable of transmitting the outside scene;

an action detection unit that detects an action of a user; and

a function determination unit that determines a function which can be executed by the head mounted display device in a case where an action situation which is a combination of the detected action and the imaged outside scene is a predetermined situation.

2. The head mounted display device according to claim 1, further comprising:

a display image control unit that displays an associated display image associated with at least one of the determined function and the action situation on the image display unit in a case where the action situation is the predetermined situation.

3. The head mounted display device according to claim 2, further comprising:

a position specification unit that specifies a current position of the image display unit in a case where the action situation is the predetermined situation; and

an information transmission and reception unit that transmits position information representing a specified current position to another device and receives local information which is based on the position information,

wherein the display image control unit displays the image associated with the received local information on the image display unit as the associated display image.

4. The head mounted display device according to claim 2,

wherein the action detection unit detects a line-of-sight direction of the user as the action of the user, and

wherein, in a case where the action situation is the predetermined situation and a detected line-of-sight direction is a direction other than a predetermined direction, the display image control unit displays the image that urges the user to change the line-of-sight direction to the predetermined direction on the image display unit as the associated display image.

5. The head mounted display device according to claim 2, further comprising:

a situation detection unit that detects a brightness of the outside scene,

wherein, in a case where the action situation is the predetermined situation and the detected brightness of the outside scene is equal to or higher than a predetermined brightness set in advance, the function determination unit sets the brightness to be higher than the brightness of the image displayed on the image display unit in a case where the detected brightness of the outside scene is lower than the predetermined brightness.

6. The head mounted display device according to claim 2, further comprising:

a history storage unit that stores a detected past history of the action at a plurality of time points in which the action situation is the predetermined situation,

wherein, in a case where the action situation is the predetermined situation, at least one of the determination of the function performed by the function determination unit and a display of the associated display image performed by the image display unit is performed based on a collation result of the history of the action stored in the plurality of time points and the detected action of the user.

7. The head mounted display device according to claim 2, further comprising:

an information transmission and reception unit that receives information of the action of another user at a plurality of time points in which the action situation is the predetermined situation, in a case where the action situation is the predetermined situation,

wherein at least one of the determination of the function performed by the function determination unit and a display of the associated display image performed by the image display unit is performed based on the collation result of the received action of another user and the detected action of another user.

8. The head mounted display device according to claim 1,

wherein the imaging unit detects a specific target set in advance from the outside scenes, and

wherein the action situation is the combination of the detected action and the specific target detected by the imaging unit.

9. The head mounted display device according to claim 1,

wherein the action detection unit is formed integrally on the image display unit and detects the action of the user based on an acceleration of the image display unit.

10. The head mounted display device according to claim 1,

wherein the action detection unit is formed separate from the image display unit and mounted on a body of the user, and detects the action of the user based on an acceleration of a mounted part of the user.

11. The head mounted display device according to claim 1, further comprising:

a situation detection unit that detects a situation of the outside scene,

wherein, in a case where the action situation is the predetermined situation and a detected situation of the outside scene is the predetermined situation, the function determination unit determines the function associated with the detected situation of the outside scene.

12. The head mounted display device according to claim 1,

wherein the predetermined situation is a combination of the image of the outside scene set in advance and the action of the user associated with the image of the outside scene set in advance.

13. A control method for a transmission type head mounted display device including an imaging unit that images an outside scene, and an image display unit that displays an image and is capable of transmitting the outside scene, the method comprising:

detecting an action of a user; and

determining a function which can be executed by the head mounted display device in a case where an action situation which is a combination of the detected action and the imaged outside scene is a predetermined situation.

14. An information system comprising a transmission type head mounted display device and an information storage device that stores local information,

wherein the head mounted display device includes:

an imaging unit that images an outside scene;

an image display unit that displays an image and is capable of transmitting the outside scene;

an action detection unit that detects an action of a user;

a position specification unit that specifies a current position of the image display unit, and

an information transmission and reception unit that transmits position information representing the specified current position to the information storage device,

wherein the information storage device includes a local information transmission unit that receives the transmitted position information of the image display unit and transmits the local information within a predetermined range from the position of the image display unit to the information transmission and reception unit,

wherein the information transmission and reception unit receives the transmitted local information, and

wherein the head mounted display device further includes;

a function determination unit that determines a function which can be executed by the head mounted display device in a case where an action situation which is a combination of the detected action and the imaged outside scene is a predetermined situation; and

a display image control unit that displays the image associated with the received local information on the image display unit.

15. A computer program for a transmission type head mounted display device that includes an imaging unit that images an outside scene and an image display unit that displays an image and is capable of transmitting the outside scene, the computer program causes a computer to implement:

an action detection function for detecting an action of a user; and

a function control function for determining a function which can be executed by the head mounted display device in a case where an action situation which is a combination of the detected action and the imaged outside scene is a predetermined situation.