DISPLAY DEVICE, CONTROL METHOD FOR DISPLAY DEVICE, AND COMPUTER PROGRAM

• US 20160313973A1
• Filed: 04/19/2016
• Published: 10/27/2016
• Est. Priority Date: 04/24/2015
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: YAJIMA, Kenro
• Application Number:
  US15/132,765
• Publication Number:
  US 20160313973A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2430/20 Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 29/004 for microphones H04R29/007 takes precedence

Abstract

An HMD includes an image display section that causes the user to visually recognize an image and transmits an outside scene and a earphone that output sound. The HMD executes, with an AR control section, sound output processing for causing the earphone to output sound corresponding to an image displayed by the image display section and output control processing including sound processing for the sound output by the earphone or processing for the image displayed by the image display section, the output control processing changing the audibility of the sound output by the earphone.

Claims

1. A display device mounted on a head of a user, the display device comprising:

a display section configured to display an image;

a sound output section configured to output sound; and

a processing section configured to execute sound output processing for causing the sound output section to output sound and output control processing including sound processing for the sound output by the sound output section or processing for the image displayed by the display section, the output control processing changing audibility of the sound output by the sound output section.

2. The display device according to claim 1, wherein, in the sound output processing, the processing section causes the sound output section to output sound corresponding to the image displayed by the display section.

3. The display device according to claim 1, further comprising a motion detecting section configured to detect at least any one of a position, a movement, and a direction of the head of the user, wherein

the processing section executes the output control processing on the basis of a result of the detection of the motion detecting section.

4. The display device according to claim 3, further comprising a movement sensor configured to detect the movement of the head of the user, wherein

the motion detecting section calculates at least one of the position, the movement, and the direction of the head of the user on the basis of a detection value of the movement sensor.

5. The display device according to claim 3, wherein the processing section performs sound specifying processing for specifying external sound and a position of a sound source of the external sound and executes the output control processing on the basis of the specified external sound or the specified position of the sound source.

6. The display device according to claim 5, further comprising a microphone configured to collect and detect the external sound, wherein

the processing section executes the sound specifying processing on the basis of sound detected from a gazing direction of the user by the microphone and the detection result of the motion detecting section and specifies the external sound and the position of the sound source that emits the external sound.

7. The display device according to claim 6, wherein, in the output control processing, the processing section causes the sound output section to output sound based on the external sound detected by the microphone.

8. The display device according to claim 5, wherein the processing section calculates relative positions of the position of the head of the user detected by the motion detecting section and the position of the sound source specified by the sound specifying section and executes the output control processing on the basis of the calculated relative positions.

9. The display device according to claim 8, wherein the processing section calculates relative positions of the position of the sound source specified by the sound specifying processing and each of the eyes and the ears of the user in addition to the relative positions of the position of the head of the user and the position of the sound source.

10. The display device according to claim 5, wherein the processing section generates auditory sense information related to auditory sensation of the user on the basis of the relative positions of the position of the head of the user and the position of the sound source, executes the output control processing on the basis of the auditory sense information, and updates the auditory sense information on the basis of the movement of the head of the user detected by the motion detecting section.

11. The display device according to claim 5, wherein, in the output control processing, the processing section perform processing for the image displayed by the display section to change visibility of the user in viewing a direction corresponding to the position of the sound source.

12. The display device according to claim 1, further comprising a visual-line detecting section configured to detect a visual line direction of the user, wherein

the processing section specifies a gazing direction of the user from a result the detection of the visual-line detecting section and executes the output control processing according to the specified direction.

13. The display device according to claim 12, wherein, in the output control processing, the processing section displays the image over a target object located in the gazing direction of the user.

14. A control method for a display device comprising:

controlling a display device worn on a head of a user and including a display section configured to display an image and a sound output section configured to output sound;

causing the sound output section to output sound; and

executing output control processing including sound processing for the sound output by the sound output section or processing for the image displayed by the display section, the output control processing changing audibility of the sound output by the sound output section.

15. A computer program executable by a computer that controls a display device worn on a head of a user and including a display section configured to display an image and a sound output section configured to output sound,

the computer program causing the computer to function as a processing section configured to execute sound output processing for causing the sound output section to output sound and output control processing including sound processing for the sound output by the sound output section or processing for the image displayed by the display section, the output control processing changing audibility of the sound output by the sound output section.