DISPLAY DEVICE, METHOD OF CONTROLLING THE SAME, AND PROGRAM

• US 20160133051A1
• Filed: 10/15/2015
• Published: 05/12/2016
• Est. Priority Date: 11/06/2014
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: AONUMA, Masashi, HIRANO, Kiichi, TAKANO, Masahide
• Granted Patent: US 9,898,868 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

A head mounted display device includes an image display portion that transmits external scenery and displays an image so as to be capable of being visually recognized together with the external scenery. In addition, the head mounted display device includes a control unit that acquires an external scenery image including the external scenery which is visually recognized through the image display portion, recognizes an object which is visually recognized through the image display portion on the basis of the acquired external scenery image, and displays information regarding the object on the image display portion.

Claims

1. A display device comprising:

a display unit that transmits external scenery and displays an image so as to be capable of being visually recognized together with the external scenery;

an external scenery image acquisition unit that acquires an external scenery image including the external scenery which is visually recognized through the display unit; and

a control unit that recognizes an object which is visually recognized through the display unit on the basis of the external scenery image acquired by the external scenery image acquisition unit, and displays information regarding the object on the display unit.

2. The display device according to claim 1, wherein when the object is positioned outside a range in which the information is displayed on the display unit, the control unit performs an inducement display for inducing a line of sight to the object by the display unit.

3. The display device according to claim 1, wherein the control unit displays an image of external scenery in a range, which is capable of being visually recognized through the display unit, on the display unit on the basis of the external scenery image acquired by the external scenery image acquisition unit.

4. The display device according to claim 1,

wherein the display unit, which is a head mounted display unit to be mounted on a user'"'"'s head, includes a first display unit that displays the image and a second display unit that displays an image visually recognized in a range wider than that of the first display unit on a side closer to external scenery than the first display unit, and

wherein the control unit performs an inducement display for inducing a line of sight to the object by the second display unit.

5. The display device according to claim 1,

wherein the display unit, which is a head mounted display unit to be mounted on a user'"'"'s head, includes a line-of-sight detection unit that detects a line of sight of the user, and

wherein the control unit changes a display of the display unit in accordance with a direction of the user'"'"'s line of sight which is detected by the line-of-sight detection unit.

6. The display device according to claim 5, wherein the control unit displays a partial region of the external scenery image acquired by the external scenery image acquisition unit on the display unit, and changes a position of the partial region displayed on the display unit in the external scenery image, in accordance with the direction of the user'"'"'s line of sight detected by the line-of-sight detection unit.

7. The display device according to claim 1, further comprising an image capturing unit that captures an image of a range including external scenery which is visually recognized through the display unit,

wherein the external scenery image acquisition unit acquires the image captured by the image capturing unit as the external scenery image.

8. The display device according to claim 7, wherein the external scenery image acquisition unit acquires a plurality of captured images captured by the image capturing unit and compounds the captured images into the external scenery image.

9. The display device according to claim 7, further comprising a plurality of the image capturing units,

wherein the external scenery image acquisition unit acquires a plurality of captured images captured respectively by the plurality of image capturing units, and compounds the captured images into the external scenery image.

10. The display device according to claim 1, further comprising a connection portion which is connected to an external device,

wherein the external scenery image acquisition unit acquires the external scenery image from the external device which is connected to the connection portion.

11. The display device according to claim 10, further comprising a position detection unit that detects a present position,

wherein the external scenery image acquisition unit acquires the external scenery image corresponding to the present position which is detected by the position detection unit from the external device which is connected to the connection portion.

12. The display device according to claim 1, wherein the control unit recognizes the object by extracting an image of the object from the external scenery image acquired by the external scenery image acquisition unit.

13. A display device, which is a display device to be mounted on a user'"'"'s head, comprising:

a display unit having a display region that transmits external scenery and displays an image so as to be capable of being visually recognized together with the external scenery; and

a control unit that recognizes an object which is positioned outside a range capable of being visually recognized through the display region, and outputs information regarding the object.

14. The display device according to claim 13, wherein when the object is positioned outside a range capable of being visually recognized through the display unit, the control unit outputs information for inducing the user to be in a state where the object is capable of being visually recognized.

15. The display device according to claim 13, wherein when the object is visually recognized through an outer side of the display region in the display unit, the control unit outputs the information for inducing the user to be in a state where the object is capable of being visually recognized through the display region.

16. The display device according to claim 13, wherein the control unit displays a character and/or an image constituting the information in a display region of the display unit.

17. The display device according to claim 13, further comprising a sound output unit that outputs a sound,

wherein the control unit outputs a sound constituting the information by the sound output unit.

18. The display device according to claim 13, wherein the control unit acquires positional information indicating a position of the object, obtains relative positions of a range which is visually recognized by the user through the display region and the object on the basis of the acquired positional information, and outputs the information.

19. The display device according to claim 13, wherein the control unit acquires an external scenery image obtained by capturing an image of the external scenery, obtains relative positions of a range which is visually recognized by the user through the display region and the object on the basis of the acquired external scenery image, and outputs the information.

20. A program causing a computer, which controls a display device including a display unit having a display region that transmits external scenery and displays an image so as to be capable of being visually recognized together with the external scenery, to function as:

a control unit that recognizes an object which is positioned outside a range capable of being visually recognized through the display region, and outputs information regarding the object.