HEAD MOUNTED DISPLAY, AND IMAGE DISPLAYING METHOD IN HEAD MOUNTED DISPLAY

• US 20100321409A1
• Filed: 06/10/2010
• Published: 12/23/2010
• Est. Priority Date: 06/22/2009
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Komori, Akihiro, Mukawa, Hiroshi
• Application Number:
  US12/813,008
• Publication Number:
  US 20100321409A1
• Time in Patent Office: Days
• US Class Current: 345/656
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0145 creating an intermediate image
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 3/14 Transformations for image registration, e.g. adjusting or mapping for alignment of images
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

Disclosed herein is A head mounted display including: (A) an eyeglasses frame-like frame to be mounted to an observer'"'"'s head; (B) an image display device; (C) an image sensing device mounted to the frame; and (D) a correction section, wherein the image display device includes (B-1) an image generating device, and (B-2) see-through type light guide section which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided, and from which the beams are emitted toward an observer'"'"'s pupil.

Claims

1. A head mounted display comprising:

an eyeglasses frame-like frame to be mounted to an observer'"'"'s head;

an image display device;

an image sensing device mounted to the frame; and

correction means, wherein

the image display device includes

an image generating device, and

see-through type light guide means which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided, and from which the beams are emitted toward an observer'"'"'s pupil, and

the correction means corrects sensed image data, obtained through sensing an image of an object by the image sensing device, so that an image of the object observed through the light guide means and an image outputted from the image generating device on the basis of the sensed image data and generated in the light guide means are put into register with each other.

2. The head mounted display according to claim 1, wherein:

the correction means stores therein correction data obtained upon calibration for correcting reference sensed image data, obtained through sensing an image of a reference object by the image sensing device, so that an image of the reference object observed through the light guide means and a reference image outputted from the image generating device on the basis of the reference sensed image data and generated in the light guide means are put into register with each other; and

the correction means corrects the sensed image data obtained through sensing an image of the object by the image sensing device, on the basis of correction data, so that the image of the object observed through the light guide means and the image outputted from the image generating device on the basis of the sensed image data and generated in the light guide means are put into register with each other.

3. The head mounted display according to claim 2, wherein at the time of the calibration, the correction means enhances at least part of a contour of the reference image which is outputted from the image generating device on the basis of the reference sensed image data obtained through sensing an image of the reference object by the image sensing device and which is generated in the light guide means.

4. The head mounted display according to claim 2, wherein at the time of the calibration, the correction means performs a processing such that the color of the reference image which is outputted from the image generating device on the basis of the reference sensed image data obtained through sensing an image of the reference object by the image sensing device and which is generated in the light guide means is made to be different from the color of the reference object.

5. The head mounted display according to claim 2, wherein:

the correction data includes distance reference data, which is data on the distance from the reference object to the image sensing device at the time of the calibration; and

at the time of calibrating the sensed image data obtained through sensing an image of the object by the image sensing device so that the image of the object observed through the light guide means and the image outputted from the image generating device on the basis of the sensed image data and generated in the light guide means are put into register with each other, the correction means further corrects the sensed image data on the basis of both data on the distance from the object to the image sensing device and the distance reference data.

6. The head mounted display according to claim 2, wherein in the calibration, the correction means performs a processing such that the image of the reference object observed through the light guide means and the reference image which is outputted from the image generating device on the basis of the reference sensed image data obtained through sensing an image of the reference object by the image sensing device and which is generated in the light guide means are put into register with each other, by subjecting the reference sensed image data to rotation, scaling, and transfer.

7. The head mounted display according to claim 1, wherein the correction means subjects the sensed image data to rotation, scaling, and transfer.

8. An image displaying method in a head mounted display comprising:

an eyeglasses frame-like frame to be mounted to an observer'"'"'s head;

an image display device;

an image sensing device mounted to the frame; and

correction means,

wherein the image display device includes

an image generating device, and

see-through type light guide means which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided, and from which the beams are emitted toward an observer'"'"'s pupil, and

the correction means corrects sensed image data, obtained through sensing an image of an object by the image sensing device, so that an image of the object observed through the light guide means and an image outputted from the image generating device on the basis of the sensed image data and generated in the light guide means are put into register with each other.

9. The image displaying method in the head mounted display according to claim 8, wherein:

correction data obtained upon calibration for correcting reference sensed image data, obtained through sensing an image of a reference object by the image sensing device, so that an image of the reference object observed through the light guide means and a reference image outputted from the image generating device on the basis of the reference sensed image data and generated in the light guide means are put into register with each other is preliminarily stored in the correction means; and

the sensed image data obtained through sensing an image of the object by the image sensing device is corrected by the correction means on the basis of the correction data so that the image of the object observed through the light guide means and the image outputted from the image generating device on the basis of the sensed image data and generated in the light guide means are put into register with each other.

10. The image displaying method in the head mounted display according to claim 9, wherein

at the time of the calibration, at least part of a contour of the reference image which is outputted from the image generating device on the basis of the reference sensed image data obtained through sensing an image of the reference object by the image sensing device and which is generated in the light guide means is enhanced by the correction means.

11. The image displaying method in the head mounted display according to claim 9, wherein

at the time of the calibration, the color of the reference image which is outputted from the image generating device on the basis of the reference sensed image data obtained through sensing an image of the reference object by the image sensing device and which is generated in the light guide means is made to be different from the color of the reference object by the correction means.

12. The image displaying method in the head mounted display according to claim 9, wherein:

the correction data includes distance reference data, which is data on the distance from the reference object to the image sensing device at the time of the calibration; and

at the time of calibrating the sensed image data obtained through sensing an image of the object by the image sensing device so that the image of the object observed through the light guide means and the image outputted from the image generating device on the basis of the sensed image data and generated in the light guide means are put into register with each other, further, the sensed image data is corrected by the correction means on the basis of both data on the distance from the object to the image sensing device and the distance reference data.

13. The image displaying method in the head mounted display according to claim 9, wherein in the calibration, the correction means performs a processing such that the image of the reference object observed through the light guide means and the reference image which is outputted from the image generating device on the basis of the reference sensed image data obtained through sensing an image of the reference object by the image sensing device and which is generated in the light guide means are put into register with each other, by subjecting the reference sensed image data to rotation, scaling, and transfer by the correction means.

14. The image displaying method in the head mounted display according to claim 13, wherein in the calibration, the reference sensed image data is subjected to rotation, scaling, and transfer by the correction means on the basis of an observer'"'"'s direction sent through the image sensing device.

15. The image displaying method in the head mounted display according to claim 8, wherein the sensed image data is subjected to rotation, scaling, and transfer by the correction means.

16. A head mounted display comprising:

an eyeglasses frame-like frame to be mounted to an observer'"'"'s head;

an image display device;

an image sensing device mounted to the frame; and

correction means, wherein

the image display device includes

an image generating device, and

see-through type light guide means which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided, and from which the beams are emitted toward an observer'"'"'s pupil, and

the correction means corrects sensed image data obtained by image sensing, and outputs the corrected sensed image data to the image generating device.

17. The head mounted display according to claim 16, wherein the correction means subjects the sensed image data to rotation, scaling, and transfer.

18. An image displaying method in a head mounted display comprising:

an eyeglasses frame-like frame to be mounted to an observer'"'"'s head;

an image display device;

an image sensing device mounted to the frame; and

correction means, wherein

the image display device includes

an image generating device, and

see-through type light guide means which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided, and from which the beams are emitted toward an observer'"'"'s pupil, and

the correction means corrects sensed image data obtained by image sensing by the image sensing device, and outputs the corrected sensed image data to the image generating device.

19. The image sensing method in the head mounted display according to claim 18, wherein the sensed image data is subjected to rotation, scaling, and transfer by the correction means.