HEAD-MOUNTED DISPLAY DEVICE

• US 20110234475A1
• Filed: 01/28/2011
• Published: 09/29/2011
• Est. Priority Date: 03/25/2010
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: ENDO, Hiroshi
• Application Number:
  US13/016,427
• Publication Number:
  US 20110234475A1
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 5/006 Geometric correction correction of chromatic aberrations adapted to be used in an image pickup device containing an electronic image sensor H04N23/10; detecting, correcting, reducing or removing artefacts resulting only from the lens unit, e.g. flare, shading, vignetting or "cos4" H04N25/61
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

A head-mounted display device captures an image of a real space as an external video through a circular fish-eye lens. A main image is extracted from a central portion of the external video, and a left image, a right image, an upper image, and a lower image are extracted as sub-images from the periphery of the external video. The distortion of a wide-angle lens is corrected in the main image, and the main image is displayed at the center. Each sub-image is displayed around the main image.

Claims

1. A head-mounted display device that is worn on the head of a wearer and is used, comprising:

an imaging unit capturing an image of a real space as an external video through a wide-angle lens from a viewpoint substantially the same as that of the wearer;

an image dividing unit extracting a portion of the external video as a main image and extracting the external video around the main image or a peripheral image of the external video as a sub-image;

a distortion correcting unit correcting distortion of the wide-angle lens for the main image; and

a display unit displaying the main image in front of eyes of the wearer and displaying the sub-image around the main image.

2. The head-mounted display device according to claim 1, wherein the image dividing unit extracts the sub-image from the external video so as to overlap a portion of the main image.

3. The head-mounted display device according to claim 1, wherein

the image dividing unit extracts the sub-images from left and right sides of the main image, or from left and right peripheral portions of the external video, and

the display unit displays the corresponding sub-images on the left and right sides of the main image.

4. The head-mounted display device according to claim 1, wherein

the image dividing unit extracts the sub-images from upper, lower, left, and right sides of the main image, or from upper, lower, left, and right peripheral portions of the external video, and

the display unit displays the corresponding sub-images on the upper, lower, left, and right sides of the main image.

5. The head-mounted display device according to claim 1, wherein the image dividing unit extracts a central portion of the external video as the main image such that a center of the main image is aligned with a center of the external video captured by the imaging unit.

6. The head-mounted display device according to claim 1, wherein the imaging unit includes a circular fish-eye lens as the wide-angle lens.

7. The head-mounted display device according to claim 1, further comprising:

an additional information composition unit superimposing additional information on the main image or the sub-image to display the main image or the sub-image having the additional information superimposed thereon.

8. The head-mounted display device according to claim 1, further comprising:

a motion detecting unit detecting motion of a head of the wearer; and

a range adjusting unit changing a size of a range of the real space displayed by the main image on the basis of the detection result of the motion detecting unit.

9. The head-mounted display device according to claim 8, wherein when the motion detecting unit detects the motion, the range adjusting unit changes the range of the real space displayed by the main image to be wider than that when the motion detecting unit does not detect the motion.

10. The head-mounted display device according to claim 8, wherein when the speed of the motion detected by the motion detecting unit is equal to or more than a predetermined value, the range adjusting unit changes the range of the real space displayed by the main image to be wider than that when the speed of the motion is less than the predetermined value.

11. The head-mounted display device according to claim 8, wherein the image dividing unit extracts the sub-image from the external video so as to overlap a portion of the main image.

12. The head-mounted display device according to claim 8, wherein

the image dividing unit extracts the sub-images from left and right sides of the main image, or from left and right peripheral portions of the external video, and

the display unit displays the corresponding sub-images on the left and right sides of the main image.

13. The head-mounted display device according to claim 8, wherein

the image dividing unit extracts the sub-images from upper, lower, left, and right sides of the main image, or from upper, lower, left, and right peripheral portions of the external video, and

the display unit displays the corresponding sub-images on the upper, lower, left, and right sides of the main image.

14. The head-mounted display device according to claim 8, wherein the image dividing unit extracts a central portion of the external video as the main image such that a center of the main image is aligned with a center of the external video captured by the imaging unit.

15. The head-mounted display device according to claim 8, wherein the imaging unit includes a circular fish-eye lens as the wide-angle lens.

16. The head-mounted display device according to claim 8, further comprising:

an additional information composition unit superimposing additional information on the main image or the sub-image to display the main image or the sub-image having the additional information superimposed thereon.

17. The head-mounted display device according to claim 1, further comprising:

a viewpoint detecting unit detecting the viewpoint position of the wearer on the main image or the sub-image; and

a center control unit detecting a gaze position of the wearer on the external video on the basis of the detection result of the viewpoint detecting unit and controlling the image dividing unit to extract the main image having the detected gaze position as its center.

18. The head-mounted display device according to claim 17, wherein

the distortion correcting unit corrects the distortion of the wide-angle lens for the external video, and

the image dividing unit extracts the main image from the external video whose distortion is corrected by the distortion correcting unit.

19. The head-mounted display device according to claim 17, wherein the image dividing unit extracts the sub-image from the external video so as to overlap a portion of the main image.

20. The head-mounted display device according to claim 17, wherein

the image dividing unit extracts the sub-images from left and right sides of the main image, or from left and right peripheral portions of the external video, and

the display unit displays the corresponding sub-images on the left and right sides of the main image.

21. The head-mounted display device according to claim 17, wherein

the image dividing unit extracts the sub-images from upper, lower, left, and right sides of the main image, or from upper, lower, left, and right peripheral portions of the external video, and

the display unit displays the corresponding sub-images on the upper, lower, left, and right sides of the main image.

22. The head-mounted display device according to claim 17, wherein the imaging unit includes a circular fish-eye lens as the wide-angle lens.

23. The head-mounted display device according to claim 17, further comprising:

an additional information composition unit superimposing additional information on the main image or the sub-image to display the main image or the sub-image having the additional information superimposed thereon.