Head-mounted display system and method for processing images

• US 20050156817A1
• Filed: 02/25/2005
• Published: 07/21/2005
• Est. Priority Date: 08/30/2002
• Status: Abandoned Application

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Iba, Yoichi
• Application Number:
  US11/067,088
• Publication Number:
  US 20050156817A1
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

A head-mounted display system comprises: a display device freely detachable and attachable on a user'"'"'s head; a direction detector for detecting the orientation of the user'"'"'s head in at least the horizontal direction, the direction detector being disposed on the display device; an image generator for generating an image in accordance with the orientation of the user'"'"'s head detected by the direction detector; a displacement-calculating unit for calculating displacement, the displacement being the difference between directional data of the current orientation of the user'"'"'s head detected by the direction detector and directional data of the orientation of the user'"'"'s head detected a predetermined amount of time ago; and an image processor for sending an image generated in the image generator to the display device after shifting the image in at least the horizontal direction in accordance with the displacement calculated by the displacement-calculating unit.

Claims

1. A head-mounted display system comprising:

display means freely detachable and attachable on a user'"'"'s head;

direction-detecting means for detecting the orientation of a user'"'"'s head in at least the horizontal direction, the direction-detecting means being disposed on the display means;

an image generator for generating an image in accordance with the orientation of the user'"'"'s head detected by the direction-detecting means;

displacement-calculating means for calculating displacement, the displacement being the difference between directional data of the current orientation of the user'"'"'s head detected by the direction-detecting means and directional data of the orientation of the user'"'"'s head detected a predetermined amount of time ago; and

image-processing means for sending an image generated by the image generator to the display means after shifting the image in at least the horizontal direction in accordance with the displacement calculated by the displacement-calculating means.

3. The head-mounted display system according to claim 1, further comprising a controller for controlling the display means, the controller including the displacement-calculating means and the image-processing means.

4. The head-mounted display system according to claim 1, wherein the direction-detecting means comprises a first direction-detecting unit and a second direction-detecting unit for detecting the orientation of the user'"'"'s head, the first direction-detecting unit being capable of measuring the direction required for the displacement-calculating means to carry out calculations and the second direction-detecting unit being capable of measuring the direction required for the image generator to generate an image.

5. The head-mounted display system according to claim 1, wherein the image-processing means processes the image signal generated from the image generator to shift the floating image to be displayed on the display means in the horizontal direction.

6. The head-mounted display system according to claim 1, further comprising time-measuring means for measuring a predetermined amount of time, the predetermined amount of time being the amount of time required by the image generator to generate an image.

7. The head-mounted display system according to claim 6, wherein the time-measuring means measures the predetermined amount of time by sending out a dummy signal for notifying a change in the orientation of the user'"'"'s head to the image generator and, analyzing the image signal generated, and thus measuring based on the signal the time required by the image generator to generate an image.

8. The head-mounted display system according to claim 6, wherein the time-measuring means measures the time required for generating a plurality of predetermined pattern images and determines it as the predetermined amount of time by statistically processing the time required for generating the plurality of predetermined pattern images.

9. The head-mounted display system according to claim 1, wherein the direction-detecting means generates directional data required for the displacement-calculating means to carry out calculations and directional data required for the image generator to generate an image.

10. The head-mounted display system according to claim 9, wherein the direction-detecting means comprises first signal-processing means for generating first directional data to be inputted to the displacement-calculating means and second processing means for generating second directional data to be inputted to the image generator.

11. The head-mounted display system according to claim 10, wherein the first signal-processing means is capable of carrying out processing at high response speed.

12. The head-mounted display system according to claim 11, wherein the response speed is equal to or faster than a video rate.

13. The head-mounted display system according to claim 11, wherein the response speed of the first signal-processing means is {fraction (1/15)} seconds or less.

14. The head-mounted display system according to claim 10, wherein the second signal-processing means is capable of suppressing drift.

2. A head-mounted display system comprising:

a display device freely detachable and attachable on a user'"'"'s head;

a direction detector for detecting the orientation of the user'"'"'s head in at least the horizontal direction, the direction detector being disposed on the display device;

an image generator for generating an image in accordance with the orientation of the user'"'"'s head detected by the direction detector;

a displacement-calculating unit for calculating displacement, the displacement being the difference between directional data of the current orientation of the user'"'"'s head detected by the direction detector and directional data of the orientation of the user'"'"'s head detected a predetermined amount of time ago; and

an image processor for sending an image generated in the image generator to the display device after shifting the image in at least the horizontal direction in accordance with the displacement calculated by the displacement-calculating unit.

15. The head-mounted display system according to claim 2, further comprising a controller for controlling the display device, the controller containing the displacement-calculating unit and the image-processor.

17. The head-mounted display system according to claim 2, wherein the image-processor processes the generated image signal from the image generator to shift the floating image to be displayed on the display device in the horizontal direction.

18. The head-mounted display system according to claim 2, further comprising a time-measuring unit for measuring a predetermined amount of time, the predetermined amount of time being the amount of time required by the image generator to generate an image.

19. The head-mounted display system according to claim 18, wherein the time-measuring unit measures the predetermined amount of time by sending out a dummy signal for notifying a change in the orientation of the user'"'"'s head to the image generator and, analyzing the image signal generated, and thus measuring based on the signal the time required by the image generator to generate an image.

20. The head-mounted display system according to claim 18, wherein the time-measuring unit measures the time required for generating a plurality of predetermined pattern images and determines it as the predetermined amount of time by statistically processing the time required for generating the plurality of predetermined pattern images.

21. The head-mounted display system according to claim 2, wherein the direction detector includes a direction sensor and a signal processing unit for receiving an output from the direction sensor, the signal processing unit being capable of generating first directional data to be sent to the displacement-calculating unit and second directional data to be sent to the image generator.

22. The head-mounted display system according to claim 21, wherein the signal-processing unit includes first signal-processing means for generating the first directional data and second signal-processing means for generating the second directional data.

23. The head-mounted display system according to claim 22, wherein the first signal-processing means is capable of carrying out processing at high response speed.

24. The head-mounted display system according to claim 23, wherein the response speed is equal to or faster than a video rate.

25. The head-mounted display system according to claim 23, wherein the response speed of the first signal-processing means is {fraction (1/15)} seconds or less.

26. The head-mounted display system according to claim 22, wherein the second signal-processing means is capable of suppressing drift.

16. A head-mounted display system comprising:

a display device freely detachable and attachable on a user'"'"'s head;

a first direction detector and a second direction detector for detecting the orientation of the user'"'"'s head in at least the horizontal direction, the first and second direction detectors being disposed on the display device;

an image generator for generating an image in accordance with the orientation of the user'"'"'s head detected by the second direction detector;

a displacement-calculating unit for calculating displacement, the displacement being the difference between directional data of the current orientation of the user'"'"'s head detected by the first direction detector and directional data of the orientation of the user'"'"'s head detected a predetermined amount of time ago; and

an image processor for sending an image generated in the image generator to the display device after shifting the image in at least the horizontal direction in accordance with the displacement calculated by the displacement-calculating unit.

27. A method for processing an image of a head-mounted display system, comprising steps of:

detecting the orientation of the user'"'"'s head in at least the horizontal direction using direction-detecting means disposed on displaying means freely detachable and attachable on the user'"'"'s head;

generating an image in accordance with the orientation of the user'"'"'s head detected by the direction-detecting means;

calculating the displacement of the user'"'"'s head, the displacement being the difference between directional data of the current orientation of the user'"'"'s head detected by the direction-detecting means and directional data of the orientation of the user'"'"'s head detected a predetermined amount of time ago;

processing the image such that the spatial position of displaying the generated image on the display means is shifted in at least the horizontal direction in accordance with the calculated displacement.

28. The method for processing an image of a head-mounted display system according to claim 27, wherein,

the direction-detecting means comprises a first direction-detecting unit and a second direction-detecting unit for detecting the orientation of the user'"'"'s head, and

the step of detecting the orientation of the user'"'"'s head includes steps of measuring the direction required for the first direction-detecting unit to calculate the displacement and of measuring the direction required for the second direction-detecting unit to generate an image.