Hybrid Display Systems and Methods

• US 20090225001A1
• Filed: 01/16/2009
• Published: 09/10/2009
• Est. Priority Date: 11/06/2007
• Status: Abandoned Application

• Current Assignee: University of Central Florida Research Foundation Inc. (State University System of Florida)
• Original Assignee: University of Central Florida Research Foundation Inc. (State University System of Florida)
• Inventors: Rolland, Jannick, Biocca, Frank
• Application Number:
  US12/266,077
• Publication Number:
  US 20090225001A1
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2300/02 Composition of display devices
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

In one embodiment, a hybrid display system includes a dome in which a system user may enter, the dome including an inner surface, a projector configured to project a background image on the dome inner surface that the user can view, and a head-mounted display (HMD) that the user can wear, the HMD being configured to display an insert image to the user simultaneous to the projection of the background image so that the user can view a hybrid image comprising both the background image of the dome and the insert image of the HMD.

Claims

1. A hybrid display system comprising:

a dome in which a system user may enter, the dome including an inner surface;

a projector configured to project a background image on the dome inner surface that the user can view; and

a head-mounted display (HMD) that the user can wear, the HMD being configured to display an insert image to the user simultaneous to the projection of the background image so that the user can view a hybrid image comprising both the background image of the dome and the insert image of the HMD.

2. The system of claim 1, wherein the dome comprises a hollow, inverted partial sphere.

3. The system of claim 2, wherein the dome is hemispherical.

4. The system of claim 1, wherein the dome is tilted such that a top edge of the dome is not parallel with the horizontal plane.

5. The system of claim 1, wherein the inner surface surrounds the user such that a substantially 360°

panoramic image can be presented to the user.

6. The system of claim 1, wherein the projector is positioned above the dome.

7. The system of claim 1, wherein the projector is further positioned forward of the user to avoid casting shadows within the user'"'"'s line of sight.

8. The system of claim 1, wherein the HMD is a see-through HMD.

9. The system of claim 1, wherein the HMD is configured to display a high-resolution insert image in registration with the background image, the high-resolution insert image having a higher resolution than the background image.

10. The system of claim 9, wherein the high-resolution insert image has a resolution of approximately 1 to 4 arc minutes.

11. The system of claim 1, wherein the insert image overlays only a portion of the background image.

12. The system of claim 11, wherein the insert image covers an area of the background image that corresponds to an approximate 20°

field of view.

13. The system of claim 1, wherein the HMD is configured to display graphical features within the insert image.

14. The system of claim 13, wherein the HMD is configured to display the graphical features in registration with the background image.

15. The system of claim 1, further comprising a control console provided within the dome.

16. The system of claim 1, further comprising a head-tracking system, the head-tracking system being configured to determine the position and orientation of the user'"'"'s head so that the portion of the dome inner surface, and background image, at which the user is presumably looking can be determined.

17. The system of claim 16, wherein the head-tracking system comprises a camera that captures images of the user.

18. The system of claim 1, further comprising a computer system that controls operation of the hybrid display system.

19. The system of claim 18, wherein in the computer system is configured to determine the portion of the dome inner surface, and background image, at which the user is presumably looking and, based upon that determination, control the insert image displayed in the HMD such that the insert image is in registration with the background image displayed on the dome inner surface.

20. A hybrid display system comprising:

an inverted dome in which a user can enter, the dome including an inner surface that surrounds the user so as to be capable of displaying substantially 360°

panoramic images to the user;

a projector positioned above the display dome and forward of the user, the projector being configured to project a relatively low-resolution background image on the dome inner surface for the user to view;

a see-through head-mounted display (HMD) that the user can wear, the HMD being configured to display relatively high-resolution insert images to the user simultaneous to the projection of the relatively low-resolution background image so that the user can view a hybrid image comprising both the relatively low-resolution background image of the dome and the relatively high-resolution insert image of the HMD;

a head-tracking system configured to determine the position and orientation of the user'"'"'s head; and

a computer system configured to determine the portion of the dome inner surface, and background image, at which the user is presumably looking based upon the head position and orientation determination and to control the high-resolution insert image to coincide and be in registration with the portion of the background image at which the user is presumably looking.

21. The hybrid display system of claim 20, wherein the insert image has a resolution of approximately 1 to 4 arc minutes.

22. The hybrid display system of claim 20, wherein the insert image covers an area of the background image that corresponds to an approximate 20°

field of view.

23. The hybrid display system of claim 20, wherein the HMD is further configured to augment the insert image with graphical features.

24. The hybrid display system of claim 23, wherein the HMD is configured to display the graphical features in registration with the background image.

25. A method for displaying a hybrid image to a user, the method comprising:

generating a background image to be displayed on a surface of a dome in which the user is positioned;

generating an insert image for display in a see-through head-mounted display (HMD) that the user is wearing; and

projecting the background image onto the dome surface and simultaneously displaying an insert image to the user in the HMD such that the user can view a hybrid image that comprises both the background image and the insert image.

26. The method of claim 25, wherein generating a background image comprises generating a background image using one or more aerial photographs.

27. The method of claim 25, wherein generating an insert image comprises generating a high-resolution insert image that corresponds to the portion of the background image at which the user is presumably looking.

28. The method of claim 27, further comprising determining the portion of the background image at which the user is presumably looking.

29. The method of claim 28, wherein determining the portion of the background image at which the user is presumably looking comprises determining a position and orientation of the user'"'"'s head.

30. The method of claim 25, wherein generating an insert image comprises generating a graphical feature that will overlie the hybrid image.