Selective real image obstruction in a virtual reality display apparatus and method

• US 20030142068A1
• Filed: 01/09/2003
• Published: 07/31/2003
• Est. Priority Date: 07/01/1998
• Status: Abandoned Application

• Current Assignee: Joan S. DeLuca, Michael J. Deluca
• Original Assignee: Joan S. DeLuca, Michael J. Deluca
• Inventors: DeLuca, Michael J., DeLuca, Joan S.
• Application Number:
  US10/339,090
• Publication Number:
  US 20030142068A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G02B 30/22 of the stereoscopic type
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/371 for tracking viewers with different interocular distances; for tracking rotational head movements around the vertical axis
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A virtual reality system (200-322) stereoscopically projects a virtual reality images including a three dimensional image (245) having an interface image (250′) in a space observable by a user (100). The display system includes a substantially transparent display means (200) which also allows real images of real objects (850) to be combined or superimposed with the virtual reality images. Selective areas or characteristics of the real images are obstructed by a selective real image obstructer (860) to enhance viewing of selected virtual reality images while providing for viewing or real images or virtual images combined with real images in other viewing areas. The display system includes either a stereoscopic headset display system or a heads-up display system. The selective real images obstructer is a gray scale liquid crystal display included with the display system providing for adjustment of the size, shape and/or transparency of the obstruction of real images. The obstruction of real images may be adjusted in response to information for generating the virtual image, manual inputs or processing of real images by video cameras (310′ and 320′). Other selective real image obstructions include filtering a portion of the spectrum of visible light associated with the real images.

Claims

1. A method of displaying a viewable virtual image within a display area having viewable real images, the method comprising the step of:

obstructing a view of real images in an obstruction area for obstructing views of real images within a portion of the display area, wherein the obstruction area is substantially independent of substantial obstructions resulting from a means for projecting the virtual image, thereby enhancing viewing of the virtual image in coincidence with the obstruction area while enabling viewing of the virtual image and the real images beyond the obstruction area.

2. The method of claim 1 further comprising the step of actively selecting the obstruction area from a plurality of obstruction areas within the display area.

3. The method according to claim 1 further comprising the step of

selectively modifying characteristics of the obstruction area in response to a modification signal.

4. The method according to claim 3 wherein said step of selectively modifying modifies a size, shape or location of the obstruction area.

5. The method according to claim 3 wherein said step of selectively modifying modifies an amount of obstruction of real images within the obstruction area between states including a first state wherein real images within the obstruction area are substantially visible and at least a second state wherein real images within the obstruction are not substantially visible.

6. The method according to claim 5 further comprising the steps of:

determining an amount of ambient light associated with the real images; and

generating the modification signal in response thereto, wherein said step of selectively modifying modifies the amount of obstruction in response to said step of determining.

7. The method according to claim 3 further comprising the steps of:

receiving a manual input; and

generating the modification signal in response thereto, wherein said step of modifying is made in response to the manual input.

8. The method according to claim 3 wherein the virtual image is generated in response to an information signal and said step of selectively modifying is responsive to the information signal.

9. The method according to claim 1 wherein the obstruction area occurs in a predetermined portion of the display area.

10. A display system comprising:

a first display projector for projecting a virtual image within a viewable area wherein the virtual image appears substantially combined with real images visible within the viewable area; and

a first real image obstruction means for obstructing viewing of real images within an obstruction area within the viewable area, thereby enhancing viewing of the virtual image appearing within the obstruction area while enabling viewing of the virtual image and real images in the viewable area and beyond the obstruction area.

11. The display system according to claim 10 comprised within a headset display system for a viewer having first and second eyes for viewing the virtual image and the real images further comprising:

a second display projector substantially equivalent to said first display projector; and

a second real image obstruction means substantially equivalent to said first real image obstruction means, and further wherein

the first eye views virtual and real images from said first display projector and said first real image obstruction means and

the second eye views virtual and real images from said second display projector and said second image obstruction means.

12. The headset display system according to claim 11 wherein the first and second display projectors display a stereoscopic virtual image viewable by the viewer, the virtual image includes a stereoscopic interface image appearing within an interface space viewable by the viewer, said headset display system further comprising

a monitoring means for determining an intersection of a physical object having a real image with the interface space including the stereoscopic interface image and for generating a control signal in response thereto.

13. The headset display system of claim 12 wherein the physical object is a selecting object having a real image including a selecting image and further wherein

said first and second real image obstruction means are responsive to said monitoring means for obstructing viewing of real images within an obstruction area substantially including the interface image yet enable viewing of the selecting image, thereby allowing the viewer to view the intersection of the selecting object with the stereoscopic interface image.

14. The headset display system according to claim 13 wherein said monitoring means further identifies the selecting object as a finger tip of the viewer.

15. The display system according to claim 10 further comprising

an obstruction controller coupled to said first real image obstruction means for selectively modifying characteristics of the obstruction area.

16. The display system according to claim 15 wherein

said obstruction controller modifies a size, shape or location of the obstruction area or an amount of obstruction of real images appearing within the obstruction area in response to a manual input.

17. The display system according to claim 15 wherein

said first display projector projects the virtual image in response to information included within an information signal, and

said obstruction controller modifies a size, shape or location of the obstruction area or an amount of obstruction of real images appearing within the obstruction area in response to the information signal.

18. The display system according to claim 15 further comprising

an ambient light monitoring means for determining an ambient light level of the real images and for generating a brightness signal in response thereto, wherein

said obstruction controller modifies an amount of obstruction of real images appearing within the obstruction area in response to the brightness signal.

19. The display system according to claim 11 further comprising:

an obstruction controller coupled to said first and second real image obstruction means for selectively modifying characteristics of the obstruction area;

a light monitoring means for determining a substantially high light level of a bright real image and a location thereof and for generating a light source signal in response thereto, wherein

said obstruction controller increases an amount of obstruction of the bright real image in substantial coincidence with the location in response to the light source signal.

20. In a headset display system, a method of enhancing viewing of a virtual image viewed in combination with real images comprised of a spectrum of light comprising the steps of:

substantially filtering a portion of the spectrum of light of the real images; and

displaying the virtual image in a light spectrum substantially within the filtered portion of the spectrum of light of the real images.

21. The method according to claim 20 wherein the virtual image includes a substantial amount of text or graphic information.

22. The method according to claim 20 wherein the virtual image is displayed in a viewing area of the headset display system and said step of substantially filtering filters the spectrum of light of real images for substantially the entire viewing area.

23. The method according to claim 22 further comprising the steps of:

substantially obstructing the entire spectrum of light of the real images within an obstruction area; and

displaying a second virtual image within the obstruction area.

24. The method according to claim 20 wherein the virtual image is displayed in a viewing area of the headset display system and said step of substantially filtering filters the spectrum of light of real images for a portion of the entire viewing area.

25. The method according to claim 24 further comprising the step of actively modifying a size or shape of the portion of the entire viewing area.