Selective real image obstruction in a virtual reality display apparatus and method

• US 6,559,813 B1
• Filed: 01/31/2000
• Issued: 05/06/2003
• Est. Priority Date: 07/01/1998
• Status: Expired due to Term

• Current Assignee: Vuzix Corporation
• Original Assignee: Joan Deluca, Michael Deluca
• Inventors: DeLuca, Michael, Deluca, Joan
• Primary Examiner(s): CHANG, KENT WU
• Application Number:
  US09/494,976
• Time in Patent Office: 1,191 Days
• Field of Search: 345/7-9, 345/629, 345/630, 345/631, 345/632, 345/633, 345/634, 359/13, 359/629, 359/630, 348/239, 348/362, 353/28, 353/29, 353/97
• US Class Current: 345/8
• CPC Class Codes: G02B 30/22 of the stereoscopic type
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/371 for tracking viewers with different interocular distances; for tracking rotational head movements around the vertical axis
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A virtual reality system (200-323) stereoscopically projects a virtual reality images including a three dimensional image (245) having an interface image (250′) in a space observable by a user (100). The display system includes a substantially transparent display means (200) which also allows real images of real objects (850) to be combined or superimposed with the virtual reality images. Selective areas or characteristics of the real images are obstructed by a selective real image obstructer (860) to enhance viewing of selected virtual reality images while providing for viewing or real images or virtual images combined with real images in other viewing areas. The display system includes either a stereoscopic headset display system or a heads-up display system. The selective real images obstructer is a gray scale liquid crystal display included with the display system providing for adjustment of the size, shape and/or transparency of the obstruction of real images. The obstruction of real images may be adjusted in response to information for generating the virtual image, manual inputs or processing of real images by video cameras (310′ and 320′). Other selective real image obstructions include filtering a portion of the spectrum of visible light associated with the real images.

Claims

1. In a headset with a variable position real image obstruction, a method of enhancing viewing of a portion of real images viewed through the headset system comprising the steps of:

determining a position of a substantially bright portion of the real images;

selecting an obstruction position from a plurality of obstruction positions in response to said step of determining; and

generating a real image obstruction for a portion of the real images viewed through the headset system in response to said step of selecting, wherein the real image obstruction is substantially inclusive of the bright portion.

2. The headset system of claim 1 wherein the headset is a stereoscopic headset display system and wherein the real image obstruction generated by said step of generating is a stereoscopic real image obstruction and appears in substantial coincidence with the substantially bright portion of the real images.

3. The method according to claim 1 wherein the headset is a headset display system and is also able to display virtual images viewed in combination with the real images and the method further comprises the steps of:

generating a virtual image at a virtual image position;

selecting a second obstruction position from the plurality of obstruction positions in response thereto; and

generating a second real image obstruction for a second portion of the real images viewed through the headset system in response thereto, wherein the second real image obstruction is in substantial coincidence with the virtual image position, thereby enhancing viewing of the virtual image.

4. The method according to claim 1 wherein the real image obstruction is substantially inclusive of the real images and the method further comprises the steps of:

determining an amount of ambient light associated with the real images; and

modifying an amount of obstruction of the real image obstruction in response to the amount of ambient light.

5. The method according to claim 3 wherein the second real image obstruction is substantially inclusive of the real images and the method further comprises the steps of:

determining an amount of ambient light associated with the real images; and

modifying an amount of obstruction of the real image obstruction in response to the amount of ambient light.

6. The method according to claim 3 wherein the headset is a stereoscopic headset display system and wherein the virtual image includes a stereoscopic interface image appearing within an interface space viewable by a viewer of the stereoscopic headset display system, the method further comprising the step of:

determining an intersection of the interface space including the stereoscopic interface image and a physical selecting object having a real image viewable by the viewer of the stereoscopic headset display system; and

generating a control signal in response thereto.

7. The method according to claim 6 further wherein

said step of generating the second real image obstruction obstructs viewing of real images within the interface space while enabling viewing of the real image of the selecting object, thereby allowing the viewer to view the intersection of the selecting object with the stereoscopic interface image.

8. The method according to claim 6 wherein the selecting object corresponds to a finger of the viewer.

9. The method according to claim 3 wherein

said step of generating the virtual image generates the virtual image in response to an information signal, and

said step of generating the second real image obstruction further modifies at least a size, shape or location of the second real image obstruction in response to the information signal.

10. The method according to claim 3 wherein

said step of generating the virtual image generates the virtual image in response to an information signal, and

said step of generating the second real image obstruction further modifies at least an amount of obstruction of real images by the second real image obstruction in response to the information signal.

11. In a headset display system able to display virtual images viewed in combination with real images viewed through the headset display, a method comprising the steps of:

determining a position of a substantially bright portion of the real images;

generating a real image obstruction substantially inclusive of the bright portion in response to said step of determining;

generating a virtual image at a virtual image position; and

generating a second real image obstruction in substantial coincidence with the virtual image position wherein the real images not obstructed by the first or second real image obstructions are substantially unobstructed.

12. The method according to claim 11 wherein the real image obstruction is substantially inclusive of the real images and the method further comprises the steps of:

determining an amount of ambient light associated with the real images; and

modifying an amount of obstruction of the second real image obstruction in response to the amount of ambient light.

13. The method according to claim 11 wherein the headset display system is a stereoscopic headset display system and wherein the virtual image includes a stereoscopic interface image appearing within an interface space viewable by a viewer of the stereoscopic headset display system the method further comprising the step of:

determining an intersection of the interface space including the stereoscopic interface image and a physical selecting object having a real image viewable by the viewer of the stereoscopic headset display system; and

generating a control signal in response thereto.

14. The method according to claim 13 further wherein

said step of generating the second real image obstruction obstructs viewing of real images within the interface space while enabling viewing of the real image of the selecting object, thereby allowing the viewer to view the intersection of the selecting object with the stereoscopic interface image.

15. The method according to claim 11 wherein

said step of generating the virtual image generates the virtual image in response to an information signal, and

said step of generating the second real image obstruction further modifies at least a size, shape or location of the second real image obstruction in response to the information signal.

16. The method according to claim 11 wherein

said step of generating the virtual image generates the virtual image in response to an information signal, and

said step of generating the second real image obstruction further modifies at least an amount of obstruction of real images by the second real image obstruction in response to the information signal.

17. In a headset display system with a variable position real image obstruction and able to display virtual images viewed in combination with real images viewed through the headset display, a method comprising the steps of:

determining a position of a substantially bright portion of the real images;

selecting an obstruction position from a plurality of obstruction positions in response to said step of determining;

generating a real image obstruction for a portion of the real images viewed through the headset system in response to said step of selecting, wherein the real image obstruction is substantially inclusive of the bright portion; and

generating a virtual image viewable in combination with the real images.

18. The method according to claim 17 further comprising the steps of:

selecting a second obstruction position from the plurality of obstruction positions in response said step of generating the virtual image; and

generating a second real image obstruction in substantial coincidence with the virtual image position.

19. The method according to claim 17 wherein

said step of generating the virtual image generates the virtual image at a virtual image position appearing within an interface space viewable by a viewer of the headset display system, and the method further comprises the steps of:

determining an intersection of the interface space including the interface image and a physical selecting object having a real image viewable by the viewer of the headset display system; and

generating a control signal in response thereto.

20. The method according to claim 19 further comprising the step of

generating a second real image obstruction in substantial coincidence with the virtual image position.

21. The method according to claim 20 further wherein

said step of generating the second real image obstruction obstructs viewing of real images within the interface space while enabling viewing of the real image of the selecting object, thereby allowing the viewer to view the intersection of the selecting object with the stereoscopic interface image.

22. The method according to claim 17 wherein

said step of generating the virtual image generates virtual image in response to an information signal, and

said step of generating the second real image obstruction further modifies at least a size, shape or location of the second real image obstruction in response to the information signal.

23. The method according to claim 17 wherein

said step of generating the virtual image generates the virtual image in response to an information signal, and

said step of generating the second real image obstruction further modifies at least an amount of obstruction of real images by the second real image obstruction in response to the information signal.

24. A headset with a variable position real image obstruction for enhancing viewing of real images viewed through the headset comprising:

a position determiner for determining a position of a substantially bright portion of the real images and selecting an obstruction position from a plurality of obstruction positions in response thereto; and

an obstruction generator for generating a real image obstruction at the selected obstruction position substantially inclusive of the bright portion.

25. The headset of claim 24 wherein the real image obstruction is substantially inclusive of the real images and the headset further comprises

an ambient light determiner for determining an amount of ambient light associated with the real images, and wherein

said obstruction generator further modifies an amount of obstruction of the real image obstruction in response to the ambient light.

26. The headset of claim 24 wherein the headset is also able to display virtual images viewable in combination with the real images and the headset further comprising:

an image generator for generating a virtual image at a virtual image position, wherein

said obstruction generator generates a second real image obstruction in substantial coincidence with the virtual image position, thereby enhancing viewing of the virtual image.

27. The headset of claim 26 wherein the real image obstruction is substantially inclusive of the real images and the headset further comprises

an ambient light determiner for determining an amount of ambient light associated with the real images, and wherein

said obstruction generator further modifies an amount of obstruction of the second real image obstruction in response to the ambient light.

28. The headset according to claim 26 wherein the headset is a steroscopic headset and wherein the virtual image includes a sterescopic interface image appearing within an interface space viewable by a viewer of the headset, the headset further comprising

a monitor for determining an intersection of the interface space including the stereoscopic interface image and a physical selecting object having a real image viewable by the viewer of the stereoscopic headset display system and for generating a control signal in response thereto.

29. The headset according to claim 28 further wherein the second real image obstruction obstructs viewing of the real images within the interface space while enabling viewing of the real image of the selecting object, thereby allowing the viewer to view the intersection of the selecting object with the stereoscopic inteface image.