Dual reality system

• US 6,498,618 B2
• Filed: 05/02/2001
• Issued: 12/24/2002
• Est. Priority Date: 02/24/1998
• Status: Expired due to Fees

• Current Assignee: Erik A. Martin, Phillip C. Wilson
• Original Assignee: Erik A. Martin, Phillip C. Wilson
• Inventors: Wilson, Phillip C., Martin, Erik A.
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US09/847,128
• Publication Number:
  US 20020005891A1
• Time in Patent Office: 601 Days
• Field of Search: H04/N 1.302, H04/N 1.500, 345/116, 348/42, 348/47, 348/53, 348/139, 348/333.12, 382/106, 382/154, 702/150, 702/151, 702/152, 702/153
• US Class Current: 348/47
• CPC Class Codes: G01S 5/163 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/38 for tracking vertical translational head movements
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 2013/0077 Colour aspects
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0096 : Synchronisation or controlling aspects

Abstract

An apparatus for merging real and virtual images in which points in three dimensions of an actual scene are obtained and selected in a random fashion and in a number sufficient to track the movement of the three dimensional scene relative to an observer wearing the apparatus. Updating of selected points occurs responsive to movement of a video camera pair observing the actual scene. The position and orientation of the unit housing the video camera pair is utilized to properly merge a generated virtual image with the real image. Selection of points and orientation of the unit relative to a three dimensional real image are obtained in real time. Microprocessor-based apparatus is utilized to perform the method of the invention.

Claims

1. A wearable visual environment integration device comprising:

a) an image capture means, including a camera pair, for capturing an observed image from a visual perspective of a wearer wearing said integration device;

b) a visual navigation means for determining a position and orientation based upon a visual perspective of said wearer from said observed image

c) image generation means for generating a computer-generated image, and

d) a display means for displaying a composite image to said wearer responsive to said image capture means and said image generation means whereby said computer-generated image is visually integrated with said observed image consistent with the derived position and orientation of the visual perspective of said wearer.

2. The wearable visual environment integration device of claim 1, whereby said observed image is a stereoscopic image.

3. The wearable visual environment integration device of claim 2, wherein said computer-generated image is a stereoscopic image.

4. The wearable visual environment integration device of claim 3, wherein said composite image is stereoscopic image and displayed to said wearer stereoscopically.

5. The wearable visual environment integration device of claim 4, wherein said device is contiguous with a head of said wearer.

6. The wearable visual environment integration device of claim 4, wherein said device is conforms with a head of said wearer.

7. The wearable visual environment integration device of claim 5, wherein the movement of said device moves with the movement of the head of said wearer.

8. The wearable visual environment integration device of claim 7, further including a housing such that the movement of the head of said wearer causes a substantially similar movement of said housing.

9. The wearable visual environment integration device of claim 8, wherein said housing means substantially houses said image generation means.

10. The wearable visual environment integration device of claim 8, wherein said housing substantially houses said visual navigation means.