COMBINED STEREO CAMERA AND STEREO DISPLAY INTERACTION
First Claim
1. A system, comprising:
- a stereo image-capturing device configured to capture images of a user;
a plurality of trackers configured to track movements of the user based on the captured images;
an event generator configured to generate an event stream associated with the user movements;
an event processor in a virtual-world client configured to map the event stream to state changes in the virtual world, wherein the event processor comprises a model combiner configured to combine output from the plurality of trackers based on one or more models of the user and/or the user'"'"'s surroundings;
a virtual-reality application with a model of a real-world scene;
one or more three-dimensional (3D) displays configured to display a model of the real-world scene; and
one or more augmented-reality clients configured to display information overlaid on a video stream of the real-world scene.
1 Assignment
0 Petitions
Accused Products
Abstract
One embodiment of the present invention provides a system that facilitates interaction between a stereo image-capturing device and a three-dimensional (3D) display. The system comprises a stereo image-capturing device, a plurality of trackers, an event generator, an event processor, and a 3D display. During operation, the stereo image-capturing device captures images of a user. The plurality of trackers track movements of the user based on the captured images. Next, the event generator generates an event stream associated with the user movements, before the event processor in a virtual-world client maps the event stream to state changes in the virtual world. The 3D display then displays an augmented reality with the virtual world.
34 Citations
24 Claims
-
1. A system, comprising:
-
a stereo image-capturing device configured to capture images of a user; a plurality of trackers configured to track movements of the user based on the captured images; an event generator configured to generate an event stream associated with the user movements; an event processor in a virtual-world client configured to map the event stream to state changes in the virtual world, wherein the event processor comprises a model combiner configured to combine output from the plurality of trackers based on one or more models of the user and/or the user'"'"'s surroundings; a virtual-reality application with a model of a real-world scene; one or more three-dimensional (3D) displays configured to display a model of the real-world scene; and one or more augmented-reality clients configured to display information overlaid on a video stream of the real-world scene. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer-implemented method, comprising:
-
capturing, by a computer, images of a user; tracking movements of the user based on the captured images by a plurality of trackers; generating an event stream associated with the user movements; mapping the event stream to state changes in a virtual world; combining output from the plurality of trackers based on one or more models of the user and/or the user'"'"'s surroundings maintaining a model of a real-world scene; displaying a model of the real-world scene and information overlaid on a video stream of the real-world scene using a three-dimensional (3D) display. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory computer-readable storage medium storing instructions which when executed by one or more computers cause the computer(s) to execute a method, the method comprising:
-
capturing, by a computer, images of a user; tracking movements of the user based on the captured images by a plurality of trackers; generating an event stream associated with the user movements; mapping the event stream to state changes in a virtual world; combining output from the plurality of trackers based on one or more models of the user and/or the user'"'"'s surroundings maintaining a model of a real-world scene; displaying a model of the real-world scene and information overlaid on a video stream of the real-world scene using a three-dimensional (3D) display. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification