Method and system for stereo videoconferencing
First Claim
1. A stereo videoconferencing system for at least two participants in at least two separate locations, comprising:
- means in each location for providing a reference point;
means for sensing a position of each participant with respect to the reference point;
means for capturing at least two video images of each participant, each video image being from a different perspective;
means for computing a stereo pair of video images of each participant for each of the other participants using at least two video images and the respective positions of each of the other participants;
means for communicating the respective stereo pairs of video images of each participant to each of the other participants; and
means for assembling a stereo video display image for each of the participants, using the position data and the stereo pairs of video images.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for stereoscopic video teleconferencing provides an immersive virtual meeting experience. Each participant is surrounded by at least two video cameras. The system senses the position of each of the participants and uses this information to select, for each participant, camera pairs to capture a stereo pair of video images of each of the other participants. The system is adapted to isolate the image of each participant from the background. The system transforms the stereo pair images to adjust the perspective for the interocular spacing of each participant. The processed stereo pairs of video images are transmitted to the respective participants. For each participant, the system assembles a stereo video display image of a virtual meeting room, combining the stereo pair images of each of the other participants appropriately sized and positioned. Three-dimensional (3D) virtual objects can also be displayed and manipulated by participants.
126 Citations
30 Claims
-
1. A stereo videoconferencing system for at least two participants in at least two separate locations, comprising:
-
means in each location for providing a reference point;
means for sensing a position of each participant with respect to the reference point;
means for capturing at least two video images of each participant, each video image being from a different perspective;
means for computing a stereo pair of video images of each participant for each of the other participants using at least two video images and the respective positions of each of the other participants;
means for communicating the respective stereo pairs of video images of each participant to each of the other participants; and
means for assembling a stereo video display image for each of the participants, using the position data and the stereo pairs of video images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for providing stereo videoconferencing for at least two participants in at least two separate locations, comprising steps of:
-
providing a reference point at each location;
sensing a relative position of each participant with respect to the reference point;
capturing at least two video images of each participant, each video image being captured from a different perspective;
computing a stereo pair of video images of each participant for each of the other participants;
communicating the respective stereo pairs of video images of each participant to each of the other participants; and
assembling a stereo video display image for each of the participants, using the position data and the stereo pairs of video images. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A system for integrating and synchronizing multi-source data, images and sounds to provide a single seamless, immersive videoconferencing environment for a plurality of participants respectively located in a plurality of different locations, comprising:
-
a position sensor in each location that provides a reference point and senses a position of each of the participants with respect to the respective reference points;
at least two cameras for simultaneously capturing at least two video images of each participant, each video image being captured from a different perspective;
at least one microphone for capturing sound data from each location;
a processor for computing a stereo pair of video images of each participant and stereo sound data for each of the other participants using at least two video images, the sound data, and the respective positions of each of the other participants, and for communicating the respective stereo pairs of video images and the stereo sound data to a corresponding processor for each of the other participants; and
a processor for integrating and synchronizing the image and the stereo sound data received from each of the other participants to provide a seamless, immersive videoconferencing environment for each of the participants. - View Dependent Claims (24, 25, 26, 28, 29, 30)
-
-
27. A method of integrating and synchronizing multi-source data, images and sounds to provide a single seamless, immersive videoconferencing environment for a plurality of participants respectively located in a plurality of different locations, comprising steps of:
-
determining a position of each participant with respect to a reference point in each of the respective locations;
simultaneously capturing at least two video images of each participant, each video image being captured from a different perspective;
capturing sound data at each location using at least one microphone;
computing a stereo pair of video images of each participant and stereo sound data for each of the other participants using at least two video images, the sound data, and the respective positions of each of the other participants, and communicating the respective stereo pairs of video images and the stereo sound data to a processor for each of the other participants; and
integrating and synchronizing the image and the stereo sound data received from each of the other participants to provide a seamless, immersive videoconferencing environment for the respective participants.
-
Specification