Method and system for stereo videoconferencing
First Claim
1. A stereo videoconferencing system for at least two participants in at least two separate locations, comprising:
- means in each location for providing a reference point;
means for sensing a position of each participant with respect to the reference point;
means for capturing at least two video images of each participant, each video image being from a different perspective;
means for computing a stereo pair of video images of each participant for each of the other participants using at least two video images and the respective positions of each of the other participants;
means for communicating the respective stereo pairs of video images of each participant to each of the other participants; and
means for assembling a stereo video display image for each of the participants, using the position data and the stereo pairs of video images.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for stereoscopic video teleconferencing provides an immersive virtual meeting experience. Each participant is surrounded by at least two video cameras. The system senses the position of each of the participants and uses this information to select, for each participant, camera pairs to capture a stereo pair of video images of each of the other participants. The system is adapted to isolate the image of each participant from the background. The system transforms the stereo pair images to adjust the perspective for the interocular spacing of each participant. The processed stereo pairs of video images are transmitted to the respective participants. For each participant, the system assembles a stereo video display image of a virtual meeting room, combining the stereo pair images of each of the other participants appropriately sized and positioned. Three-dimensional (3D) virtual objects can also be displayed and manipulated by participants.
161 Citations
30 Claims
-
1. A stereo videoconferencing system for at least two participants in at least two separate locations, comprising:
-
means in each location for providing a reference point;
means for sensing a position of each participant with respect to the reference point;
means for capturing at least two video images of each participant, each video image being from a different perspective;
means for computing a stereo pair of video images of each participant for each of the other participants using at least two video images and the respective positions of each of the other participants;
means for communicating the respective stereo pairs of video images of each participant to each of the other participants; and
means for assembling a stereo video display image for each of the participants, using the position data and the stereo pairs of video images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
means for creating a virtual model of one or more three-dimensional objects;
means for computing a stereo pair of video images of the virtual model for each of the participants, using position data of respective participants and the virtual model, each stereo pair of video images representative of a perspective view of the virtual model from a virtual view point of the each of the respective participants.
-
-
10. The system as claimed in claim 9, wherein one of the three-dimensional objects is a virtual meeting room.
-
11. The system as claimed in claim 9, further comprising:
-
means for manipulating the virtual model; and
means for using virtual model manipulation information to compute the stereo pair of video images of the virtual model.
-
-
12. A method for providing stereo videoconferencing for at least two participants in at least two separate locations, comprising steps of:
-
providing a reference point at each location;
sensing a relative position of each participant with respect to the reference point;
capturing at least two video images of each participant, each video image being captured from a different perspective;
computing a stereo pair of video images of each participant for each of the other participants;
communicating the respective stereo pairs of video images of each participant to each of the other participants; and
assembling a stereo video display image for each of the participants, using the position data and the stereo pairs of video images. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
creating a virtual model of one or more three-dimensional objects;
computing a stereo pair of video images of the virtual model for each of the participants, using position data related to each of the respective participants and position data related to the virtual model, each stereo pair of video images representative of a perspective view of the virtual model from a virtual view point of each of the respective participants.
-
-
21. The method as claimed in claim 20, wherein one of the three-dimensional objects is a virtual meeting room.
-
22. The method as claimed in claim 20, further comprising steps of:
-
manipulating the virtual model; and
using virtual model manipulation information in the step of computing the stereo pair of video images of the virtual model in order to display the virtual model in a position resulting from the manipulation.
-
-
23. A system for integrating and synchronizing multi-source data, images and sounds to provide a single seamless, immersive videoconferencing environment for a plurality of participants respectively located in a plurality of different locations, comprising:
-
a position sensor in each location that provides a reference point and senses a position of each of the participants with respect to the respective reference points;
at least two cameras for simultaneously capturing at least two video images of each participant, each video image being captured from a different perspective;
at least one microphone for capturing sound data from each location;
a processor for computing a stereo pair of video images of each participant and stereo sound data for each of the other participants using at least two video images, the sound data, and the respective positions of each of the other participants, and for communicating the respective stereo pairs of video images and the stereo sound data to a corresponding processor for each of the other participants; and
a processor for integrating and synchronizing the image and the stereo sound data received from each of the other participants to provide a seamless, immersive videoconferencing environment for each of the participants. - View Dependent Claims (24, 25, 26, 27, 28, 29)
-
-
30. A method of integrating and synchronizing multi-source data, images and sounds to provide a single seamless, immersive videoconferencing environment for a plurality of participants respectively located in a plurality of different locations, comprising steps of:
-
determining a position of each participant with respect to a reference point in each of the respective locations;
simultaneously capturing at least two video images of each participant, each video image being captured from a different perspective;
capturing sound data at each location using at least one microphone;
computing a stereo pair of video images of each participant and stereo sound data for each of the other participants using at least two video images, the sound data, and the respective positions of each of the other participants, and communicating the respective stereo pairs of video images and the stereo sound data to a processor for each of the other participants; and
integrating and synchronizing the image and the stereo sound data received from each of the other participants to provide a seamless, immersive videoconferencing environment for the respective participants.
-
Specification