Controlled three-dimensional communication endpoint
First Claim
1. A method for simulating an in-person communication, comprising:
- capturing three-dimensional video of a local participant at a local endpoint, wherein capturing the three-dimensional video is performed in a controlled manner at the local endpoint using a plurality of camera pods that capture both RGB data and depth information about the local participant from 360 degrees around the local participant;
creating a local geometric proxy for the local participant using the captured three-dimensional video;
generating a scene geometry having correct eye gaze and conversational geometry consistent with an in-person communication;
placing the local geometric proxy in the scene geometry to create a virtual environment; and
transmitting the local geometric proxy and the scene geometry to a remote participant at a remote endpoint, wherein the local endpoint and the remote endpoint are at different physical locations to simulate an in-person communication between the local participant and the remote participant.
2 Assignments
0 Petitions
Accused Products
Abstract
A controlled three-dimensional (3D) communication endpoint system and method for simulating an in-person communication between participants in an online meeting or conference and providing easy scaling of a virtual environment when additional participants join. This gives the participants the illusion that the other participants are in the same room and sitting around the same table with the viewer. The controlled communication endpoint includes a plurality of camera pods that capture video of a participant from 360 degrees around the participant. The controlled communication endpoint also includes a display device configuration containing display devices placed at least 180 degrees around the participant and display the virtual environment containing geometric proxies of the other participants. Placing the participants at a round virtual table and increasing the diameter of the virtual table as additional participants are added easily achieves scalability.
80 Citations
20 Claims
-
1. A method for simulating an in-person communication, comprising:
-
capturing three-dimensional video of a local participant at a local endpoint, wherein capturing the three-dimensional video is performed in a controlled manner at the local endpoint using a plurality of camera pods that capture both RGB data and depth information about the local participant from 360 degrees around the local participant; creating a local geometric proxy for the local participant using the captured three-dimensional video; generating a scene geometry having correct eye gaze and conversational geometry consistent with an in-person communication; placing the local geometric proxy in the scene geometry to create a virtual environment; and transmitting the local geometric proxy and the scene geometry to a remote participant at a remote endpoint, wherein the local endpoint and the remote endpoint are at different physical locations to simulate an in-person communication between the local participant and the remote participant. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 20)
-
-
15. A controlled three-dimensional (3D) endpoint system, comprising:
-
a plurality of camera pods disposed around a first endpoint to capture a 3D video of a participant at the first endpoint such that 360 degrees around the participant is captured by the plurality of camera pods; a geometric proxy for the participant obtained by adding captured RGB data and captured depth information from the 3D video; a scene geometry having correct eye gaze and conversational geometry consistent with an in-person communication to create a virtual environment; and a display device configuration having a plurality of display devices situated at a second endpoint such that the display devices are placed at least 180 degrees around a viewer at the second endpoint to enable the viewer to view the participant through a virtual viewpoint, where the viewer'"'"'s perspective of the participant in the virtual environment changes based on a position and orientation of the viewer'"'"'s head. - View Dependent Claims (16)
-
-
17. A method for scaling a number of participants in an online meeting, comprising:
-
organizing a controlled capture environment at endpoints having a plurality of camera pods disposed around each of the endpoints; capturing three-dimensional video of each participant at the each endpoint using the plurality of camera pods; creating geometric proxies for each of the participants; generating scene geometry based on the number of participants, the scene geometry including a virtual table; rendering each of the geometric proxies to each other in the scene geometry that is consistent with an in-person communication; placing the rendered geometric proxies in the scene geometry around the virtual table to create a virtual environment; organizing a controlled viewing environment at the endpoints having a display device that wraps around at least 180 degrees of the participants at the endpoints; displaying the virtual environment to the participants in the controlled viewing environment using the display device; changing a virtual viewpoint of participants viewing the display device based on a position and orientation of each participant'"'"'s head; increasing the number of participants such that additional participants are added; and increasing a size of the virtual table to accommodate the additional participants. - View Dependent Claims (18, 19)
-
Specification