System and method for 3D telepresence
First Claim
Patent Images
1. A method comprising:
- receiving a 3D-data stream depicting a first participant and a live environment of the first participant;
rendering a common virtual meeting space having a virtual window for display of the first participant;
rendering a first perspective projection stream of the first participant and the live environment of the first participant from the received 3D-data stream from a first virtual viewpoint within the common virtual meeting space, the rendering the live environment of the first participant using depth cues derived from the received 3D-data stream to enable perspective changes as a function of changing viewpoint, wherein the changing viewpoint is altered by rotating a view about an axis perpendicular to a floor and approximately parallel to an axis of a viewpoint source; and
a transmission unit configured to transmit the rendered first and second perspectives for display;
displaying the rendered first perspective projection stream in the virtual window for the first virtual viewpoint;
rendering a second perspective projection stream of the first participant and the live environment of the first participant from the received 3D-data stream from a second virtual viewpoint within the common virtual meeting space; and
displaying the rendered second perspective projection stream in the virtual window for the second virtual viewpoint.
3 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are described that enable a 3D telepresence. In an exemplary method, a 3D image stream is generated of a first participant in a virtual meeting. A virtual meeting room is generated. The virtual meeting room includes a virtual window, and the 3D image stream is reconstructed in the virtual window. The first participant thus appears as a 3D presence within the virtual window. The virtual meeting room may also include virtual windows providing 3D views of other participants in the virtual meeting and may further include avatars of other meeting participants and/or of the first meeting participant.
14 Citations
27 Claims
-
1. A method comprising:
-
receiving a 3D-data stream depicting a first participant and a live environment of the first participant; rendering a common virtual meeting space having a virtual window for display of the first participant; rendering a first perspective projection stream of the first participant and the live environment of the first participant from the received 3D-data stream from a first virtual viewpoint within the common virtual meeting space, the rendering the live environment of the first participant using depth cues derived from the received 3D-data stream to enable perspective changes as a function of changing viewpoint, wherein the changing viewpoint is altered by rotating a view about an axis perpendicular to a floor and approximately parallel to an axis of a viewpoint source; and a transmission unit configured to transmit the rendered first and second perspectives for display; displaying the rendered first perspective projection stream in the virtual window for the first virtual viewpoint; rendering a second perspective projection stream of the first participant and the live environment of the first participant from the received 3D-data stream from a second virtual viewpoint within the common virtual meeting space; and displaying the rendered second perspective projection stream in the virtual window for the second virtual viewpoint. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 19, 20, 21, 22)
-
-
10. An apparatus comprising:
-
a processor configured to receive a 3D-data stream depicting a first participant and a live environment of the first participant, and to generate first and second perspective projection streams of the first participant and the live environment of the first participant based respectively on first and second virtual viewpoints in a common virtual meeting space; a rendering system configured to render first and second perspectives of the virtual meeting space, the first and second perspectives respectively displaying the first and second perspective projection streams in a virtual window in the virtual meeting space, the rendering system rendering the live environment of the first participant using depth cues derived from the received 3D-data stream to enable perspective changes as a function of changing viewpoint, wherein the changing viewpoint is altered by rotating a view about an axis perpendicular to a floor and approximately parallel to an axis of a viewpoint source; and a transmission unit configured to transmit the rendered first and second perspectives for display. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
23. A method comprising:
-
receiving a 3D-data stream depicting a first participant and a live environment including a background of the first participant; rendering a common virtual meeting space, the common virtual meeting space connecting a plurality of reconstructed 3D views and having a virtual window for display of the first participant; rendering a first perspective projection stream of the first participant and the live environment including the background of the first participant from the received 3D-data stream from a first virtual viewpoint within the common virtual meeting space, the rendering the live environment of the first participant applying at least a plurality of depth cues, parallax data, and perspective data derived from the 3D-data stream, the plurality of depth cues, parallax data, and perspective data providing an immersive experience by providing perspective changes as a function of changing virtual viewpoint, wherein the changing virtual viewpoint is altered by rotating a view about an axis perpendicular to a floor and approximately parallel to an axis of a viewpoint source; displaying the rendered first perspective projection stream in the virtual window for the first virtual viewpoint; rendering a second perspective projection stream of the first participant and the live environment including the background of the first participant from the received 3D-data stream from a second virtual viewpoint within the common virtual meeting space, the second virtual viewpoint being a changeable arbitrary virtual viewpoint from within the common virtual meeting space; and displaying the rendered second perspective projection stream in the virtual window for the second virtual viewpoint. - View Dependent Claims (24, 25, 26, 27)
-
Specification