Virtual Viewpoint for a Participant in an Online Communication

• US 20180089884A1
• Filed: 12/04/2017
• Published: 03/29/2018
• Est. Priority Date: 05/31/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Smith, Yancey Christopher, Lang, Eric G., Zhang, Zhengyou, Huitema, Christian F.
• Granted Patent: US 10,325,400 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2210/56 Particle system, point based geometry or rendering
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/246 Calibration of cameras
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04S 2400/15 Aspects of sound capture and related signal processing for recording or reproduction

Abstract

Implementations provide an in-person communication experience by generating a changable virtual viewpoint for a participant in an online communication. For instance, techniques described herein capture visual data about participants in an online communication, and create a realistic geometric proxy from the visual data. A virtual scene geometry is generated that mimics an arrangement of an in-person meeting for the online communication. According to various implementations, a virtual viewpoint displays a changing virtual viewpoint, such as based on a change in position of a participants face.

Claims

1. A system comprising:

one or more processors; and

one or more computer-readable storage media storing instructions that are executable by the one or more processors to perform operations including;

generating a scene geometry including a geometric proxy for a particular participant and a different geometric proxy for a different participant in an online communication, the scene geometry visually simulating an in-person conversation; and

causing a virtual viewpoint to be displayed for the particular participant that includes the different geometric proxy for the different participant along with a background that is part of the scene geometry, the virtual viewpoint being displayed based on a detected position of the particular participant'"'"'s face such that a change in the detected position of the particular participant'"'"'s face causes a change in the virtual viewpoint of the different geometric proxy of the different participant.