Systems And Methods For Providing Personal Video Services
First Claim
1. A method of video conferencing, the method comprising the steps of:
- detecting a human face of a video conference participant depicted in portions of a video stream;
creating by explicitly modeling one or more explicit object models to model the face of the video conference participant;
generating one or more implicit object models relative to parameters obtained from the explicit object models to facilitate creation of a compact encoding of the video conference participant'"'"'s face; and
using the implicit object models, creating a photorealistic avatar representation of the video conference participant.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for processing video are provided. Video compression schemes are provided to reduce the number of bits required to store and transmit digital media in video conferencing or videoblogging applications. A photorealistic avatar representation of a video conference participant is created. The avatar representation can be based on portions of a video stream that depict the conference participant. A face detector is used to identify, track and classify the face. Object models including density, structure, deformation, appearance and illumination models are created based on the detected face. An object based video compression algorithm, which uses machine learning face detection techniques, creates the photorealistic avatar representation from parameters derived from the density, structure, deformation, appearance and illumination models.
-
Citations
20 Claims
-
1. A method of video conferencing, the method comprising the steps of:
-
detecting a human face of a video conference participant depicted in portions of a video stream; creating by explicitly modeling one or more explicit object models to model the face of the video conference participant; generating one or more implicit object models relative to parameters obtained from the explicit object models to facilitate creation of a compact encoding of the video conference participant'"'"'s face; and using the implicit object models, creating a photorealistic avatar representation of the video conference participant. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A computer program product for facilitating video conferencing, the computer program product being embodied on a computer-readable medium and comprising code configured so as when executed on a transmitting terminal to perform operations of:
-
creating by explicitly modeling one or more explicit object models to model a detected face of a video conference participant; generating one or more implicit object models relative to parameters obtained from the explicit object models to facilitate creation of a compact encoding of the video conference participant'"'"'s face; and using the implicit object models, creating a photorealistic avatar representation of the video conference participant.
-
-
19. A video conferencing system comprising:
-
a face detector configured to detect a face of a video conference participant in a video stream; a calibrator configured to generate a calibration model calibrating the face of the video conference participant; an explicit object modeler configured to generate one or more explicit object models, in combination with the calibrator and face detector, the explicit object models modeling portions of the video stream depicting the face of the video conference participant based on the calibration model; an implicit object modeler configured to build one or more implicit object models relative to parameters from the explicit object models to facilitate creation of a compact encoding of the participant'"'"'s face; and the system operable to generate a photorealistic avatar representation of the video conference participant from the implicit models.
-
-
20. A method of video conferencing, the method comprising the steps of:
-
generating explicit object models to model a human face of a video conference participant depicted in portions of a video stream; using parameters from the explicit object models, generating implicit object models to create a photorealistic avatar representation of the video conference participant, where the explicit object model parameters are used to define expectations for the implicit object models regarding how lighting interacts with a structure of the face of the video conference participant.
-
Specification