Facial pose improvement with perspective distortion correction
First Claim
1. A method of reducing distortion in an image, the method comprising:
- receiving a captured image corresponding to a video sequence, the video sequence comprising one or more past images to the captured image and zero or more future images to the captured image;
determining an orientation of a camera used to generate the captured image;
computing a warp parameter based on the determined orientation of the camera;
filtering the warp parameter in conjunction with either or both of past images and future images from the video sequence;
computing an orientation indicator based, at least in part, on a difference between the determined orientation and a preferred orientation of the camera, wherein the orientation indicator indicates an orientation that, when applied to the camera, would orient the camera to more closely approximate the preferred orientation;
applying, based on the filtered warp parameter, one or more warp techniques to the captured image to generate a distortion corrected image; and
associating the orientation indicator with the distortion corrected image.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods, systems, and apparatus are presented for reducing distortion in an image, such as a video image. A video image can be captured by an image capture device, e.g. during a video conferencing session. Distortion correction processing, such as the application of one or more warping techniques, can be applied to the captured image to produce a distortion corrected image, which can be transmitted to one or more participants. The warping techniques can be performed in accordance with one or more warp parameters specifying a transformation of the captured image. Further, the warp parameters can be generated in accordance with an orientation of the image capture device, which can be determined based on sensor data or can be a fixed value. Additionally or alternatively, the warp parameters can be determined in accordance with a reference image or model to which the captured image should be warped.
12 Citations
34 Claims
-
1. A method of reducing distortion in an image, the method comprising:
-
receiving a captured image corresponding to a video sequence, the video sequence comprising one or more past images to the captured image and zero or more future images to the captured image; determining an orientation of a camera used to generate the captured image; computing a warp parameter based on the determined orientation of the camera; filtering the warp parameter in conjunction with either or both of past images and future images from the video sequence; computing an orientation indicator based, at least in part, on a difference between the determined orientation and a preferred orientation of the camera, wherein the orientation indicator indicates an orientation that, when applied to the camera, would orient the camera to more closely approximate the preferred orientation; applying, based on the filtered warp parameter, one or more warp techniques to the captured image to generate a distortion corrected image; and associating the orientation indicator with the distortion corrected image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:
-
receiving a captured image depicting a face, wherein the captured image is generated by a camera and corresponds to a video sequence, the video sequence comprising one or more past images to the captured image and zero or more future images to the captured image; analyzing sensor data to determine an orientation of the camera; computing one or more warp parameters based on the determined orientation of the camera; filtering the one or more warp parameter in conjunction with either or both of past images and future images from the video sequence; computing an orientation indicator based, at least in part, on a difference between the determined orientation and a preferred orientation of the camera, wherein the orientation indicator indicates an orientation that, when applied to the camera, would orient the camera to more closely approximate the preferred orientation; warping at least a portion of the captured image, based on the filtered one or more warp parameters, to generate a distortion corrected image; and associating the orientation indicator with the distortion corrected image. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A system comprising:
-
a camera configured to capture video images corresponding to a video sequence, the video sequence comprising one or more past images to the captured image and zero or more future images to the captured image; a position sensor; and a computing system coupled to the camera and the position sensor, the computing system including one or more processors configured to perform operations comprising; receiving, from the camera, a captured video image; receiving sensor data from the position sensor; analyzing the received sensor data to determine an orientation of the camera; computing a warp parameter based on the determined orientation of the camera; filtering the warp parameter in conjunction with either or both of past video images and future video images from the video sequence; computing an orientation indicator based, at least in part, on a difference between the determined orientation and a preferred orientation of the camera, wherein the orientation indicator indicates an orientation that, when applied to the camera, would orient the camera to more closely approximate the preferred orientation; applying, based on the filtered warp parameter, one or more warp techniques to the captured video image to generate a distortion corrected image; and associating the orientation indicator with the distortion corrected image. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. A method of reducing distortion in an image, the method comprising:
-
receiving a captured image corresponding to a video sequence, the video sequence comprising one or more past images to the captured image and zero or more future images to the captured image; receiving sensor data from a position sensor associated with a camera used to generate the captured image; identifying one or more registration points associated with the captured image; comparing, based on the identified one or more registration points, the captured image with a reference image; determining, in response to the comparing, one or more warp parameters; filtering the one or more warp parameter in conjunction with either or both of past video images and future video images from the video sequence; determining, based at least in part on the sensor data, an orientation indicator, wherein the orientation indicator indicates an orientation that, when applied to the camera, would orient the camera to more closely approximate a preferred orientation; applying, based on the filtered one or more warp parameters, one or more warp techniques to the captured image to generate a distortion corrected image; and associating the orientation indicator with the distortion corrected image. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30)
-
-
31. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:
-
receiving a captured image depicting a face, wherein the captured image corresponds to a video sequence, the video sequence comprising one or more past images to the captured image and zero or more future images to the captured image; receiving sensor data from a position sensor associated with a camera used to generate the captured image; identifying one or more registration points associated with the captured image; comparing, based on the identified one or more registration points, the captured image with the reference image; determining, in response to the comparing, one or more warp parameters; filtering the one or more warp parameter in conjunction with either or both of past video images and future video images from the video sequence; determining, based at least in part on the sensor data, an orientation indicator, wherein the orientation indicator indicates an orientation that, when applied to the camera, would orient the camera to more closely approximate a preferred orientation; applying, based on the filtered one or more warp parameters, one or more warp techniques to the captured image to generate a distortion corrected image; and associating the orientation indicator with the distortion corrected image. - View Dependent Claims (32, 33, 34)
-
Specification