Gaze correction of multi-view images
First Claim
1. A device for adjusting multi-view images of a head to correct gaze, the device comprising an image processor arranged to process the multi-view images of a head by:
- in each image, identifying image patches containing the left and right eyes of the head, respectively;
in respect of the image patches containing the left eyes of the head in each image of the multi-view images, and also in respect of the image patches containing the right eyes of the head in each image of the multi-view images, performing the steps of;
deriving a feature vector from plural local image descriptors of the image patch in at least one image of the multi-view images; and
deriving a displacement vector field representing a transformation of an image patch, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector; and
adjusting each image of the multi-view images by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field.
7 Assignments
0 Petitions
Accused Products
Abstract
Gaze is corrected by adjusting multi-view images of a head. Image patches containing the left and right eyes of the head are identified and a feature vector is derived from plural local image descriptors of the image patch in at least one image of the multi-view images. A displacement vector field representing a transformation of an image patch is derived, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector produced by machine learning. The multi-view images are adjusted by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field.
309 Citations
15 Claims
-
1. A device for adjusting multi-view images of a head to correct gaze, the device comprising an image processor arranged to process the multi-view images of a head by:
-
in each image, identifying image patches containing the left and right eyes of the head, respectively; in respect of the image patches containing the left eyes of the head in each image of the multi-view images, and also in respect of the image patches containing the right eyes of the head in each image of the multi-view images, performing the steps of; deriving a feature vector from plural local image descriptors of the image patch in at least one image of the multi-view images; and deriving a displacement vector field representing a transformation of an image patch, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector; and adjusting each image of the multi-view images by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
Specification