Correction of the gaze direction for a videophone
First Claim
1. A method for computer based altering a gaze direction of a face represented in a digital image, of a video image sequence describing persons communicating with each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person'"'"'s gaze direction and a camera axis, the method comprising the steps of:
- a) segmenting pupils and eyeballs of a depicted face by a computer;
b) displacing resulting segments corresponding to said pupils in an image plane and thereby computationally freeing areas previously occupied by the displaced segments;
c) filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and
d) displaying said image of a face having an altered gaze direction.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for correcting the gaze direction of persons in a digital image where an angular error between the gaze direction and the camera axis is determined. The pupils of both eyes in the image are then segmented and displaced within the image plane. Areas which have become free are filled in using the color of the eyeball. Any interfering edges produced are attenuated in a subsequent processing step (e.g., by using a low-pass filter). The method is also applicable for a sequence of images over time.
-
Citations
7 Claims
-
1. A method for computer based altering a gaze direction of a face represented in a digital image, of a video image sequence describing persons communicating with each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person'"'"'s gaze direction and a camera axis, the method comprising the steps of:
-
a) segmenting pupils and eyeballs of a depicted face by a computer; b) displacing resulting segments corresponding to said pupils in an image plane and thereby computationally freeing areas previously occupied by the displaced segments; c) filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and d) displaying said image of a face having an altered gaze direction. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method for computer based altering a gaze direction of a face represented in a digital image in a video image sequence over time describing persons communicating to each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person'"'"'s gaze direction and a camera axis, the method comprising the steps of:
-
a) tracking pupils and eyeballs of a depicted face with regard to a change over time of the position of said pupils and eyeballs in an image plane; b) determining an instantaneous position of said pupils and eyeballs in said image plane using predicted estimated values; c) computationally segmenting said pupils and eyeballs; d) displacing resulting segments corresponding to said pupils in said image plane and thereby freeing areas previously occupied by the displaced segments; e) computationally filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and f) displaying said image of a face having an altered gaze direction. - View Dependent Claims (7)
-
Specification