Gaze Intent Estimation for Retargeting of Characters
First Claim
1. In a computer aided animation system, a method for retargeting the gaze of a rendered image comprising:
- determining an eye-line of an eye model using a computer system;
determining a gaze-object at which the eye model is directed in response to the eye-line using the computer system;
determining a relative change in position of the gaze-object relative to the eye model using the computer system;
adjusting the eye-line of the eye model to remain on the gaze-object using the computer system;
rendering an image of the eye model in response to the adjusted eye-line of the eye model using the computer system;
displaying the rendered image with adjusted image of the eye on an output device using the computer system.
2 Assignments
0 Petitions
Accused Products
Abstract
Any image capturing system, and a method to use same, that includes one or more image capturing devices that have known and fixed positions relative to one another and the eye of a subject, wherein the image capturing devices capture a plurality of images of eye of a subject during a performance is disclosed. The images of the eye, along with the known and fixed relative positions of the image capturing devices are used define eye-lines for the eye of the subject. The eye-lines can then be used to manually or automatically retarget the eye of a rendered or animated figure based on the performance of the subject to retarget the gaze intent of the rendered or animated figure within a scene.
-
Citations
20 Claims
-
1. In a computer aided animation system, a method for retargeting the gaze of a rendered image comprising:
-
determining an eye-line of an eye model using a computer system; determining a gaze-object at which the eye model is directed in response to the eye-line using the computer system; determining a relative change in position of the gaze-object relative to the eye model using the computer system; adjusting the eye-line of the eye model to remain on the gaze-object using the computer system; rendering an image of the eye model in response to the adjusted eye-line of the eye model using the computer system; displaying the rendered image with adjusted image of the eye on an output device using the computer system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An apparatus for retargeting the gaze of rendered images comprising:
-
a plurality of imaging devices configured to maintain a constant position and orientation relative to the eyes of a subject actor; a computer system in communication with the plurality of imaging devices, wherein the computer system comprises one or more digital eyes models comprising a plurality of eye-lines usable to retarget the one or more digital eye models. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. In a computer aided animation system, a method for retargeting the gaze of a rendered figure in real-time comprising:
-
retrieving an eye-line of an eye model to a designated gaze-object, determining a relative change in position of the gaze-object relative to the subject actor; adjusting the eye-line of the eye model to remain on the designated gaze-object after the change in position; rendering the eye model for the rendered figure in response to the adjusted eye-line of the eye model; displaying the rendered figure and the adjusted rendered eye model on an output device. - View Dependent Claims (18, 19, 20)
-
Specification