Method and system generating an avatar animation transform using a neutral face image

• US 20020067362A1
• Filed: 07/24/2001
• Published: 06/06/2002
• Est. Priority Date: 11/06/1998
• Status: Abandoned Application

• Current Assignee: Neven Vision, Inc. (Alphabet Inc.)
• Original Assignee: Neven Vision, Inc. (Alphabet Inc.)
• Inventors: Agostino Nocera, Luciano Pasquale, Neven, Hartmut
• Application Number:
  US09/915,235
• Publication Number:
  US 20020067362A1
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/174 Facial expression recognition

Abstract

The present invention is embodied in a method and system for generating an animation transform using a neutral face image. An avatar editor uses a frontal head image and a side head image of a neutral face model for generating an avatar. The avatar is generated by automatically finding head feature locations on the front and side head images using elastic bunch graph matching. Significant time savings may be accomplished by a generating an animation transform using the neutral face features. The animation transform for the neutral face features may be applied to the other facial expression avatar meshes to improve the quality of the resulting avatar. The neutral-face-based animation transform provides significant improvement to the facial expression head models without the significant editing time incurred by generating a particular animation transform for each particular facial expression (and/or pose) features.

Claims

1. A method for generating an avatar animation transform, comprising:

providing a neutral-face front head image and a side head image for generating an avatar;

automatically finding head feature locations on the front head image and the side head image using elastic bunch graph matching;

automatically positioning nodes at feature locations on the front head image and the side head image; and

manually reviewing and correcting the node positions to remove artifacts and minimize distorted features in the avatar generated based on the node positions.

2. A method for generating an avatar animation transform as defined in claim 1, further comprising generating an animation transform based on the corrected node positions for the neutral face.

3. A method for generating an avatar animation transform as defined in claim 2, further comprising applying the animation transform to expression face avatar meshes for generating the avatar.

4. A method for generating an avatar animation transform as defined in claim 2, further comprising applying the animation transform to morph targets.

5. A system for generating an avatar animation transform, comprising:

means for providing a neutral-face front head image and a side head image for generating an avatar;

means for automatically finding head feature locations on the front head image and the side head image using elastic bunch graph matching;

means for automatically positioning nodes at feature locations on the front head image and the side head image; and

means for manually reviewing and correcting the node positions to remove artifacts and minimize distorted features in the avatar generated based on the node positions.

6. A system for generating an avatar animation transform as defined in claim 5, further comprising means for generating an animation transform based on the corrected node positions for the neutral face.

7. A system for generating an avatar animation transform as defined in claim 6, further comprising means for applying the animation transform to expression face avatar meshes for generating the avatar.

8. A system for generating an avatar animation transform as defined in claim 6, further comprising means for applying the animation transform to morph targets.

9. A method for generating an avatar animation transform, comprising:

providing a neutral-face front head image and a side head image for generating an avatar;

automatically finding head feature locations on the front head image and the side head image using image analysis based on wavelet component values generated from wavelet transformations of the respective neutral-face front head image and the side head image;

automatically positioning nodes at feature locations on the front head image and the side head image; and

manually reviewing and correcting the node positions to remove artifacts and minimize distorted features in the avatar generated based on the node positions.

10. A method for generating an avatar animation transform as defined in claim 9, further comprising generating an animation transform based on the corrected node positions for the neutral face.

11. A method for generating an avatar animation transform as defined in claim 10, further comprising applying the animation transform to expression face avatar meshes for generating the avatar.

12. A method for generating an avatar animation transform as defined in claim 10, further comprising applying the animation transform to morph targets.

13. A method for generating an avatar animation transform as defined in claim 9, wherein the wavelet transformations use Gabor wavelets.