METHOD AND APPARATUS FOR GENERATING FACE AVATAR

• US 20120113106A1
• Filed: 11/03/2011
• Published: 05/10/2012
• Est. Priority Date: 11/04/2010
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: CHOI, Yoon-Seok, Lee, Ji Hyung
• Application Number:
  US13/288,698
• Publication Number:
  US 20120113106A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

A face avatar generating apparatus includes: a face feature information extraction unit for receiving a face photo and extracting face feature information from the face photo and a two-dimensional (2D) avatar generation unit for selecting at least one region from the face photo based on the face feature information, and exaggerating or beautifying the selected region to create a 2D avatar image. The apparatus further includes a 3D avatar generation unit for modifying a standard 3D face model through a comparison with the standard 3D model based on the face feature information and pre-stored standard information to create a 3D avatar image.

Claims

1. A face avatar generating apparatus comprising:

a face feature information extraction unit for receiving a face photo and extracting face feature information from the face photo;

a two-dimensional (2D) avatar generation unit for selecting at least one region from the face photo based on the face feature information, and exaggerating or beautifying the selected region to create a 2D avatar image; and

a 3D avatar generation unit for modifying a standard 3D face model through a comparison of predetermined feature information on standard 3D face model and the face feature information to create a 3D avatar.

2. The face avatar generating apparatus of claim 1, further comprising:

a data processing unit for correcting geometrical information of the face photo or correcting a color of the face photo.

3. The face avatar generating apparatus of claim 1, wherein the face feature information extraction unit includes a user designation feature recognition unit for designating the feature information by a user through an interface.

4. The face avatar generating apparatus of claim 1, wherein the face feature information extraction unit includes:

an automatic feature recognition unit for designating at least one of both eyes, a nose, lips, and a face contour region on the face photo to extract primary feature information of a face; and

a composite feature recognition unit for providing an interface for correcting the primary feature information, and extracting the primary feature information corrected through the interface as the face feature information.

5. The face avatar generating apparatus of claim 1, wherein the 2D avatar generation unit includes an avatar beautification unit for generating the 2D avatar image by beautifying the predetermined portion on the face photo corresponding to the extracted face feature information based on pre-stored statistic information, or beautifying the predetermined portion based on an input from a user.

6. The face avatar generating apparatus of claim 1, further comprising:

an artistic effect generation unit for applying an artistic conversion technique of at least one of an illustration, a cartoon and an oil painting to the 2D avatar image generated by the 2D avatar generation unit.

7. The face avatar generating apparatus of claim 1, wherein the 3D avatar generation unit includes:

a feature difference calculation unit for comparing the face feature information with predetermined feature information on the standard 3D face model generated based on the pre-stored standard information, to calculate a difference therebetween; and

a model modification unit for modifying the standard 3D model based on the calculated difference, to create the shape of a face on the face photo and then generate the 3D avatar image on the basis of the created face shape.

8. The face avatar generating apparatus of claim 7, wherein the model modification unit includes:

a marking processing unit for providing an interface for designating at least one vertex among a left eye, a right eye, a nose, the line of a jaw, and a contour line of lips in order to compare the standard 3D face model with the face feature information and providing an interface for moving a vertex forming each feature vertex; and

a region control unit for dividing the standard 3D face model into n regions, and controlling the divided n regions, wherein the standard 3D face model is modified through control of the n regions to generate the face shape of the face photo.

9. The face avatar generating apparatus of claim 8, wherein the region control unit interpolates between maximum and minimum value of respective n face regions in n pairs of face models, which has been previously prepared to represent maximum and minimum size of n face regions in a pair, based on calculated feature difference from the feature difference calculation unit or the movement result of the vertex forming each feature vertex.

10. The face avatar generating apparatus of claim 1, further comprising:

3D avatar exaggeration beautification units for exaggerating or beautifying the generated 3D avatar image depending on a user'"'"'s setting.

11. The face avatar generating apparatus of claim 1, wherein the 3D avatar generation unit includes a texture generation unit for generating a texture of a face of modified standard 3D face model in order to provide a realistic feeling to the modified standard 3D face model, and

the 3D avatar image is created by combining the generated face texture and the modified standard 3D face model.

12. The face avatar generating apparatus of claim 11, wherein the texture generation unit extracts texture information on the face by combining information on the modified standard 3D face model and a 3D scene image including the face photo.

13. The face avatar generating apparatus of claim 11, wherein the texture generation unit generates a polygonal index image based on a texture coordinate in the modified standard 3D face model and then calculates a corresponding coordinates within the 3D scene image when a polygon corresponding to the polygonal index image is rendered, and generates texture information of the face by performing a conversion process on a polygon in a texture coordinates of the polygonal index image and the polygon in the 3D scene image.

14. The face avatar generating apparatus of claim 13, wherein the texture generation unit determines a pixel value using a linear interpolation function in a conversion process on triangle in the texture coordinates and a triangle of the 3D scene image.

15. The face avatar generating apparatus of claim 11, wherein the 3D avatar generation unit further includes an avatar model function unit for providing a model exporting function based on a standard document format to use the 3D avatar image and the generated texture in other application programs or virtual environments.

16. A face avatar generating method comprising:

correcting geometrical information or color information of a face photo received from an outside and extracting face feature information based on the corrected result;

selecting at least one region from the face photo based on the face feature information, and exaggerating or beautifying the selected region to create a 2D avatar image; and

modifying a standard 3D face model through a comparison of predetermined feature information on standard 3D model and the face feature information to create a 3D avatar image.

17. The face avatar generating method of claim 16, wherein said exaggerating or beautifying the selected region includes:

comparing pre-stored statistic information and the extracted face feature information; and

exaggerating or beautifying a predetermined portion on the face photo corresponding to the extracted face feature information based on the comparison result, to create the 2D avatar image.

18. The face avatar generating method of claim 16, wherein said modifying a standard 3D face model includes:

generating the standard 3D face model based on the pre-stored standard information, and comparing feature information of the standard 3D face model with the face feature information to calculate a difference therebetween; and

modifying the standard 3D model based on the calculated difference, to create the shape of a face on the face photo and then generate the 3D avatar image based on the created face shape.

19. The face avatar generating method of claim 18, further comprising:

providing an interface for designating at least one or more vertices among a left eye, a right eye, a nose, a line of a jaw, and a contour line of lips in order to compare the standard 3D face model with the face feature information and providing an interface for moving a vertex forming each feature vertex;

when the vertices designated through the interface are moved, designating n regions moving corresponding to the movement of the vertices, into an n-number of regions; and

modifying the standard 3D face model through control of the n regions to create the shape of a face on the face photo and then generate the 3D avatar image based on the created face shape.