Computer readable medium for modifying an animation wire frame

• US 8,654,130 B2
• Filed: 06/06/2011
• Issued: 02/18/2014
• Est. Priority Date: 06/03/1997
• Status: Expired due to Fees

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Rakuten, Inc. (Rakuten Group, Inc.)
• Inventors: Ostermann, Joern
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US13/154,312
• Publication Number:
  US 20110234588A1
• Time in Patent Office: 988 Days
• Field of Search: 345473-475, 345419-427
• US Class Current: 345/473
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation

Abstract

An animation wireframe is modified with three-dimensional (3D) range and color data having a corresponding shape surface. The animation wireframe is vertically scaled based on distances between consecutive features within the 3D range and color data and corresponding distances within the generic animation wireframe. For each animation wireframe point, the location of the animation wireframe point is adjusted to coincide with a point on the shape surface. The shape surface point lies along a scaling line connecting the animation wireframe point, the shape surface point and an origin point. The scaling line is within a horizontal point.

Claims

1. A method comprising:

segmenting an animation wireframe in a depth map indicating a face region and a non-face region, the depth map being a 2D image where each pixel represents an absolute distance or a relative distance between a face model and a viewpoint, wherein the animation wireframe has three-dimensional range data and color data; and

scaling, via a processor, the animation wireframe proportionally, based on the color data and on a plurality of distances between feature pairs within a plurality of features, the plurality of features being within the three-dimensional range data,

wherein said scaling is performed for a horizontal slice of said animation wireframe using a scaling factor based on the distance between a corresponding feature pair, and

wherein said animation wireframe comprises a plurality of horizontal slices and each horizontal slice of said animation wireframe is scaled according to a corresponding scaling factor based on the distance between the corresponding feature pair.

2. The method of claim 1, further comprising:

obtaining a primary point within the three-dimensional range data corresponding to a first feature within the plurality of features;

obtaining an alignment line in a first direction based on the primary point;

obtaining a plurality of points within the three-dimensional range data corresponding to features within the plurality of features that lie along the alignment line; and

calculating a plurality of scaling factors based on the plurality of distances between feature pairs within the plurality of features.

3. The method of claim 2, wherein obtaining the primary point is performed manually.

4. The method of claim 2, wherein obtaining the plurality of points is performed manually.

5. The method of claim 2, wherein:

a first point from the plurality of points corresponds to a lower edge of a forehead,

a second point from the plurality of points corresponds to a bridge of a nose,

a third point from the plurality of points corresponds to a bottom of the nose,

a fourth point from the plurality of points corresponds to an upper lip,

a fifth point from the plurality of points corresponds to a mouth opening,

a sixth point from the plurality of points corresponds to a lower lip.

6. The method of claim 2, wherein the primary point is selected from the three-dimensional range data based on a feature'"'"'s protrusion with respect to other features in the plurality of features.

7. The method of claim 2, wherein the primary point is selected from the three-dimensional range data based on the color data.

8. The method of claim 1, further comprising applying a color texture from the color data to the animation wireframe.

9. The method according to claim 1, wherein said scaling occurs in only a single dimension.

10. The method according to claim 9, wherein said single dimension is in a vertical direction.

11. A system, comprising:

a processor; and

a non-transitory computer-readable storage medium having stored therein instructions which, when executed by the processor, cause the processor to perform a method comprising;

segmenting an animation wireframe in a depth map indicating a face region and a non-face region, the depth map being a 2D image where each pixel represents an absolute distance or a relative distance between a face model and a viewpoint, wherein the animation wireframe has three-dimensional range data and color data; and

scaling the animation wireframe proportionally based on the color data and on a plurality of distances between feature pairs within a plurality of features, the plurality of features being within the three-dimensional range data,

wherein said scaling is performed for a horizontal slice of said animation wireframe using a scaling factor based on the distance between a corresponding feature pair, and

wherein said animation wireframe comprises a plurality of horizontal slices and each horizontal slice of said animation wireframe is scaled according to a corresponding scaling factor based on the distance between the corresponding feature pair.

12. The system of claim 11, the instructions which, when executed by the processor, cause the processor to perform a method further comprising:

obtaining a primary point within the three-dimensional range data corresponding to a first feature within the plurality of features;

obtaining an alignment line in a first direction based on the primary point;

obtaining a plurality of points within the three-dimensional range data corresponding to features within the plurality of features that lie along the alignment line; and

calculating a plurality of scaling factors based on the plurality of distances between feature pairs within the plurality of features.

13. The system of claim 12, wherein the primary point is obtained manually.

14. The system of claim 12, wherein the plurality of points is obtained manually.

15. The system of claim 12, wherein the primary point is selected from the three-dimensional range data based on a feature'"'"'s protrusion with respect to other features in the plurality of features.

16. The system of claim 11, the instructions which, when executed by the processor, cause the processor to perform a method further comprising:

applying a color texture from the color data to the animation wireframe.

17. A non-transitory computer-readable storage medium having stored therein instructions which, when executed by a computing device, cause the computing device to perform a method comprising:

segmenting an animation wireframe in a depth map indicating a face region and a non-face region, the depth map being a 2D image where each pixel represents an absolute distance or a relative distance between a face model and a viewpoint, wherein the animation wireframe has three-dimensional range data and color data; and

scaling the animation wireframe proportionally based on the color data and on a plurality of distances between feature pairs within a plurality of features, the plurality of features being within the three-dimensional range data,

wherein said scaling is performed for a horizontal slice of said animation wireframe using a scaling factor based on the distance between a corresponding feature pair, and

wherein said animation wireframe comprises a plurality of horizontal slices and each horizontal slice of said animation wireframe is scaled according to a corresponding scaling factor based on the distance between the corresponding feature pair.

18. The non-transitory computer-readable storage medium of claim 17, the instructions which, when executed by the computing device, cause the computing device to perform a method further comprising:

providing texture mapping to the animation wireframe based on color data corresponding to the three-dimensional range data.

19. The non-transitory computer-readable storage medium of claim 18, the instructions which, when executed by the computing device, cause the computing device to perform a method further comprising:

obtaining an alignment point within the color data corresponding to an object within the animation wireframe that substantially moves during animation; and

matching the alignment point with a corresponding point within the animation wireframe.

20. The non-transitory computer-readable storage medium of claim 17, wherein scaling comprises:

obtaining a primary point within the three-dimensional range data corresponding to a first feature within the plurality of features;

obtaining an alignment line in a first direction based on the primary point;

obtaining a plurality of points within the three-dimensional range data corresponding to features within the plurality of features that lie along the alignment line; and

calculating a plurality of scaling factors based on the plurality of distances between feature pairs within the plurality of features.

21. The non-transitory computer-readable storage medium of claim 20, wherein obtaining the primary point is performed manually.

22. The non-transitory computer-readable storage medium of claim 20, wherein obtaining the plurality of points is performed manually.