System and apparatus for customizing a computer animation wireframe

• US 5,969,721 A
• Filed: 06/03/1997
• Issued: 10/19/1999
• Est. Priority Date: 06/03/1997
• Status: Expired due to Term

• Current Assignee: Rakuten, Inc. (Rakuten Group, Inc.)
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Ostermann, Joern, Chen, Lawrence Shao-Hsien
• Primary Examiner(s): Nguyen, Phu K.
• Assistant Examiner(s): Vo, Cliff N.
• Application Number:
  US08/867,727
• Time in Patent Office: 868 Days
• Field of Search: 345/412, 345/420, 345/421, 345/125, 345/473, 345/474
• US Class Current: 345/419
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation

Abstract

An animation wireframe is modified with three-dimensional (3D) range and color data having a corresponding shape surface. The animation wireframe is vertically scaled based on distances between consecutive features within the 3D range and color data and corresponding distances within the generic animation wireframe. For each animation wireframe point, the location of the animation wireframe point is adjusted to coincide with a point on the shape surface. The shape surface point lies along a scaling line connecting the animation wireframe point, the shape surface point and an origin point. The scaling line is within a horizontal plane.

Claims

1. A method for modifying an animation wireframe having a plurality of points with three-dimensional (3D) range data having a corresponding shape surface, comprising:

(a) vertically scaling the animation wireframe based on a plurality of distances between consecutive features within a plurality of features, the plurality of features being within the 3D range data; and

(b) for each animation-wireframe point, horizontally adjusting the location of a first animation-wireframe point to correspond to a first point on the shape surface within a horizontal plane.

2. The method of claim 1, wherein step (a) further comprises the following substeps:

(i) obtaining a primary point within the 3D range data corresponding to a first feature within the plurality of features;

(ii) obtaining a vertical alignment line based on the primary point;

(iii) obtaining a plurality of secondary points within the 3D range data corresponding to features within the plurality of features that lie along the vertical alignment line; and

(iv) calculating a plurality of vertical scaling factors based on the plurality of distances between consecutive features.

3. The method of claim 2, wherein said step (a) (i) of obtaining the primary point is performed manually.

4. The method of claim 2, wherein said step (a) (iii) of obtaining the plurality of secondary points is performed manually.

5. The method of claim 1, wherein step (b) further includes the following substeps:

(i) defining a scaling line connecting the first animation-wireframe point and an origin point, the scaling line being within the horizontal plane;

(ii) determining the first shape surface point as the intersection of the scaling line and the shape surface; and

(iii) adjusting the location of the first animation-wireframe point to coincide with the first shape surface point.

6. The method of claim 1, wherein step (b) further comprises the following substep:

(i) selecting a tertiary point within the 3D range data that defines a vertical cut-off plane, the vertical cut-off plane intersecting with the horizontal plane to define a limit of the horizontal plane.

7. The method of claim 6, wherein said step (b) (i) of obtaining the tertiary point is performed manually.

8. The method of claim 6, wherein said step (b) further includes the following substeps:

(ii) defining a first scaling line connecting the first animation-wireframe point and an origin point, the first scaling line being within the horizontal plane;

(iii) determining the first shape surface point as the intersection of the first scaling line and the shape surface;

(iv) selecting a second animation wireframe point within the horizontal plane;

(v) defining a second scaling line connecting the second animation-wireframe point and the origin point, the second scaling line being within the horizontal plane;

(vi) determining the second shape surface point as the intersection of the second scaling line and the shape surface; and

(vii) adjusting the location of the second animation wireframe point to correspond to the second shape surface point.

9. The method of claim 8, wherein the location of the first animation wireframe point and the second animation wireframe point are adjusted so that L_W '"'"'/L_W substantially equals L_R '"'"'/L_R where:

L_W '"'"' is the length of a first line connecting the first animation wireframe point and the second animation wireframe point along the animation wireframe within the horizontal plane,

L_W is the length of a second line along the animation wireframe within the horizontal plane, the second line being between the limit of the horizontal plane and a first intersection point where the animation wireframe within the horizontal plane intersects a perpendicular line containing the origin point and being perpendicular from the limit of the horizontal plane,

L_R '"'"' is the length of a third line connecting the first shape-surface point and the second shape-surface point along the shape surface within the horizontal plane, and

L_R is the length of a fourth line along the shape surface within the horizontal plane, the fourth line being between the limit of the horizontal plane and a second intersection point where the shape surface within the horizontal plane intersects the perpendicular line.

10. The method of claim 1, further comprising:

(c) providing texture mapping to the animation wireframe based on color data corresponding to the 3D range data.

11. The method of claim 10, further comprising:

(d) obtaining an alignment point within the color data corresponding to an object within the animation wireframe that substantially moves during animation; and

(e) matching the alignment point with a corresponding point within the animation wireframe.

12. A method for modifying an animation wireframe having a plurality of points with three-dimensional (3D) range data of a head, the 3D range data having a corresponding shape surface, comprising:

(a) obtaining a primary point within the 3D range data corresponding to a nose tip;

(b) obtaining a vertical profile line based on the primary point;

(c) obtaining a plurality of secondary points within the 3D data corresponding to other facial features;

(d) determining a plurality of vertical scaling factors corresponding to a distance between consecutive features, including the nose tip;

(e) vertically scaling the animation wireframe based on the plurality of vertical scaling factors;

(f) selecting a tertiary point within the 3D range data that defines a vertical cut-off plane;

(g) for each animation wireframe point, performing the following substeps;

(I) defining a center point within a horizontal plane orthogonal to the vertical cut-off plane and containing the tertiary point and a point along the vertical aligning line intersecting the horizontal plane; and

(ii) horizontally scaling the animation wireframe along a scaling line within the horizontal plane connecting the center point and the animation wireframe point.

13. The method of claim 12, wherein:

a first secondary point from the plurality of secondary points corresponds to a lower edge of a forehead,

a second secondary point from the plurality of secondary points corresponds to a bridge of the nose,

a third secondary point from the plurality of secondary points corresponds to a bottom of the nose,

a fourth secondary point from the plurality of secondary points corresponds to an upper lip,

a fifth secondary point from the plurality of secondary points corresponds to a mouth opening, and

a sixth secondary point from the plurality of secondary points corresponds to a lower lip.

14. The method of claim 12, further comprising:

(h) providing texture mapping to the animation wireframe based on color data corresponding to the 3D range data.

15. The method of claim 14, further comprising:

(i) obtaining a plurality of alignment points within the color data corresponding to corners of two eyes and a mouth; and

(j) matching the alignment points with corresponding points within the animation wireframe.

16. An apparatus for modifying an animation wireframe having a plurality of points with three-dimensional (3D) range data having a corresponding shape surface, comprising:

a processor,

a computer-readable memory,

a first input port to be coupled to a range sensor system, the first input port receives 3D range data,

a second input port which receives the animation wireframe,

an output port which sends the modified animation wireframe, and

a data bus connecting the processor, the computer-readable memory, the first input port, the second input port, and the output port,

the processor vertically scaling the animation wireframe based on a plurality of distances between consecutive features within a plurality of features, the plurality of features being within the 3D range data,

the processor, for each animation wireframe point, adjusting the location of the animation wireframe point to coincide with a point on the shape surface, the shape surface point lying along a scaling line connecting the animation wireframe point, the shape surface point and an origin point, the scaling line being within a horizontal plane.

17. The method of claim 16, further comprising:

a first storage device coupled to the second input port and sending the animation wireframe to the second input port.

18. The method of claim 16, further comprising:

a second storage device coupled to the output device and receiving the animation wireframe from the output device.

19. An apparatus for modifying an animation wireframe having a plurality of points with three-dimensional (3D) range data having a corresponding shape surface, comprising:

means for vertically scaling the animation wireframe based on a plurality of distances between consecutive features within a plurality of features, the plurality of features being within the 3D range data; and

means for adjusting, for each animation wireframe point, the location of the animation wireframe point to coincide with a point on the shape surface, the shape surface point lying along a scaling line connecting the animation wireframe point, the shape surface point and an origin point, the scaling line being within a horizontal plane.