Apparatus and method for efficient animation of believable speaking 3D characters in real time

• US 7,663,628 B2
• Filed: 09/06/2002
• Issued: 02/16/2010
• Est. Priority Date: 01/22/2002
• Status: Expired due to Fees

• Current Assignee: DG Holdings Inc. (DAZ Productions, Inc.)
• Original Assignee: Gizmoz Israel 2002 Ltd.
• Inventors: Griffith, Todd, Cederwall, Chris, Rom, Hillel
• Primary Examiner(s): Nguyen; Phu K
• Application Number:
  US10/235,822
• Publication Number:
  US 20030137515A1
• Time in Patent Office: 2,720 Days
• Field of Search: 345/473, 345/474, 345/475
• US Class Current: 345/473
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 2213/12 Rule based animation

Abstract

An apparatus for animating a moving and speaking enhanced-believability, character in real time, comprising a plurality of behavior generators, each for defining a respective aspect of facial behavior, a unifying scripter, associated with the behavior generators, the scripter operable to combine the behaviors into a unified animation script, and a renderer, associated with the unifying scripter, the renderer operable to render the character in accordance with the script, thereby to enhance believability of the character.

Claims

1. An apparatus comprising a computer processor for animating a moving and speaking enhanced-believability character in real time, comprising:

i. a plurality of behavior generators each responsible for a respective aspect of facial behavior, at least some of said generators being configured with a respective time definer defining time intervals and generating behavior elements in accordance with said defined time intervals;

ii. a unifying scripter, associated with said behavior generators, said unifying scripter operable to combine said generated elements into a unified animation script for said enhanced believability character; and

iii. a renderer, associated with said unifying scripter, said renderer operable to render said enhanced believability character in accordance with said unified animation script,

iv. an executor, associated with said renderer, operable to execute animating of said rendered enhanced believability character,

wherein said behavior generators are configured to continue to generate behavior elements during execution of said animating of said rendered enhanced believability character in accordance with said defined time intervals and said renderer continues to render the enhanced believability character in accordance with respective ones of said generated behavior elements as said behavior elements are added to said unified animation script during said execution of the animating of the rendered enhanced believability character, said unifying scripter randomly selecting elements from different ones of said behavior generators in response to stimuli for addition to said unified animation script.

2. The apparatus according to claim 1 wherein said behavior generator is operable to generate an element of said aspect over a defined time.

3. The apparatus according to claim 2 wherein said aspect comprises a plurality of currently selected ones of said behavior elements.

4. The apparatus according to claim 1 wherein said aspect is maintainable through an active behavior pool of said behavior elements in accordance with said defined time.

5. The apparatus according to claim 1 wherein said behavior elements of said aspect comprise at least one chosen from a list comprising:

geometric;

orientation; and

appearance elements.

6. The apparatus according to claim 5 wherein said geometric behavior element comprises changes of position of a plurality of vertices of said polygonal surfaces.

7. The apparatus according to claim 5 wherein said orientation behavior element comprises changes to said character resulting from transformations to vertices of said polygonal surfaces.

8. The apparatus according to claim 7 wherein said transformations comprise a rigid transformation applied to a plurality of vertices of said polygonal surfaces of at least one part of said character.

9. The apparatus according to claim 7 wherein said transformations comprise tapered transformations operable upon a plurality of points of said character in accordance with respective stickiness factors.

10. The apparatus according to claim 9 wherein respective stickiness factors are defined as:

s.sub..nu.=1−

k.sub..nu. where;

s.sub..nu. is said stickiness factor for a rotation of a given vertex within a body of vertices; and

k.sub..nu. is an angular coefficient for said vertex, k.sub..nu. further being defined in;

.theta..sub..nu.,.alpha.=k.sub..nu. .−

alpha. where;

a is a rotation of said body of vertices; and

.theta..sub..nu.,.alpha. is a resultant rotation at said vertex.

11. The apparatus according to claim 10 further comprising a graphics library rotation mechanism to effect a sticky rotation, resembling a standard rigid rotation, said mechanism comprising:

i. a sorter for sorting said vertices according to respective s.sub..nu. values;

ii. a rotation definer for defining a local rotation, based upon said rotation angle a around an axis W, using library commands;

iii. a rotation matrix computer, in association with said sorter and said rotation definer, operable to compute a rigid rotation matrix with angle −

s.sub..nu.a for said vertices when s.sub..nu. is not equal to zero. iv. a vertex multiplier, in association with said thresholder, for multiplying respective vertices with a non-zero s.sub..nu. value by said rigid rotation matrix, thereby yielding a negative rotation over said angle a.

12. The apparatus according to claim 1 wherein said behavior elements of said aspect are operable upon a plurality of polygonal surfaces comprising a visual appearance of said character.

13. An apparatus according to claim 1, wherein said renderer is configured to render said character on a frame-by-frame basis.

14. A computerized method for animating a moving and speaking enhanced-believability character in real time, comprising carrying out on an electronic computer:

i. defining a plurality of aspects of behavior;

ii. for at least some of said aspects, dynamically determining time intervals and providing respective behavior elements in accordance with said time intervals;

iii. receiving said respectively provided behavior elements;

iv. unifying said received elements into a unified animation script;

v. rendering said character in accordance with said unified animation script; and

vi. animating said character using said rendering, thereby dynamically integrating said respective provided behavior elements in accordance with said time intervals to enhance believability of said rendered character, said unifying said received elements into said unified animation script comprising randomly selecting elements from different ones of said behavior aspects in response to stimuli, the unified animation script being for controlling said electronic computer to carry out said animating.

15. The method according to claim 14 further comprising defining said plurality of aspects substantially off line.

16. The method according to claim 14, further comprising generating said respective elements for a respective defined time.

17. The method according to claim 14 wherein rendering said character comprises rendering on a frame-by-frame basis.

18. An apparatus comprising a computer processor for animating a moving and speaking enhanced-believability character in real time, comprising:

i. a plurality of behavior generators each responsible for a respective aspect of facial behavior, each generator being configured to generate behavior elements and to provide ones of said elements relating to said aspect, said ones of said elements being provided at random;

ii. a unifying scripter, associated with said behavior generators, said unifying scripter operable to combine said generated and randomly provided elements into a unified animation script for said enhanced believability character; and

iii. a renderer, associated with said unifying scripter, said renderer operable to render said enhanced believability character in accordance with said unified animation script,

iv. an executor, associated with said renderer, operable to execute animating of said rendered enhanced believability character,

wherein said behavior generators are configured to continue to generate behavior elements during execution of said animating of said rendered enhanced believability character and said renderer continues to render the enhanced believability character in accordance with said randomly selected ones of said generated behavior elements as said behavior elements are added to said unified animation script during said execution of the animating of the rendered enhanced believability character, said unifying scripter randomly selecting elements from different ones of said behavior generators in response to stimuli for addition to said unified animation script.