Data reduction and representation method for graphic articulation parameters gaps

• US 6,130,679 A
• Filed: 07/31/1998
• Issued: 10/10/2000
• Est. Priority Date: 02/13/1997
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Rockwell Science Center LLC
• Inventors: Tao, Hai, Chen, Homer H.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US09/127,466
• Time in Patent Office: 802 Days
• Field of Search: 345/473, 345/474, 345/475, 345/326, 345/956, 345/957
• US Class Current: 345/473
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 9/001 Model-based coding, e.g. wire frame
• CPC Class Codes: H04N 19/27 involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/619 the transform being operated outside the prediction loop

Abstract

A data reduction and representation method reduces the number of graphic articulation parameters (GAPs) that must be stored or transmitted to animate an object. A number of GAPs are identified that can be interpolated from other GAPs. A directed graph is created which depicts the identities of the "derived" GAPs, the "defining" GAPs from which derived GAPs can be interpolated, and the relationship between them. The GAPs reside at nodes on the graph which are interconnected with directed links that indicate the "parent" to "child" relationships, with each link representing an interpolation function which defines how the derived GAPs are interpolated from the defining GAPs. The graph and interpolation functions are conveyed to a decoder. Frames containing defining GAPs are then sent to the decoder, which performs the interpolations as directed by the graph and using the interpolation functions to reconstruct the derived GAPs.

Claims

1. A method of reducing the number of parameters which must be conveyed to a decoder to animate an object, comprising the steps of:

identifying at least one defining parameter which defines the animation of a portion of an object,

identifying at least one derived parameter which can be interpolated from said at least one defining parameter,

specifying interpolation functions which enable respective ones of said derived parameters to be interpolated from said at least one defining parameter, and

arranging said parameters in a data structure which includes the identities of said at least one derived parameter and said at least one defining parameter and which indicates from which of said defining parameters each of said derived parameters can be interpolated,

said interpolation functions and said data structure when conveyed to a decoder enabling said decoder to interpolate said derived parameters from said defining parameters and thereby reduce the number of parameters that must be conveyed to said decoder to animate an object.

2. The method of claim 1, wherein said at least one defining parameter comprises a set of parameters, and said data structure indicates the relationship between said at least one derived parameter and said set of parameters.

3. The method of claim 1, further comprising the steps of conveying said data structure and said interpolation functions to a decoder, and interpolating said derived parameters from their respective defining parameters as directed in said data structure and using their respective interpolation functions.

4. The method of claim 1, wherein said data structure is a directed graph which comprises a plurality of nodes, said at least one derived parameter and said at least one defining parameter residing at respective "child" and "parent" nodes, said nodes interconnected with directed links, each of said links indicating from which of said parent nodes a child node can be interpolated.

5. The method of claim 4, wherein each of said directed links comprises at least one of said interpolation functions, each of said interpolation functions defining a respective one of said derived parameters as a function of said at least one defining parameter.

6. The method of claim 1, wherein said at least one defining parameter comprises a set of parameters G₁, G₂, . . . , G_n and said interpolation function is an extended rational polynomial which defines the interpolation of said set of parameters I(G₁, G₂, . . . , G_n) as equal to ##EQU2## where K and P are the numbers of polynomial products in the numerator and denominator of said function, respectively, c_i and b_i are the coefficients of the ith products, l_ij and m_ij are the powers of F_j in the ith product, and δ

(F_si -a_i) is an optional impulse function which may be defined for each term in the numerator polynomial.

7. The method of claim 6, wherein said step of specifying said interpolation functions comprises determining values for K, P, a_i, S_i, c_i, b_i, l_ij, and m_ij for each of said interpolation functions, which, when supplied to said extended rational polynomial, enable a respective one of said derived parameters to be interpolated from said at least one defining parameter.

8. The method of claim 1, wherein said parameters are graphic articulation parameters (GAPs) which define the animation of a 3-D object.

9. The method of claim 1, wherein said GAPs are facial animation parameters (FAPs) which define the animation of a face.

10. A method of reducing the number of graphic articulation parameters (GAPs) which must be conveyed to a decoder to animate an object, comprising the steps of:

identifying at least one defining set of GAPs which defines the animation of a portion of an object,

identifying at least one derived set of GAPs which can be interpolated from said at least one defining set,

specifying a respective interpolation function for each of said at least one derived sets, each of said interpolation functions enabling its respective derived set to be interpolated from one of said defining sets, and

arranging said defining sets and said derived sets in a directed graph comprising a plurality of child and parent nodes, each child and parent node comprising a derived set and a defining set from which said derived set can be interpolated, respectively, said nodes interconnected with directed links which indicate from which of said parent nodes said child nodes can be interpolated,

said interpolation functions and said data structure when conveyed to a decoder enabling said decoder to interpolate said derived sets from said defining sets and thereby reduce the number of GAPs that must be conveyed to said decoder to animate an object.

11. The method of claim 10, wherein said object is a 3-D object.

12. The method of claim 10, in which said GAPs are facial animation parameters (FAPs).

13. The method of claim 10, further comprising the steps of conveying said directed graph and said interpolation functions to a decoder, and interpolating said derived sets from their respective defining sets as directed in said directed graph and using their respective interpolation functions.

14. The method of claim 10, wherein each of said directed links comprises at least one of said interpolation functions, each of said interpolation functions defining one of said derived sets as a function of said at least one defining set.

15. The method of claim 10, wherein said at least one defining set comprises GAPs G₁, G₂, . . . , G_n and said given interpolation function is an extended rational polynomial which defines the interpolation of said defining set I(G₁, G₂, . . . , G_n) as equal to ##EQU3## where K and P are the numbers of polynomial products in the numerator and denominator of said function, respectively, c_i and b_i are the coefficients of the ith products, l_ij and m_ij are the powers of F_j in the ith product, and δ

(F_si -a_i) is an optional impulse function which may be defined for each term in the numerator polynomial.

16. The method of claim 15, wherein said step of specifying said interpolation functions comprises determining values for K, P, a_i, S_i, c_i, b_i, l_ij, and m_ij for each of said interpolation functions, which, when supplied to said extended rational polynomial, enable a respective one of said derived sets to be interpolated from one of said defining sets.

17. The method of claim 16, further comprising the steps of conveying said directed graph and said values for K, P, a_i, S_i, c_i, b_i, l_ij, and m_ij for each of said interpolation functions to a decoder, and interpolating said derived sets from their respective defining sets as directed in said directed graph and using their respective interpolation functions.

18. The method of claim 10, further comprising the steps of conveying said directed graph and said interpolation functions to a decoder, and interpolating said child nodes from their respective parent nodes as directed in said directed graph and using their respective interpolation functions, said child nodes interpolated from said parent nodes using a process comprising the steps of:

inspecting each node of said directed graph in turn,

determining if said node being inspected requires interpolation,

determining, if said node being inspected requires interpolation, if all the GAPs comprising any one of its parent nodes are available,

interpolating, if said node being inspected requires interpolation and all the GAPs comprising any one of its parent nodes are available, said node from a parent node having all of its GAPs available using said node'"'"'s respective interpolation function, and

recursively performing the steps of said process until all nodes requiring interpolation have been interpolated.

19. The method of claim 10, wherein a given defining set can be interpolated from one or more other of said defining sets or said derived sets, said directed graph indicating each of said defining sets or said derived sets from which said given defining set can be interpolated.

20. A method of conveying a group of graphic articulation parameters (GAPs) which define the animation of an object to a decoder, in which some of said GAPs in said group are interpolated from others of said GAPs in said group such that the number of GAPs that must be conveyed is less than the number in said group, comprising the steps of:

identifying at least one defining set of GAPs which defines the animation of a portion of an object,

identifying at least one derived set of GAPs which can be interpolated from said at least one defining set,

specifying a respective interpolation function for each of said at least one derived sets, each of said interpolation functions enabling its respective derived set to be interpolated from one of said defining sets,

arranging said defining sets and said derived sets in a directed graph which comprises a plurality of child and parent nodes, each child and parent node comprising a derived set and a defining set from which said derived set can be interpolated, respectively, said nodes interconnected with directed links which indicate from which of said parent nodes said child nodes can be interpolated,

conveying said directed graph and said interpolation functions to a decoder,

conveying the GAPs of at least one of said defining sets to said decoder, and

interpolating said child nodes from their respective parent nodes as indicated in said directed graph using said respective interpolation functions to provide all of the GAPs in said group, said method reducing the number of GAPs that must be conveyed to said decoder to define the animation of an object.

21. The method of claim 20, in which said GAPs are facial animation parameters (FAPs).