Object modeling for computer simulation and animation

• US 6,563,503 B1
• Filed: 08/25/1999
• Issued: 05/13/2003
• Est. Priority Date: 05/07/1999
• Status: Expired due to Term

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Li, Xin, Samra, Samir A., Fam, Sun T., Comair, Claude, Ghali, Prasanna
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Nguyen, Kimbinh T.
• Application Number:
  US09/382,819
• Time in Patent Office: 1,357 Days
• Field of Search: 345/473, 345/474, 345/475, 345/861, 345/709, 345/706
• US Class Current: 345/473
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06N 3/004 Artificial life, i.e. computing arrangements simulating life
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 2213/12 Rule based animation

Abstract

Generic, abstract, encapsulated, expandable and maintainable techniques for modeling and animating computer graphics display objects can be used in a variety of different computer applications and platforms including, for example, video games developed for inexpensive home 3D video game platforms. An abstract simulation entity definition for use in real time computer simulation and animation encapsulates both the physical and behavioral characteristics of a display object. The simulation entity provides a unique “genetic plan” containing abstract attributes that may be shared among objects. Each simulation entity has the knowledge or know-how of common operations, and the ability to communicate with other simulation entities. Two separate class hierarchies may be used to differentiate between abstract components and physical components of simulation entities: an entity class hierarchy may be used to specify data structures and methods for behavior and communication; and an object class hierarchy may be used to define geometry and animation information and functions. A simulation entity can possess more than one set of object information. This allows the entity to change form (e.g., from a tiger to a bird) or perform multi-functionality during its lifetime. The simulation entity construct allows for more accurate modeling of the real world, supporting automation of simulation software production, and distributed and/or remote processing.

Claims

1. In a home or portable video game playing system of the type including a processor programmed to play an animated game, a display, and user-manipulable controls allowing a user to interact with said play of said game, a method of providing real time computer simulation and/or animation display of at least one entity at least in part in response to said user interaction, comprising:

representing said entity with a data structure comprising an entity class and at least one object class, said at least one object class defining plural alternative physical characteristic-defining components corresponding to plural different physical appearances of said entity, said entity class defining at least one behavioral characteristic-defining component modeling at least one behavioral characteristic associated with said entity, said data structure further including information defining a state associated with said entity;

reading incoming messages pertaining to skid entity; and

executing actions based on said behavioral characteristic and said reading step to provide animated game play;

wherein a first of said plural alternative physical characteristic-defining components defines a humanoid appearance, and a second of said plural alternative physical characteristic-defining components defines an appearance other than a humanoid appearance.

2. A method as in claim 1 further including sending outgoing messages based at least in part on said executing step.

3. A method as in claim 1 further including modifying said state information to transition said entity to a next state.

4. A method as in claim 3 wherein said modifying step comprises determining said next state based on a finite state machine.

5. A method as in claim 3 wherein said modifying step comprises determining said next state based on at least one of artificial intelligence, neural networks, adaptive resonant feedback loop technology, and fuzzy logic.

6. A method as in claim 1 wherein said reading step comprises reading a collision message, and said executing step includes handling a collision condition based at least in part on said behavioral characteristic-defining component.

7. A method as in claim 1 wherein said executing step includes performing animation based on predetermined animation information provided by said behavioral characteristic-defining component.

8. A method as in claim 1 wherein said predetermined animation information comprises a hierarchically-defined parts animation list.

9. A home or portable video game playing system of the type including a processor programmed to play an animated game, a display, and user-manipulable controls allowing a user to interact with said play of said game, the system for providing real time computer simulation and/or animation display of at least one entity at least in part in response to said user interaction, comprising:

a data storage element that stores at least one data structure representing said entity, said data structure comprising an entity class and at least one object class, said at least one object class defining plural alternative physical characteristic-defining components corresponding to plural different physical appearances of said entity;

said entity class defining at least one behavioral characteristic-defining component modeling at least one behavioral characteristic, and information defining a state of said entity;

a messaging facility that reads incoming messages pertaining to said entity; and

an executor coupled to said message reading facility, said executor executing actions based on said behavioral characteristic and said state to provided animated game play;

wherein a first of said plural alternative physical characteristic-defining components defines a humanoid appearance, and a second said plural alternative physical characteristic-defining components defines an appearance other than a humanoid appearance.

10. A system as in claim 9 wherein said messaging facility sends outgoing messages based at least in part on said executor.

11. A system as in claim 9 wherein said executor modifies said state information to transition said entity to a next state.

12. A system as in claim 11 wherein said executor determines said next state based on a finite state machine.

13. A system as in claim 11 wherein said executor determines said next state based on at least one of an artificial intelligence element, a neural network, an adaptive resonant feedback loop, and fuzzy logic.

14. A system as in claim 9 wherein said messaging facility reads a collision message, and said executor handles a collision condition based at least in part on said behavioral characteristic-defining component.

15. A system as in claim 9 wherein said executor performs animation based on predetermined animation information provided by said behavioral characteristic-defining component.

16. A system as in claim 15 wherein said predetermined animation information comprises a hierarchically-defined parts animation list.

17. For use with a home or portable video game playing system of the type including a processor programmed to play an animated game, a display, and user-manipulable controls allowing a user to interact with said play of said game, a data structure for use in generating a real time computer simulation and/or animation display based at least in part on said user interaction, said data structure comprising an entity class and at least one object class, said at least one object class defining:

plural alternative physical characteristic-defining components corresponding to plural different physical appearances of said entity; and

said entity class defining at least one behavioral characteristic-defining component modeling at least one behavioral characteristic of said entity;

wherein a first of said plural alternative physical characteristic-defining components defines a humanoid appearance, and a second said plural alternative physical characteristic-defining components defines an appearance other than a humanoid appearance, and

wherein said animated game play based on said data structure includes changing said entity between a humanoid appearance and other than said humanoid appearance.

18. A data structure as in claim 17 wherein said second plural alternative physical characteristic defining components defines an animal appearance.

19. A data structure as in claim 17 wherein said second said plural alternative physical characteristic defining components defines a non-sentient object appearance.

20. A data structure as in claim 19 wherein said data structure stores further information that controls transition between said plural different appearances based on external stimuli.

21. A data structure as in claim 17 wherein the behavioral characteristic defining component comprises a genetic plan.

22. A data structure as in claim 21 wherein said genetic plan defines a set of rules that determine the behavior of the entity.

23. A data structure as in claim 21 wherein said genetic plan includes code defining at least one finite state machine.

24. A data structure as in claim 21 wherein said genetic plan describes how the stimulation entity reacts to at least one external stimulus.

25. A data structure as in claim 17 wherein said physical characteristic-defining component comprises a list of display items specifying the appearance of the entity.

26. A data structure as in claim 17 wherein said physical characteristic-defining component includes at least one 3D polygon definition.

27. A data structure as in claim 17 wherein said physical characteristic-defining component includes a hierarchical tree data sub-structure.

28. A data structure as in claim 17 further including a communication facility.

29. A data structure as in claim 28 wherein said communications facility includes an input queue and an output queue.

30. A data structure as in claim 17 further including data representing status of said entity.

31. A data structure as in claim 17 wherein said physical characteristic-defining component corresponds to an object class, and said behavioral characteristic-defining component corresponds to an entity class.

32. A data structure as in claim 17 wherein said behavioral characteristic-defining component corresponds to at least one of the following entity classes:

(a) master subclass,

(b) simple actor subclass,

(c) actor subclass, or

(d) photographer subclass.

33. A data structure as in claim 17 wherein said physical characteristic-defining component corresponds to at least one of the following object classes:

(a) static object class,

(b) animated object class, and

(c) moving object class.

35. An animation authoring system as in claim 17 further including a converter that converts data in other formats to at least portions of said data structures.

34. An animation authoring system comprising:

an editor that constructs and edits data structures for use in generating a real time computer simulation and/or animation display, said data structures each comprising an entity class and at least one object class, said at least one object class defining plural alternative physical characteristic-defining components corresponding to plural different physical appearances of said entity, and said entity class defines at least one behavioral characteristic-defining component modeling at least one behavioral characteristic of said entity;

an animator that creates animation tables for use in connection with said behavioral characteristic-defining component;

a viewer that provides animation visualization based on said animation tables; and

a run time library that provides run time processing support, said runtime library adapted for use in connection with a home or portable video game playing system of the type including a processor programmed to play an animated game, a display, and user-manipulable controls allowing a user to interact with said play of said game; and

wherein a first of said plural alternative physical characteristic-defining components defines a humanoid appearance, and a second said plural alternative physical characteristic-defining components defines an appearance other than a humanoid appearance.

36. An object oriented real time 3D home or portable video game playing graphics system of the type including a processor programmed to play an animated game, a display, and user-manipulable controls allowing a user to interact with said play of said game, said system further comprising:

a storage device storing an object oriented data structure defining at least one 3D display object, said object oriented data structure inheriting at least one characteristic from at least one other object oriented data structure, said object oriented data structure defining behavioral and appearance characteristics of said 3D display object and including an entity class and at least one object class, said at least one object class defining plural alternative physical characteristic-defining components corresponding to plural different physical appearances of said entity;

a graphics engine operatively coupled to said storage device, said graphics engine rendering said 3D display object based at least in part on said object oriented data structure and said at least one characteristic inherited thereby; and

a computation engine coupled to said storage device, said computation engine modifying said object oriented data structure at run time based at least in part on user interaction with said 3D computer graphics system to provide animated game play at least in part in response to user interaction;

wherein a first of said plural alternative physical characteristic-defining components defines a humanoid appearance, and a second said plural alternative physical characteristic-defining components defines an appearance other than a humanoid appearance.

37. A system as in claim 36 wherein said computation engine computes a next state associated with said display object based at least in part on said behavioral characteristic.

38. A system as in claim 36 wherein said data structure defines first and second alternative appearance characteristic-defining components, and said computation engine selects between said first and second alternative appearance characteristic-defining components based at least in part on said behavioral characteristic.

39. For use with a home or portable video game playing system of the type including a processor programmed to play an animated game, a display, and user-manipulable controls allowing a user to interact with said play of said game, a storage medium comprising:

a first storage area storing at least one data structure for use in generating a real time computer simulation and/or animation display, said data structure comprising an entity class and at least one object class, said at least one object class defining plural alternative physical characteristic-defining components corresponding to plural different physical appearances of said entity, and said entity class including at least one behavioral characteristic-defining component modeling at least one behavioral characteristic of said entity; and

a second storage area storing executable code for use in processing said data structure and providing animated game play at least in part in response to user interaction;

wherein a first of said plural alternative physical characteristic-defining components defines a humanoid appearance, and a second said plural alternative physical characteristic-defining components defines an appearance other than a humanoid appearance.