Methods for spontaneously generating behavior in two and three-dimensional images and mechanical robots, and of linking this behavior to that of human users

• US 10,207,405 B2
• Filed: 01/22/2015
• Issued: 02/19/2019
• Est. Priority Date: 03/31/2014
• Status: Active Grant

• Current Assignee: Christopher Deane Shaw
• Original Assignee: Christopher Deane Shaw
• Inventors: Shaw, Christopher Deane
• Primary Examiner(s): Amin, Bhavesh V
• Application Number:
  US14/603,094
• Publication Number:
  US 20150279077A1
• Time in Patent Office: 1,489 Days
• CPC Class Codes: A63F 13/56 Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
• CPC Class Codes: A63F 13/60 Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• CPC Class Codes: B25J 9/1633 compliant, force, torque control, e.g. combined with position control
• CPC Class Codes: B25J 9/1679 characterised by the tasks executed

Abstract

The spontaneous animation methods disclosed herein generate apparent emotions and apparent willful actions in artificial characters using mathematical formulae. Because these animations are spontaneously calculated, they are precisely tailored to interactive input. This is in contrast to current methods for creating interactive characters, in which the computer selects among predetermined animation sequences to approximate an appropriate reaction.

In addition to spontaneously generating emotional states and actions, this method is further capable of spontaneously evolving a progression of emotive states and actions, thereby simulating an evolving emotional relationship and/or creating extended interactive sequences with a plot-like structure.

Because spontaneous animation replaces stored behaviors with realtime calculations, it can require thousands of times less data than animation methods currently used in animation and gaming.

Claims

1. A method of creating apparent emotions or moods in a computer-controlled artificial character or robot using a computer or a computer-controlled device, the method comprising:

(a) using one or more processors to select one or more variable oscillator mathematical formulas/equations, where each of these generate an adjustable oscillation which is controlled by changing a value of one or more parameter contained within the variable oscillator mathematical formulas/equations, in the manner of a spring equation which calculates the motion of a virtual spring, wherein the parameter known as a spring constant, k, determines the virtual spring'"'"'s strength, and therefore the virtual spring'"'"'s speed of oscillation, or bouncing back and forth, and wherein the additional parameter, known as damping, d, determines the rapidity with which the virtual spring ceases bouncing and comes to rest;

creating one or more of an array of Physiological derived behaviors (PDB) using the Variable oscillator mathematical formulas/equations;

(b) running the one or more variable oscillator mathematical formulas/equations on the one or more processors of a computer, whereby each of the variable oscillator mathematical formulas/equations is calculating a numerical output in real time, in the manner in which the spring equation calculates the numerical output which represents the displacement of the virtual spring being modeled;

(c) Sending the numerical output of the one or more mathematical equations from the one or more computer processors and receiving the numerical output into the one or more processors of the computer controlled artificial character (artificial character) or robot, which affects some element of a behavior of the artificial character or the robot;

in the case of the artificial character, the numerical output is sent to a display where the artificial character is shown to a user;

in the case of the robot, the numerical output is imported into the one or more processors which modifies the position or sound of the robot;

the one or more processors manipulates the robot or the artificial character in one or more of the following manners;

Facial Expression—

in the case of the artificial character, the numerical output (derived within the computer processor) is applied to the artificial character controls running within the processor that modify the artificial character'"'"'s face;

in the case of the robot, the numerical output regulates the devices that deform the robot'"'"'s face to show emotion;

Body Movements—

in the case of the artificial character, the numerical output is applied to the artificial character controls running within the processor that modify a degree of one or more body movements, whereas, in the case of the robot, the numerical output regulates the degree of the mechanical manipulation of the robot;

Vocal Patterns—

the numerical output produced by the processor is applied within a device modifying characteristics of an artificial voice to control one or more of the following;

the artificial voice'"'"'s pitch, the artificial voice'"'"'s volume, the rate at which the artificial voice is speaking via separate oscillators;

(f) using one or more of a sensing device while the user is interacting with the computer generated artificial character, computer-controlled device or robot to measure natural patterns of the user'"'"'s behavior which resemble the variable oscillation mathematical equations/formulas which generate an adjustable oscillation, whereby the sensing devices including one or more of the following;

A Touchpad—

used to record patterns of user input which reflect emotional state, such as fast jittery movements, or slow sluggish movement;

A User-Facing Camera—

used in combination with computer vision software to extract the user'"'"'s facial expression, as well as the user'"'"'s movements;

(g) transmitting the natural patterns of the user'"'"'s behavior measured by the sensing device to the one or more computer processor;

(h) mathematically linking, via the one or more computer processors, the natural patterns of the user'"'"'s behavior to the Variable oscillation mathematical equations/formulas which generate adjustable oscillations, in the manner of coupled oscillators, whereby patterns and apparent moods induced in the artificial character or robot appear to mirror changing moods of the user as sensed by one or more of the sensing devices.

2. The method of claim 1, further comprising:

i) creating via one or more processors on a computer which runs a separate non-transitory computer program on a computer readable medium, which generates independent calculations of one or more of the parameters within the variable oscillator equations running on the one or more computer processors;

(j) Feeding back the independent calculations of one or more of the parameters into the variable oscillator mathematical equations/formulas being run on the one or more computer processors.