Robot apparatus and method of controlling the motion thereof

• US 7,689,322 B2
• Filed: 06/07/2005
• Issued: 03/30/2010
• Est. Priority Date: 06/07/2004
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tanaka, Fumihide
• Primary Examiner(s): Black; Thomas G
• Assistant Examiner(s): LI, CE LI
• Application Number:
  US11/146,019
• Publication Number:
  US 20060020368A1
• Time in Patent Office: 1,757 Days
• Field of Search: 700/245, 700/259
• US Class Current: 700/259
• CPC Class Codes: B25J 13/00 Controls for manipulators programme controls B25J9/16; control in general G05
• CPC Class Codes: B25J 13/003 by means of an audio-responsive input audible safety signals B25J19/061
• CPC Class Codes: B25J 9/161 Hardware, e.g. neural networks, fuzzy logic, interfaces, processor

Abstract

The present invention provides a robot apparatus is capable of moving autonomously, flexibly responding to a motion of conforming to an external moving subject that may typically be the user of the robot apparatus and conforming to the motion of the moving subject, and also capable of modifying the conforming relationship with the moving subject. The robot apparatus is capable of moving autonomously, and comprises an input section that inputs an image or sound of an external moving subject, a plurality of motion generating sections that generate a plurality different motions in response to the image or sound input by way of the input section, conforming to the motion of the external moving subject, a motion expressing section that integrally expresses one or more than one motions out of the plurality of motions generated by the plurality of motion generating sections, and a control section that controls the number of motions integrated by the motion expressing section and the ratio of the motions to be integrated.

Claims

1. A robot apparatus capable of moving autonomously, the robot apparatus comprising:

a joint having a degree of freedom;

an actuator for actuating the joint;

input means for inputting an image of an external moving body;

a motion controller, comprising;

means for generating a waveform corresponding to the image of the moving body;

a rhythmic motion module for generating, based on the waveform, a rhythmic motion signal corresponding to a rhythm of the moving body;

means for detecting a body part in the image of the moving body;

a body position module for generating, based on the detected body part, a body position signal indicative of a position of the moving body;

a modulator for modulating the rhythmic motion signal and the body position signal; and

a body controller for controlling the actuator based on the modulated rhythmic motion signal and the modulated body position signal.

2. The robot apparatus according to claim 1, further comprising:

a microphone for receiving voice input; and

a voice recognizer for determining a mood based on the voice input,

wherein the body controller controls the modulator based on the determined mood.

3. The robot apparatus according to claim 1, wherein the rhythmic motion module includes:

a buffer for storing the waveform over a time period;

a predicted rhythmic motion module for generating, based on the stored waveform, a predicted rhythmic motion signal corresponding to a predicted rhythm of the moving body;

an actual rhythmic motion module for generating, based on a current state of the waveform, an actual rhythmic motion signal corresponding to an actual rhythm of the moving body; and

an adder for adding the predicted rhythmic motion signal and the actual rhythmic motion signal to produce the rhythmic motion signal, and

the motion generating means body positioning module includes;

a buffer for storing positioning information of the detected body part over a time period;

a predicted body position module for generating, based on the stored positioning information, a predicted body position signal corresponding to a predicted position of the moving body;

an actual body position module for generating an actual body position signal corresponding to an actual position of the detected body part; and

an adder for adding the predicted body position signal and the actual body position signal to produce the body position signal.

4. The robot apparatus according to claim 3, further comprising:

a rhythm prediction accuracy module for computing an accuracy of the predicted rhythmic motion signal relative to the actual rhythmic motion signal; and

a body position accuracy module for computing an accuracy of the predicted body position signal relative to the actual body position signal,

wherein the adders change parameters of the rhythmic motion signal and the body position signal based on the computed accuracies or according to a lapse of time.

5. The robot apparatus according to claim 1, wherein the external moving body is a user of the robot apparatus.

6. A method of controlling the motion of a robot apparatus capable of moving autonomously, the method comprising:

receiving an image of an external moving body;

generating a waveform corresponding to the image of the moving body;

generating, based on the waveform, a rhythmic motion signal corresponding to a rhythm of the moving body;

detecting a body part in the image;

generating, based on a position of the detected body part, a body position signal indicative of a position of the moving body;

modulating the rhythmic motion signal and the body position signal; and

controlling an actuator for a joint of the robot apparatus based on the modulated rhythmic motion signal and the modulated body position signal.

7. The method according to claim 6, further comprising:

receiving voice input; and

determining a mood based on the voice input,

wherein the modulation is controlled based on the mood.

8. The method according to claim 6, wherein

generating a rhythmic motion signal includes:

storing the waveform over a time period;

generating, based on the stored waveform, a predicted rhythmic motion signal corresponding to a predicted rhythm of the moving body;

generating, based on a current state of the waveform, an actual rhythmic motion signal corresponding to an actual rhythm of the moving body; and

adding the predicted rhythmic motion signal and the actual rhythmic motion signal to produce the rhythmic motion signal, and

generating a body position signal includes;

storing positioning information of the detected body part over a time period;

generating, based on the stored positioning information, a predicted body position signal corresponding to a predicted position of the moving body;

generating an actual body position signal according to an actual position of the detected body part; and

adding the predicted body position signal and the actual body position signal to produce the body position signal.

9. The method according to claim 8, further comprising:

computing an accuracy of the predicted rhythmic motion signal relative to the actual rhythmic motion signal;

computing an accuracy of the predicted body position signal relative to the actual body position signal; and

changing parameters of the rhythmic motion signal and the body position signal based on the computer accuracies or according to a lapse of time.

10. The method according to claim 6, wherein the external moving body is a user of the robot apparatus.

11. A robot apparatus capable of moving autonomously, the robot apparatus comprising:

a joint having a degree of freedom;

an actuator that actuates the joint;

an input section that inputs an image of an external moving body;

a motion controller, comprising;

a waveform generator that generates a waveform corresponding to the image of the moving body;

a rhythmic motion module that generates, based on the waveform, a rhythmic motion signal corresponding to a rhythm of the moving body;

a detector that detects a body part in the image of the moving body;

a body position module that generates, based on the detected body part, a body position signal indicative of a position of the moving body; and

a modulator that modulates the rhythmic motion signal and the body position signal; and

a body controller that controls the actuator based on the modulated rhythmic motion signal and the modulated body position signal.