Speech communication system and method, and robot apparatus
First Claim
1. A speech communication system enabling a conversation with a conversation partner, said system comprising:
- a speech recognition unit configured to recognize a speech content of the conversation partner;
a conversation control unit configured to continue the conversation using available resources;
an image recognition unit configured to recognize a face of the conversation partner; and
a tracking control unit configured to, in a normal mode, track a position of the conversation partner in response to both of a recognition result of the image recognition unit and a recognition result of the speech recognition unit, whereinwhile the speech communication system is in a failure mode as a result of an inability of the tracking control unit to track the position of the conversation partner, the conversation control unit is configured to continue the conversation without tracking including behaviors relying, in the normal mode, on tracking performed by the tracking control unit, the conversation is continued, without tracking, through the speech content of the conversation partner being recognized with the speech recognition unit and matching a predicted response.
1 Assignment
0 Petitions
Accused Products
Abstract
This invention realizes a speech communication system and method, and a robot apparatus capable of significantly improving entertainment property. A speech communication system with a function to make conversation with a conversation partner is provided with a speech recognition means for recognizing speech of the conversation partner, a conversation control means for controlling conversation with the conversation partner based on the recognition result of the speech recognition means, an image recognition means for recognizing the face of the conversation partner, and a tracking control means for tracing the existence of the conversation partner based on one or both of the recognition result of the image recognition means and the recognition result of the speech recognition means. The conversation control means controls conversation so as to continue depending on tracking of the tracking control means.
-
Citations
14 Claims
-
1. A speech communication system enabling a conversation with a conversation partner, said system comprising:
-
a speech recognition unit configured to recognize a speech content of the conversation partner; a conversation control unit configured to continue the conversation using available resources; an image recognition unit configured to recognize a face of the conversation partner; and a tracking control unit configured to, in a normal mode, track a position of the conversation partner in response to both of a recognition result of the image recognition unit and a recognition result of the speech recognition unit, wherein while the speech communication system is in a failure mode as a result of an inability of the tracking control unit to track the position of the conversation partner, the conversation control unit is configured to continue the conversation without tracking including behaviors relying, in the normal mode, on tracking performed by the tracking control unit, the conversation is continued, without tracking, through the speech content of the conversation partner being recognized with the speech recognition unit and matching a predicted response. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A speech communication method for enabling a conversation with a conversation partner, said method comprising:
-
tracking a position of the conversation partner, in a normal mode, in response to both of a speech recognition result obtained by recognizing speech of the conversation partner and a image recognition result obtained by recognizing a face of the conversation partner; and continuing the conversation with the conversation partner without tracking including behaviors relying, in the normal mode, on tracking performed by the tracking, the conversation is continued, without tracking, through the speech content of the conversation partner being recognized and matching a predicted response while the speech communication system is in a failure mode as a result of an inability to track the position of the conversation partner. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A robot apparatus comprising:
a speech communication system enabling a conversation with a conversation partner, said system including a speech recognition unit configured to recognize a speech content of the conversation partner; a conversation control unit configured to the conversation using available resources; an image recognition unit configured to recognize a face of the conversation partner; and a tracking control unit configured to, in a normal mode, track a position of the conversation partner in response to both of a recognition result of the image recognition unit and a recognition result of the speech recognition unit, wherein while the speech communication system is in a failure mode as a result of an inability of the tracking control unit to track the position of the conversation partner, the conversation control unit is configured to continue the conversation without tracking including behaviors relying, in the normal mode, on tracking performed by the tracking control unit, the conversation is continued, without tracking, through the speech content of the conversation partner being recognized with the speech recognition unit and matching a predicted response.
Specification