Dialogue apparatus, dialogue parent apparatus, dialogue child apparatus, dialogue control method, and dialogue control program

• US 20040068406A1
• Filed: 07/16/2003
• Published: 04/08/2004
• Est. Priority Date: 09/27/2001
• Status: Abandoned Application

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Mizutani, Kenji, Hirose, Yoshifumi, Matsui, Kenji, Yoshizawa, Shinichi, Maekawa, Hidetsugu, Wakita, Yumi
• Application Number:
  US10/466,785
• Publication Number:
  US 20040068406A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04N 7/14 Systems for two-way working H04N7/12, H04N7/173 take precedence
• CPC Class Codes: H04N 7/16 Analogue secrecy systems; Analogue subscription systems

Abstract

Even with an apparatus structure of a relatively small size, the possibility of misrecognizing speeches of a viewer can be reduced, and a conversation is smoothly sustained, whereby the viewer can readily have an impression that the conversation is established almost naturally. Such effects can be achieved by the following features. An image output section displays images which transit in a non-interactive manner for a viewer, such as broadcast images, or the like, on a display section. A conversation processing section outputs apparatus speech data for commencing a conversation based on conversation data which is stored in a conversation database and which is determined according to the transition of the images. When a speech is emitted by a viewer, the conversation processing section outputs apparatus speech data for replying to the speech of the viewer based on viewer speech data output from a speech recognition section and the conversation data.

Claims

1. A conversation apparatus, comprising:

display control means for displaying on a display section images which transit in a non-interactive manner for a viewer based on image data;

conversation data storage means for storing conversation data corresponding to the transition of the images;

speech recognition means for performing recognition processing based on a speech emitted by the viewer to output viewer speech data which represents a speech content of the viewer;

conversation processing means for outputting apparatus speech data which represents a speech content to be output by the conversation apparatus based on the viewer speech data, the conversation data, and timing information determined according to the transition of the images; and

speech control means for allowing a speech emitting section to emit a sound based on the apparatus speech data.

2. A conversation apparatus according to claim 1, further comprising input means, to which the image data and the conversation data are input through at least one of a wireless communication, a wire communication, a network communication, and a recording medium, and from which the input data is output to the display control means and the conversation data storage means.

3. A conversation apparatus according to claim 2, wherein the input means is structured such that the image data and the conversation data are input through different routes.

4. A conversation apparatus according to claim 2, wherein the input means is structured such that the conversation data is input at a predetermined timing determined according to the image data to output the timing information.

5. A conversation apparatus according to claim 2, further comprising viewer speech data storage means for storing the viewer speech data,

wherein the conversation processing means is structured to output the apparatus speech data based on the viewer speech data stored in the viewer speech data storage means and conversation data newly input to the input means after the viewer utters the speech on which the viewer speech data depends.

6. A conversation apparatus according to claim 1, wherein the conversation processing means is structured to output the apparatus speech data based on the timing information included in the image data.

7. A conversation apparatus according to claim 6 wherein:

the conversation data storage means is structured to store a plurality of conversation data;

the image data includes conversation data specifying information for specifying at least one of the plurality of conversation data together with the timing information; and

the conversation processing means is structured to output the apparatus speech data based on the timing information and the conversation data specifying information.

8. A conversation apparatus according to claim 1, further comprising time measurement means for outputting the timing information determined according to elapse of time during the display of the images,

wherein the conversation data includes output time information indicating the timing at which the apparatus speech data is to be output by the conversation processing means, and

the conversation processing means is structured to output the apparatus speech data based on the timing information and the output time information.

9. A conversation apparatus according to claim. 1, wherein the conversation processing means is structured to output the apparatus speech data based on the conversation data and the timing information, thereby commencing a conversation with the viewer, and on the other hand, output the apparatus speech data based on the conversation data and the viewer speech data, thereby continuing the above commenced conversation.

10. A conversation apparatus according to claim 9, wherein the conversation processing means is structured to commence the new conversation based on the degree of conformity between the apparatus speech data and the viewer speech data in a conversation already commenced with a viewer and based on the priority for commencing a new conversation with the viewer.

11. A conversation apparatus according to claim 9, wherein the conversation processing means is structured to commence a conversation with a viewer based on profile information about the viewer and conversation commencement condition information which represents a condition for commencing a conversation with the viewer according to the profile information.

12. A conversation apparatus according to claim 9, wherein the conversation processing means is structured to commence a new conversation based on the degree of conformity between the apparatus speech data and the viewer speech data in a conversation already commenced with a viewer, profile information about the viewer, and conversation commencement condition information which represents a condition for commencing a conversation with the viewer according to the degree of conformity and the profile information.

13. A conversation apparatus according to claim 12, wherein the conversation processing means is structured to update the profile information according to the degree of conformity between the apparatus speech data and the viewer speech data in the commenced conversation.

14. A conversation apparatus according to claim 1, wherein the conversation processing means is structured to output the apparatus speech data when a certain series of the images are displayed in succession for a predetermined time length.

15. A conversation host device comprising:

input means to which image data representing images which transit in a non-interactive manner for a viewer and conversation data corresponding to the transition of the images are input through at least one of a wireless communication, a wire communication, a network communication, and a recording medium;

display control means for displaying the images on a display section based on the image data; and

transmitting means for transmitting the conversation data and timing information determined according to the transition of the images to a conversation slave device.

16. A conversation slave device comprising:

receiving means for receiving conversation data which is transmitted from a conversation host device and which corresponds to transition of images which transit in a non-interactive manner for a viewer and timing information determined according to the transition of the images;

conversation data storage means for storing the conversation data;

speech recognition means for performing recognition processing based on a speech emitted by the viewer to output viewer speech data which represents a speech content of the viewer;

conversation processing means for outputting apparatus speech data which represents a speech content to be output by the conversation slave apparatus based on the viewer speech data, the conversation data, and the timing information; and

speech control means for allowing a speech emitting section to emit a sound based on the apparatus speech data.

17. A conversation control method comprising:

a display control step of allowing a display section to display images which transit in a non-interactive manner for a viewer based on image data;

a speech recognition step of performing recognition processing based on a speech emitted by the viewer to output viewer speech data which represents a speech content of the viewer;

a conversation processing step of outputting apparatus speech data which represents a speech content to be output by a conversation apparatus based on the viewer speech data, the conversation data which corresponds to the transition of the images, and the timing information determined according to the transition of the images; and

a speech control step of allowing a speech emitting section to emit a sound based on the apparatus speech data.

18. A conversation control method comprising:

an input step of inputting image data representing images which transit in a non-interactive manner for a viewer and conversation data corresponding to the transition of the images through at least one of a wireless communication, a wire communication, a network communication, and a recording medium;

a display control step of displaying the images on a display section based on the image data; and

a transmission step of transmitting the conversation data and timing information determined according to the transition of the images to a conversation slave device.

19. A conversation control method comprising:

a reception step of receiving conversation data which is transmitted from a conversation host device and which corresponds to transition of images which transit in a non-interactive manner for a viewer and of receiving timing information determined according to the transition of the images;

a speech recognition step of performing recognition processing based on a speech emitted by the viewer to output viewer speech data which represents a speech content of the viewer;

a conversation processing step of outputting apparatus speech data which represents a speech content to be output by the conversation slave apparatus based on the viewer speech data, the conversation data, and the timing information; and

a speech control step of allowing a speech emitting section to emit a sound based on the apparatus speech data.

20. A conversation control program for instructing a computer to execute the following steps:

a display control step of allowing a display section to display images which transit in a non-interactive manner for a viewer based on image data;

a speech recognition step of performing recognition processing based on a speech emitted by the viewer to output viewer speech data which represents a speech content of the viewer;

a conversation processing step of outputting apparatus speech data which represents a speech content to be output by a conversation apparatus based on the viewer speech data, the conversation data which corresponds to the transition of the images, and the timing information determined according to the transition of the images; and

a speech control step of allowing a speech emitting section to emit a sound based on the apparatus speech data.

21. A conversation control program for instructing a computer to execute the following steps:

an input step of inputting image data representing images which transit in a non-interactive manner for a viewer and conversation data corresponding to the transition of the images through at least one of a wireless communication, a wire communication, a network communication, and a recording medium;

a display control step of displaying the images on a display section based on the image data; and

a transmission step of transmitting the conversation data and timing information determined according to the transition of the images to a conversation slave device.

22. A conversation control program for instructing a computer to execute the following steps:

a reception step of receiving conversation data which is transmitted from a conversation host device and which corresponds to transition of images which transit in a non-interactive manner for a viewer and timing information determined according to the transition of the images;

a speech recognition step of performing recognition processing based on a speech emitted by the viewer to output viewer speech data which represents a speech content of the viewer;

a conversation processing step of outputting apparatus speech data which represents a speech content to be output by the conversation slave apparatus based on the viewer speech data, the conversation data, and the timing information; and

a speech control step of allowing a speech emitting section to emit a sound based on the apparatus speech data.