System and method for supporting interactive user interface operations and storage medium
First Claim
1. An interactive operation supporting system for an apparatus, comprising a display unit, a speech input unit, a speech output unit and an operation control unit, wherein said operation control unit comprises:
- an assistant control means for generating a personified assistant and making said assistant appear on a screen of said display unit;
an output speech control means for determining speech required for said assistant to output said assistant'"'"'s speech to the outside through said speech output unit after speech synthesis;
an input speech recognition means for recognizing user'"'"'s voice as a speech inputted through said speech input unit;
an interaction management means for managing interaction between said assistant and said user according to said assistant'"'"'s speech determined by said output speech control means and said user speech recognized by said input speech recognition means;
an ambient state generating means for enabling said personified assistant to act as if urging the user to input commands using the input speech recognition means when the interactive operating system is placed in a wait state;
a connection means for connecting a television set/monitor to said system;
a command interpreting means for specifying a user'"'"'s intention or specifying said inputted user command based on a content of interaction traced by said interaction management means; and
a command execution means for executing function commands, said function commands including a channel selection or channel change command,wherein in response to said command interpreting means interpreting an inputted user command as a channel change command, said assistant control means places respective changeable broadcasting program display windows in the shape of a ring around said assistant, and a part of the ring has a gap with no broadcasting program display window, and a broadcasting program display window of a program on a temporarily selected channel is placed at the forefront of the ring,wherein said output speech control means determines an assistant'"'"'s speech based on a content of interaction managed by said interaction management means or an inputted user command specified by said command interpreting means, andwherein said output speech control means determines an assistant'"'"'s speech for leading a user'"'"'s intention when said command interpreting means fails to specify said user'"'"'s intention or said inputted user command.
1 Assignment
0 Petitions
Accused Products
Abstract
There is provided a system for supporting interactive operations for inputting user commands to a household electric apparatus such as a television set/monitor and information apparatuses. According to the system for supporting interactive operations applying an animated character called a personified assistant interacting with a user based on speech synthesis and animation, realizing a user-friendly user interface and simultaneously making it possible to meet a demand for complex commands or providing an entry for services. Further, since the system is provided with a command system producing an effect close to human natural language, the user can easily operate the apparatus with a feeling close to ordinary human conversation.
-
Citations
42 Claims
-
1. An interactive operation supporting system for an apparatus, comprising a display unit, a speech input unit, a speech output unit and an operation control unit, wherein said operation control unit comprises:
-
an assistant control means for generating a personified assistant and making said assistant appear on a screen of said display unit; an output speech control means for determining speech required for said assistant to output said assistant'"'"'s speech to the outside through said speech output unit after speech synthesis; an input speech recognition means for recognizing user'"'"'s voice as a speech inputted through said speech input unit; an interaction management means for managing interaction between said assistant and said user according to said assistant'"'"'s speech determined by said output speech control means and said user speech recognized by said input speech recognition means; an ambient state generating means for enabling said personified assistant to act as if urging the user to input commands using the input speech recognition means when the interactive operating system is placed in a wait state; a connection means for connecting a television set/monitor to said system; a command interpreting means for specifying a user'"'"'s intention or specifying said inputted user command based on a content of interaction traced by said interaction management means; and a command execution means for executing function commands, said function commands including a channel selection or channel change command, wherein in response to said command interpreting means interpreting an inputted user command as a channel change command, said assistant control means places respective changeable broadcasting program display windows in the shape of a ring around said assistant, and a part of the ring has a gap with no broadcasting program display window, and a broadcasting program display window of a program on a temporarily selected channel is placed at the forefront of the ring, wherein said output speech control means determines an assistant'"'"'s speech based on a content of interaction managed by said interaction management means or an inputted user command specified by said command interpreting means, and wherein said output speech control means determines an assistant'"'"'s speech for leading a user'"'"'s intention when said command interpreting means fails to specify said user'"'"'s intention or said inputted user command. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A method for supporting interactive operation of an apparatus or other externally connected apparatus including a display unit, a speech input unit and a speech output unit, comprising:
-
an assistant control step for generating a personified assistant and making said generated assistant appear on a screen of said display unit; an output speech control step for determining a speech required for the assistant to output the assistant'"'"'s speech to the outside through said speech output unit after speech synthesis; an input speech recognition step for recognizing a user'"'"'s voice as a speech inputted through said speech input unit; an interaction management step for managing interaction between said assistant and said user according to said assistant'"'"'s speech determined by said output speech control step and said user speech recognized by said input speech recognition step;
an ambient state generating step for enabling said personified assistant to act as if urging the user to input commands using the input speech recognition step when the interactive operating system is placed in a wait state;a command interpreting step for specifying said user'"'"'s intention or specifying said inputted user command based on a content of interaction traced by said interaction management step; a connecting step for connecting a television set/monitor to said apparatus; a command executing step for executing function commands, said function commands including a channel selection or channel change command; a first determining step for determining an assistant'"'"'s speech based on the content of interaction managed by said interaction management step or an inputted user command specified by said command interpreting step; a second determining step for determining an assistant'"'"'s speech for leading a user'"'"'s intention when said command interpreting step fails to specify said user'"'"'s intention or said inputted user command; and a positioning step for, in response to interpreting an inputted user command as a channel change command by the command interpreting step, placing respective changeable broadcasting program display windows in the shape of a ring around said assistant, and placing a gap with no broadcasting program display window as a part of the ring, and a placing broadcasting program display window of a program on a temporarily selected channel at the forefront of the ring. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)
-
Specification