Communication terminal controlled through touch screen or voice recognition and instruction executing method thereof

• US 20030009330A1
• Filed: 05/22/2002
• Published: 01/09/2003
• Est. Priority Date: 07/07/2001
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Cho, Su-kyung
• Granted Patent: US 7,167,826 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

An information terminal having a touch screen on which an instruction is input by touching the screen and the result of executing the instruction is displayed includes: a voice recognition and learning unit for recognizing an input voice signal; and a system controller which when a predetermined item on the touch screen is touched, recognizes an instruction corresponding to the coordinates of the touched item, and which when a voice corresponding to a sub-instruction associated with the recognized instruction is recognized by the voice recognition and learning unit, executes the corresponding sub-instruction. If a currently input voice does not correspond to an instruction to be executed, the information terminal stores the fact that the currently input voice is a voice instruction for the instruction to be executed.

Claims

1. An instruction executing method performed by an information terminal in which an instruction is executed by recognizing coordinates of a selected item or a voice of a user when one of a plurality of items displayed on a touch screen is selected, the method comprising the steps of:

(a) recognizing the voice of the user input when one of the items is selected on the touch screen;

(b) upon recognizing a voice corresponding to one of a plurality of sub-instructions corresponding to coordinates of the item selected in step (a), executing a corresponding sub-instruction; and

(c) upon recognizing no voice corresponding to any one of the sub-instructions, displaying the plurality of sub-instructions on the touch screen.

2. The method as claimed in claim 1, further comprising the step of, if one of the sub-instructions displayed on the touch screen is selected, recognizing the selected sub-instruction and learning a voice for the selected sub-instruction.

4. The method as claimed in claim 1, wherein if the user'"'"'s voice is recognized, a recognized sub-instruction is displayed on the touch screen, thereby indicating that the sub-instruction is normally recognized.

6. The method as claimed in claim 2, wherein while the voice for the selected sub-instruction is learned, the voice input by the user is reproduced, thereby indicating that the voice has been learned.

8. A recording medium on which the method claimed in claim 1 is recorded in a program code that can be executed on a computer.

9. A recording medium on which the method claimed in claim 2 is recorded in a program code that can be executed on a computer.

11. A recording medium on which the method claimed in claim 4 is recorded in a program code that can be executed on a computer.

13. A recording medium on which the method claimed in claim 6 is recorded in a program code that can be executed on a computer.

16. The information terminal as claimed in claim 15, wherein the system controller displays the plurality of sub-instructions on the touch screen if a voice corresponding to the sub-instruction of the recognized instruction is not recognized, and controls the voice recognition and learning unit so that the voice recognition and learning unit learns that a sub-instruction corresponding to the input voice signal is the selected sub-instruction if one of the plurality sub-instructions is selected.

17. The information terminal as claimed in claim 15, wherein the voice recognition and learning unit reproduces the input voice signal while learning the voice corresponding to the selected sub-instruction.

18. The information terminal as claimed in claim 16, wherein the voice recognition and learning unit reproduces the input voice signal while learning the voice corresponding to the selected sub-instruction.

3. An instruction executing method performed by an information terminal in which an instruction is executed by recognizing the coordinates of a selected item or a voice of a user when one of a plurality of items displayed on a touch screen is selected, the method comprising the steps of:

(a) recognizing an instruction corresponding to the coordinates of a selected item when one of items is selected on the touch screen;

(b) executing the recognized instruction if the recognized instruction is not determined to have any sub-instruction associated therewith;

(c) waiting for the input of a user'"'"'s voice if the recognized instruction is determined to have two or more sub-instructions;

(d) upon receiving the user'"'"'s voice, recognizing the user'"'"'s voice and thus a sub-instruction corresponding to the recognized voice and returning to step (b);

(e) upon not recognizing a voice corresponding to any one of the sub-instructions in step (d), displaying the sub-instructions on the touch screen; and

(f) upon selecting one of the sub-instructions on the touch screen, recognizing the selected sub-instruction through coordinates thereof and returning to step (b) and learning a voice for the selected sub-instruction.

5. The method as claimed in claim 3, wherein if the user'"'"'s voice is recognized, a recognized sub-instruction is displayed on the touch screen, thereby indicating that the sub-instruction is normally recognized.

7. The method as claimed in claim 3, wherein while the voice for the selected sub-instruction is learned, the voice input by the user is reproduced, thereby indicating that the voice has been learned.

10. A recording medium on which the method claimed in claim 3 is recorded in a program code that can be executed on a computer.

12. A recording medium on which the method claimed in claim 5 is recorded in a program code that can be executed on a computer.

14. A recording medium on which the method claimed in claim 7 is recorded in a program code that can be executed on a computer.

15. An information terminal having a touch screen on which an instruction is input by touching the screen and the result of executing the instruction is displayed, the information terminal comprising:

a voice recognition and learning unit for recognizing a voice signal input from outside the information terminal; and

a system controller which when a predetermined item on the touch screen is touched, recognizes an instruction corresponding to coordinates of the touched item, and which when a voice corresponding to one of a plurality of sub-instructions associated with the recognized instruction is recognized by the voice recognition and learning unit, executes the corresponding sub-instruction.