METHOD AND APPARATUS FOR EXECUTING A USER FUNCTION USING VOICE RECOGNITION

• US 20130179173A1
• Filed: 01/11/2013
• Published: 07/11/2013
• Est. Priority Date: 01/11/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: PARK, Sehwan, LEE, Dongyeol
• Granted Patent: US 10,347,246 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A method and an apparatus for executing a user function using voice recognition. The method includes displaying a user function execution screen; confirming a function to be executed according to voice input; displaying a voice command corresponding to the confirmed function on the user function execution screen; recognizing a voice input by a user, while a voice recognition execution request is continuously received; and executing the function associated with the input voice command, when the recognized voice input is at least one of the displayed voice command.

Claims

1. A method for executing a user function by an electronic device using voice recognition, the method comprising:

displaying a user function execution screen;

confirming a function to be executed according to voice input;

displaying a voice command corresponding to the confirmed function on the user function execution screen;

recognizing a voice input by a user, while a voice recognition execution request is continuously received; and

executing the function associated with the input voice command, when the recognized voice input is at least one of the displayed voice command.

2. The method of claim 1, wherein the voice command is displayed around an image component of the user function execution screen or in a blanket of the user function execution screen.

3. The method of claim 1, wherein the voice command is displayed around an image component associated with a function corresponding to the voice command.

4. The method of claim 1, wherein the voice command is displayed around a mounted location of a key input unit generating a key input event, when a function executed according to the voice input is a function executed by the key input event.

5. The method of claim 1, further comprises determining whether the voice input by the user corresponds to at least one of the displayed voice command.

6. The method of claim 1, wherein the function includes one of a function executed when a touch event and a key input event are received, and a preset function of a certain application.

7. The method of claim 1, further comprising:

testing similarity voice commands; and

changing at least one of similar voice commands, according to a result of the testing, before displaying the voice command.

8. The method of claim 1, further comprising removing the displayed voice command from the execution screen to terminate the voice recognition, when the voice recognition execution request is no longer received.

9. The method of claim 1, further comprising dynamically changing and searching voice commands associated with a displayed screen as a candidate recognition target each time a displayed screen is changed.

11. The apparatus of claim 9, wherein the voice command is displayed around an image component of the user function execution screen or in a blanket of the user function execution screen.

12. The apparatus of claim 9, wherein the voice command is displayed around an image component associated with a function corresponding to the voice command.

13. The apparatus of claim 9, wherein the voice command is displayed on a side of the user function execution screen in a direction of the touch event.

14. The apparatus of claim 9, wherein the voice command is displayed in a start location of the touch event among the user function execution screen.

15. The apparatus of claim 9, wherein the voice command is displayed in a tool tip, a pop-up window, or a list form.

16. The apparatus of claim 9, wherein the controller confirms the function executed according to the voice input, calls a command display map including a display location of a voice command associated with the user function execution screen, and controls the display unit to display corresponding voice commands by functions on the execution screen.

17. The apparatus of claim 9, wherein the controller stores a display location of the voice command associated with the user function execution screen.

10. An apparatus for executing a user function using voice recognition, the apparatus comprising:

a display unit that displays a user function execution screen;

an input that enters a voice recognition execution request when pressed;

an audio processor that collects and records voice input; and

a controller that receives the voice recognition execution request from the input, confirms a function executed according to the voice input, and controlling the display unit to display a voice command corresponding to the confirmed function on the user function execution screen, while the voice recognition execution request is being received, recognizing the voice input, and executing the function associated with an input voice command, when the displayed voice command is input, based on the recognized voice input.

18. The apparatus of claim 10, wherein the controller determines whether the voice input by the user is at least one of the displayed voice command.

19. The apparatus of claim 10, wherein the function executed according to the voice input includes one of a function executed according to the touch event for the user function, and a key input event and a preset function of a certain application.

20. The apparatus of claim 10, wherein the controller removes the displayed voice command, when the voice recognition execution request is no longer received, and terminates the voice recognition.

21. A voice recognition system comprising:

an application layer configured by applications providing an object; and

a user interface framework for outputting a user execution screen configured by the object collected from the application layer, searching a voice command associated with the object from stored voice commands, when a screen is switched to the execution screen to determine a candidate voice recognizable command while displaying the execution screen, and transferring the determined candidate voice recognizable command to a voice recognition engine.

22. The system of claim 21, wherein the user interface framework reconfigures the execution screen to display the candidate voice recognizable command.

23. The system of claim 21, further comprising:

a multimedia framework for recording a user voice; and

a voice framework having the voice recognition engine;

the voice framework receives recorded voice data from the multimedia framework, and determines whether the voice data accords with at least one of the candidate voice command.