METHOD AND APPARATUS FOR PERFORMING PRESET OPERATION MODE USING VOICE RECOGNITION

• US 20140100850A1
• Filed: 07/30/2013
• Published: 04/10/2014
• Est. Priority Date: 10/08/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: WON, Sung-Joon
• Application Number:
  US13/954,432
• Publication Number:
  US 20140100850A1
• Time in Patent Office: Days
• US Class Current: 704/250
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A method and apparatus of performing a preset operation by using voice recognition are provided. The method includes performing the preset operation of a preset operation mode according to a key input or a touch input in the preset operation mode; and recognizing an input voice during performance of the preset operation of the preset operation mode and assisting the performance of the preset operation according to the recognized voice.

Claims

1. A method of performing a preset operation by using voice recognition, the method comprising:

performing the preset operation of a preset operation mode according to a key input or a touch input in the preset operation mode; and

recognizing an input voice during performance of the preset operation of the preset operation mode and assisting the performance of the preset operation according to the recognized voice.

2. The method of claim 1, wherein the preset operation mode corresponds to a text writing mode, and

performing the preset operation comprises displaying an input text according to the key input or the touch input in the text writing mode on a text display window, and

assisting the preset operation comprises recognizing the input voice while displaying the input text according to the key input or the touch input on the text display window, comparing the displayed text with the recognized voice, determining that the displayed text has an error when the displayed text is not identical to the recognized voice, and converting the recognized voice to text and modifying the displayed text when it is determined that the displayed text has the error.

3. The method of claim 2, further comprising, determining that the displayed text has no error when the displayed text is identical to the recognized voice, and when it is determined that the displayed text has no error,

determining whether the recognized voice is a preset operation command;

and

performing the preset operation by applying the recognized voice when the recognized voice is the preset operation command.

4. The method of claim 1, wherein the preset operation mode is a text writing mode, and

performing the preset operation comprises displaying an input text according to a key input or a touch input in the text writing mode on a text display window, and

assisting the preset operation comprises recognizing the input voice while displaying the input text according to the key input or the touch input on the text display window, determining whether the recognized voice is a preset operation command, performing the preset operation by applying the recognized voice when the recognized voice is the preset operation command, comparing the displayed text with the recognized voice when the recognized voice is not the preset operation command, determining that the displayed text has an error when the displayed text is not identical to the recognized voice and determining that the displayed text has no error when the displayed text is identical to the recognized voice, and converting the recognized voice to text and modifying the displayed text when it is determined that the displayed text has the error.

5. The method of claim 2, wherein modifying the displayed text comprises:

converting the recognized voice to text and displaying the voice converted text on a voice assist window; and

changing the displayed text on the text display window to the displayed voice converted text when a preset function of changing contents of the text display window to contents of the voice assist window is applied.

6. The method of claim 4, wherein modifying the displayed text comprises:

converting the recognized voice to text and displaying the voice converted text on a voice assist window; and

changing the displayed text on the text display window to the displayed voice converted text when a preset function of changing contents of the text display window to contents of the voice assist window is applied.

7. The method of claim 3, wherein performing the preset operation comprises:

performing the preset operation when the recognized voice is the preset operation command; and

outputting a result of the performance when the performance of the preset operation is completed,

wherein displaying the input text according to the key input or the touch input on the text display window is not interrupted during performing the preset operation.

8. The method of claim 4, wherein performing the preset operation comprises:

performing the preset operation when the recognized voice is the preset operation command; and

outputting a result of the performance when the performance of the preset operation is completed,

wherein displaying the input text according to the key input or the touch input on the text display window is not interrupted during performing the preset operation.

9. The method of claim 1, wherein the preset operation mode is a state where lists of a preset list menu are displayed, and

performing the preset operation comprises performing a scrolling operation of the displayed list according to the touch input on the displayed lists, and

assisting the preset operation comprises recognizing the input voice in performing the scrolling operation of the displayed lists, and performing the preset operation by applying the recognized voice when the recognized voice is a preset operation command.

10. The method of claim 9, wherein the touch input is a scrolling touch input, the preset operation command is a command set to automatically perform the scrolling operation on the displayed list to a desired position, and the command set to automatically perform the scrolling operation on the displayed list to the desired position includes a command set to automatically perform a scrolling operation to a position of one or more words, a characteristic string or a phrase, a position of a part of all lists, and a position of a language for each country.

11. The method of claim 1, wherein the preset operation mode is a state where one of pages of a preset home screen including preset items is displayed,

performing the preset operation comprises performing an operation of selecting one or more items of one page of the home screen according to the touch input when the one page of the home screen is displayed and then moving the selected items to another page of the home screen, and

assisting the preset operation comprises recognizing the input voice in performing the operation of moving the selected items to another page of the home screen, and performing the preset operation according to a preset operation command by applying the recognized voice when the recognized voice is the preset operation command.

12. The method of claim 11, wherein the touch input is a dragging touch input,

a dragging operation includes an operation of placing the items when there is a space to place the moved items in a position where the touch ends and returning the items to an original position when there is no space,

the preset operation command includes a command set to automatically move the one or more items in the page of the home screen to another page of the home screen, determining whether the recognized voice is the preset operation command comprises determining whether, when the one or more items in the page of the home screen are dragged to another page of the home screen by applying a touch to the items, there is a space to place the dragged items in another page of the home screen, and

determining whether the recognized voice is the preset operation command when the items are dragged by applying the touch to the items when there is no space to place the dragged items, and

performing the preset operation according to the preset operation command of the recognized voice comprises performing the preset operation command when the recognized voice is the preset operation command, and ending the touch applied to the dragged items and placing the dragged items in a page of the home screen where the touch ends when there is the space to place the dragged items.

13. The method of claim 12, wherein the preset operation command includes a command set to generate a new page of the home screen.

14. An apparatus for performing a preset operation by using voice recognition, the apparatus comprising:

an input/output module including at least one button and a physical or virtual keypad configured to receive a control input of a user, and a microphone receiving an input voice from the user;

a touch screen configured to receive a control input of the user and display an execution image, an operation state, and a menu state of an application program; and

a controller configured to control the input/output module and the touch screen, the controller including a voice recognition module for recognizing the voice input by the user through the microphone of the input/output module, the controller further configured to perform the preset operation according to a key input or a touch input from the touch screen, and apply a recognized voice of the user received from the voice recognition module to assist performance of the preset operation.

15. The apparatus of claim 14, wherein, in order to apply the recognized voice to assist the performance of the preset operation, the controller displays a text received from the input/output module on a text display window of the touch screen, recognizes the voice received from the input/output module, compares the displayed text with the recognized voice, determines that the displayed text has an error when the displayed text is not identical to the recognized voice, and converts the recognized voice to text and modifies the displayed text when the displayed text has the error.

16. The apparatus of claim 14, wherein, in order to apply the recognized voice to assist the performance of the preset operation, the controller displays a text received from the input/output module on a text display window of the touch screen, recognizes the voice received from the input/output module, determines whether the recognized voice is a preset operation command, performs the preset operation when the recognized voice is the preset operation command, compares the displayed text with the recognized voice, determines that the displayed text has an error when the displayed text is not identical to the recognized voice, and converts the recognized voice to text and modifies the displayed text when the displayed text has the error.

17. The apparatus of claim 15, wherein, in order to modify the displayed text, the controller converts the recognized voice to the text, displays the voice converted text on a voice assist window of the touch screen, and selects to change contents of the text display window to contents of the voice assist window, and changes the displayed text on the text display window to the displayed voice converted text when the user selects to change the contents of the text display window into the contents of the voice assist window.

18. The apparatus of claim 16, wherein, in order to modify the displayed text, the controller converts the recognized voice to the text, displays the voice converted text on a voice assist window of the touch screen, and selects to change contents of the text display window to contents of the voice assist window, and changes the displayed text on the text display window to the displayed voice converted text when the user selects to change the contents of the text display window into the contents of the voice assist window.

19. The apparatus of claim 15, wherein, when the displayed text is identical to the recognized voice through the comparison between the displayed text and the recognized voice, the controller determines that the displayed text has no error and performs the preset operation according to a preset operation command by applying the recognized voice when the displayed text has no error.

20. The apparatus of claim 14, wherein the preset operation is a scrolling operation in a list menu mode, and in order to perform the preset operation in accordance with a preset operation command by applying the recognized voice, the controller is further configured to recognize a voice by applying the voice recognition module when the voice is input while the scrolling operation is executed according to a touch input for performing the scrolling operation from the touch screen in a preset list screen of the list menu mode, and perform the preset operation while the scrolling operation is executed when the recognized voice is the preset operation command.

21. The apparatus of claim 14, wherein the preset operation is editing a home screen operation, and in order to perform the preset operation according to a preset operation command by applying the recognized voice, the controller is further configured to determine whether there is a space to place items in a page of a preset home screen of the touch screen to which the items are dragged when one or more preset items are dragged from one page of the home screen to another page of the home screen among pages of the home screen, recognize a voice by applying the voice recognition module when the items are dragged through the touch, perform the preset operation according to the preset operation command when the recognized voice is the preset operation command, place the items in a position of the page of the home screen where the touch ends when there is the space to place the items and the touch applied to the items ends, and return the items to an original position when there is no space to place the items and the touch applied to the items ends.