Method and device for user interface

• US 9,361,282 B2
• Filed: 05/24/2011
• Issued: 06/07/2016
• Est. Priority Date: 05/24/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kang, Donghyun
• Primary Examiner(s): Saint Cyr, Leonard
• Application Number:
  US14/119,801
• Publication Number:
  US 20140088970A1
• Time in Patent Office: 1,841 Days
• Field of Search: 704/260, 704/275, 704/270, 704/235, 704/256
• US Class Current: 1/1
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination

Abstract

A method for user interface according to one embodiment of the present invention comprises the steps of: displaying text on a screen; receiving a character selection command of a user who selects at least one character included in a text, receiving a speech command of a user who designates a selected range in the text including at least one character, specifying the selected range according to the character selection command and the speech command; and a step for receiving an editing command of a user for the selected range.

Claims

1. A user interface method comprising:

executing an application including a text;

performing speech synthesis on the text included in the executed application and outputting the speech-synthesized text as speech, wherein a word or a phrase, which is determined according to an attribute of the executed application, included in the output speech-synthesized text is sequentially highlighted;

receiving a first speech command indicating the start of a first selected range of the text from a user during outputting the speech-synthesized text;

receiving a second speech command indicating the end of the first selected range of the text from the user during outputting the speech-synthesized text;

specifying the first selected range according to the first speech command and the second speech command;

receiving an editing command for the selected range from the user;

receiving a third speech command for repeatedly outputting the specified first selected range;

receiving a fourth speech command indicating the start of a second selected range; and

receiving a fifth speech command indicating the end of the second selected range,

wherein the third speech command through the fifth speech command are received for re-specifying the second selected range within the specified first selected range after specifying the first selected range.

2. The user interface method according to claim 1, further comprising:

displaying the text on a screen; and

sequentially highlighting words or sentences of the speech-synthesized text.

3. The user interface method according to claim 1, further comprising:

performing speech synthesis on the selected range of the text and outputting the selected range as speech; and

specifying the second selected range according to the fourth speech command and the fifth speech command.

4. The user interface method according to claim 1, wherein the editing command corresponds to one of a copy command, a cut command, an edit command, a transmit command and a search command for the selected range of the text.

5. A user interface device comprising:

a speech rendering module for performing speech synthesis on a text;

an audio output unit for outputting synthesized speech data corresponding to the text processed by the speech rendering module;

a speech recognition module for recognizing a first speech command of a user for indicating the start of a first selected range of the text and a second speech command of the user for indicating the end of the first selected range during output of the synthesized speech data;

a speech interpretation module for interpreting the first speech command and the second speech command received from the speech recognition module; and

a controller for executing an application including the text, specifying the first selected range according to the first speech command and the second speech command interpreted by the speech interpretation module,

wherein a word or a phrase, which is determined according to an attribute of the executed application, included in the output speech-synthesized text is sequentially highlighted,

wherein the speech recognition module further recognizes;

a third speech command for repeatedly outputting the specified first selected range,

a fourth speech command indicating the start of a second selected range, and

a fifth speech command indicating the end of the first second selected range,

wherein the controller re-specifies the second selected range within the specified first selected range after specifying the first selected range in response to the third speech command through the fifth speech command.

6. The user interface device according to claim 5, further comprising a video output unit for displaying words or sentences of the speech-synthesized test by sequentially highlighting the same.

7. The user interface device according to claim 5, wherein the speech rendering module performs speech synthesis on the selected range of the text and outputs synthesized speech, and

wherein the speech interpretation module interprets the third speech command to the fifth speech command.

8. The user interface device according to claim 5, wherein the speech recognition module recognizes an editing command for the selected range from the user, and wherein the editing command corresponds to one of a copy command, a cut command, an edit command, a transmit command and a search command for the selected range of the text.