MOBILE TERMINAL AND CONTROLLING METHOD THEREOF

• US 20140088955A1
• Filed: 08/28/2013
• Published: 03/27/2014
• Est. Priority Date: 09/24/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: KIM, Taejun, NAM, Yunae
• Granted Patent: US 9,401,139 B2
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/086 Detection of language
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails

Abstract

A mobile terminal and controlling method thereof are disclosed, by which a feedback matching a meaning of a natural language is outputted in the course of outputting a sound corresponding to the natural language by sentence unit. The present invention includes a display unit configured to display a text by sentence unit, an audio output module configured to output a synthetic sound generated from converting the text to a sound, and a controller configured to generate the synthetic sound, extract a meaning of the text, and control a feedback matching the meaning of the text to be outputted while the synthetic sound is outputted via the audio output module.

Claims

1. A mobile terminal comprising:

a display unit configured to display a text by sentence unit;

an audio output module configured to output a synthetic sound generated from converting the text to a sound; and

a controller configured to generate the synthetic sound, extract a meaning of the text, and control a feedback matching the meaning of the text to be outputted while the synthetic sound is outputted via the audio output module.

2. The mobile terminal of claim 1, wherein if a core word corresponding to the feedback is included in the text, the controller further configured to control the feedback to be outputted when an output of the core word in the synthetic sound starts.

3. The mobile terminal of claim 1, wherein if a play time of the feedback is longer than that of the synthetic sound, the controller controls a silence period to be added to at least one of a case before starting the output of the synthetic sound and a case after completion of the output of the synthetic sound.

4. The mobile terminal of claim 3, wherein the play time of the silence period added synthetic sound is equal to or greater than that of the feedback.

5. The mobile terminal of claim 1, wherein the feedback comprises a background sound utilized as a background sound of the synthetic sound.

6. The mobile terminal of claim 5, wherein while the background sound is outputted, the controller further configured to control a vibration accompanied by the output of the background sound to be outputted.

7. The mobile terminal of claim 6, wherein the controller further configured to analyze a sound wave of the background sound and then set an interval having an amplitude of the sound wave greater than a threshold to an exceeding interval and wherein the controller further configured to control the vibration to be outputted while the exceeding interval is outputted via the audio output unit.

8. The mobile terminal of claim 7, wherein the threshold comprises an average amplitude of the sound wave.

9. The mobile terminal of claim 7, wherein the controller further configured to control an output strength of the vibration to be adjusted based on a rate between the threshold and a maximum amplitude in the exceeding interval.

10. The mobile terminal of claim 8, wherein the output strength of the vibration depends on formulas as follows:

11. The mobile terminal of claim 1, wherein the feedback comprises displaying an image matching the meaning of the text.

12. The mobile terminal of claim 11, wherein the controller further configured to control the image to be displayed as a background screen of the display unit while the synthetic sound is outputted.

13. The mobile terminal of claim 1, wherein the controller further configured to control the feedback to be outputted in a manner of changing an output color of the display unit or adjusting a brightness of the display unit.

14. The mobile terminal of claim 1, wherein the feedback comprises a flickering of a light source.

15. The mobile terminal of claim 14, wherein the light source comprises a camera flash configured to supplement a light in photographing.

16. A method of controlling a mobile terminal, comprising the steps of:

displaying a text by sentence unit;

generating a synthetic sound from converting the text to a sound;

extracting a meaning of the text;

determining a feedback matching the meaning of the text;

outputting the synthetic sound; and

outputting the feedback while the synthetic sound is outputted.