Mobile terminal and controlling method thereof

• US 9,401,139 B2
• Filed: 08/28/2013
• Issued: 07/26/2016
• Est. Priority Date: 09/24/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Taejun, Nam, Yunae
• Primary Examiner(s): Jackson, Jakieda
• Application Number:
  US14/012,732
• Publication Number:
  US 20140088955A1
• Time in Patent Office: 1,063 Days
• Field of Search: 704/260
• US Class Current: 1/1
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/086 Detection of language
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails

Abstract

A mobile terminal and controlling method thereof are disclosed, by which a feedback matching a meaning of a natural language is outputted in the course of outputting a sound corresponding to the natural language by sentence unit. The present invention includes a display unit configured to display a text by sentence unit, an audio output module configured to output a synthetic sound generated from converting the text to a sound, and a controller configured to generate the synthetic sound, extract a meaning of the text, and control a feedback matching the meaning of the text to be outputted while the synthetic sound is outputted via the audio output module.

Claims

1. A mobile terminal comprising:

a display unit configured to display a text corresponding to a sentence unit;

an audio output module configured to output a synthetic sound generated from converting the text to a sound; and

a controller configured to;

generate the synthetic sound;

extract a meaning of the text;

cause a feedback to be output corresponding to the meaning of the text while the synthetic sound is output via the audio output module, wherein the feedback comprises a background sound of the synthetic sound;

analyze a sound wave of the background sound and set an exceeding interval in which an amplitude of the sound wave is greater than a threshold, wherein the threshold comprises an average amplitude of the sound wave;

cause a vibration to be output while the background sound is output, wherein the vibration is output when the exceeding interval is output via the audio output unit; and

adjust an output strength of the vibration based on a rate between the average amplitude of the sound wave and a maximum amplitude in the exceeding interval.

2. The mobile terminal of claim 1, wherein the controller is further configured to cause the feedback to be output when an output of synthetic sound corresponding to a core word associated with the feedback is started.

3. The mobile terminal of claim 1, wherein the controller is further configured to add a silence period to at least before starting the output of the synthetic sound or after completion of the output of the synthetic sound if a play time of the feedback is longer than that of the synthetic sound,

wherein a total play time of the silence period and the synthetic sound is equal to or greater than the play time of the feedback.

4. The mobile terminal of claim 1, wherein the output strength of the vibration is determined by formulas as follows:

5. The mobile terminal of claim 1, wherein the feedback further comprises displaying an image corresponding to the meaning of the text, and wherein the controller is further configured to cause the image to be displayed as a background screen of the display unit while the synthetic sound is output.

6. The mobile terminal of claim 1, wherein the controller is further configured to cause the feedback to be output in a manner of changing an output color of the display unit or adjusting a brightness of the display unit.

7. The mobile terminal of claim 1, wherein the feedback further comprises a flickering of a light source, and the light source comprises a camera flash configured to provide light.

8. A method of controlling a mobile terminal, the method comprising:

displaying a text corresponding to a sentence unit;

generating a synthetic sound by converting the text to a sound;

extracting a meaning of the text;

determining a feedback corresponding to the meaning of the text;

outputting the synthetic sound;

outputting the feedback while the synthetic sound is output, wherein the feedback comprises a background sound of the synthetic sound;

analyzing a sound wave of the background sound and setting an exceeding interval in which an amplitude of the sound wave is greater than a threshold, wherein the threshold comprises an average amplitude of the sound wave;

outputting a vibration while the background sound is output, wherein the vibration is output when the exceeding interval is output via an audio output unit; and

adjusting an output strength of the vibration based on a rate between the average amplitude of the sound wave and a maximum amplitude in the exceeding interval.