MOBILE TERMINAL AND CONTROL METHOD THEREOF

• US 20130141551A1
• Filed: 11/16/2012
• Published: 06/06/2013
• Est. Priority Date: 12/02/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: KIM, Jihwan
• Granted Patent: US 9,699,399 B2
• Time in Patent Office: Days
• US Class Current: 348/51
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42653 for processing graphics
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence

Abstract

A mobile terminal which reproduces a video including image data and audio data and a control method thereof are provided. The mobile terminal which reproduces a video including image data and audio data includes a display unit configured to display an image corresponding to the image data based on a reproduction command with respect to the video, a subtitle processing unit configured to output subtitles related to the video along with the image to the display unit, and a controller configured to control the subtitle processing unit to change a display format of the subtitles according to sound characteristics of the audio data related to the image.

Claims

1. A mobile terminal, comprising:

a receiver configured to receive a content signal comprising video data and audio data;

a display; and

a controller configured to;

cause displaying of video on the display based upon the received video data;

cause displaying of subtitles on the display simultaneously with the displayed video, wherein content of the subtitles is based upon the received audio data; and

cause the subtitles to be displayed in any of a plurality of different formats according to a corresponding sound characteristic of the received audio data, wherein the sound characteristic of the received audio data is one of a plurality of possible sound characteristics.

2. The mobile terminal of claim 1, wherein the sound characteristic of the received audio data relates to at least an amplitude, a number of vibrations, or waveform.

3. The mobile terminal of claim 1, wherein the controller is further configured to:

cause the displaying of the subtitles in a two-dimensional (2D) format when the sound characteristic of the received audio data is less than a threshold; and

cause the displaying of the subtitles in a three-dimensional (3D) format when the sound characteristics of the audio data greater than the threshold.

4. The mobile terminal of claim 3, wherein a depth value of the displayed subtitle in the 3D format varies based on a level of sound amplitude corresponding to the audio data that exceeds the threshold.

5. The mobile terminal of claim 1, wherein the sound characteristic of the received audio data relates to a waveform, and wherein the controller is further configured to:

cause the displaying of the subtitles to occur at a location of the display that is based upon the waveform of the audio data.

6. The mobile terminal of claim 1, wherein:

the sound characteristic of the received audio data relates to a waveform;

the displayed video comprises a plurality of objects;

each subtitle of the displayed subtitles relates to a corresponding one of the plurality of objects; and

the controller is further configured to cause the display to display each subtitle of the displayed subtitles at a location of the display that corresponds with the corresponding one of the plurality of objects.

7. The mobile terminal of claim 6, wherein each of the plurality of objects comprises a face.

8. The mobile terminal of claim 6, wherein the controller is further configured to cause the displaying of at least one of the displayed subtitles in a three-dimensional (3D) format.

9. The mobile terminal of claim 1, wherein:

the sound characteristic of the received audio data relates to a waveform;

the controller is further configured to cause the display to display each subtitle of the displayed subtitles in a color that is based on the waveform of the audio data; and

subtitles of the displayed subtitles that are based on different waveforms of the audio data are displayed in different colors from each other.

10. The mobile terminal of claim 1, wherein:

the sound characteristic of the received audio data relates to amplitude; and

the controller is further configured to cause the display to vary a size of each subtitle of the displayed subtitles based on a level of sound amplitude corresponding to each subtitle of the displayed subtitles.

11. The mobile terminal of claim 10, wherein the controller is further configured to:

determine whether the sound amplitude corresponding to each subtitle of the displayed subtitles is greater than or equal to a reference value;

cause displaying each subtitle of the displayed subtitles that is based on sound amplitude that is greater than the reference value at a size greater than a reference size; and

cause displaying each subtitle of the displayed subtitles that is based on sound amplitude that is less than the reference value at a size smaller than the reference size.

12. The mobile terminal of claim 11, wherein the size of each of the displayed subtitles varies based on a difference between sound amplitude corresponding to each subtitle of the displayed subtitles and the reference value.

13. The mobile terminal of claim 12, wherein the controller is further configured to:

increase the size of each of the displayed subtitles in proportion to an increase in the difference between the sound amplitude corresponding to each subtitle of the displayed subtitles and the reference value when the corresponding sound amplitude is greater than the reference value; and

decrease the size of each of the displayed subtitles in proportion to an increase in the difference between the sound amplitude corresponding to each subtitle of the displayed subtitles and the reference value when the corresponding sound amplitude is less than the reference value.

14. The mobile terminal of claim 13, wherein the controller is further configured to:

cause the displaying of the subtitles in a three-dimensional (3D) format when the sound amplitude is above a preset threshold; and

vary a depth value of the subtitles displayed in the 3D format based on a difference between sound amplitude and the preset threshold.

15. The mobile terminal of claim 10, wherein the controller is further configured to vary a character thickness of each subtitle of the displayed subtitles based on changes of sound amplitude corresponding to each subtitle of the displayed subtitles.

16. The mobile terminal of claim 1, wherein:

the sound characteristic of the received audio data relates to amplitude; and

the controller is further configured to cause the display to display each subtitle of the displayed subtitles at a size different from other of the displayed subtitles based on differences of sound amplitude corresponding to each subtitle of the displayed subtitles.

17. A method for controlling a mobile terminal, the method comprising:

receiving a content signal, via a receiver of the mobile terminal, the content signal comprising video data and audio data;

controlling a display of the mobile terminal, via a controller of the mobile terminal, to display video based upon the received video data;

controlling the display, via the controller, to display subtitles simultaneously with the displayed video, wherein content of the subtitles is based upon the received audio data; and

controlling the display, via the controller, to display the subtitles in any of a plurality of different formats according to a corresponding sound characteristic of the received audio data, wherein the sound characteristic of the received audio data is one of a plurality of possible sound characteristics.

18. The method of claim 17, wherein the sound characteristic of the received audio data relates to at least an amplitude, a number of vibrations, or waveform.

19. The method of claim 17, wherein the sound characteristic of the received audio data relates to amplitude, the method further comprising:

controlling the display, via the controller, to display the subtitles in a two-dimensional (2D) format when the sound amplitude is less than a threshold;

controlling the display, via the controller, to display the subtitles in a three-dimensional (3D) format when the sound amplitude is greater than the threshold; and

controlling the display, via the controller, to vary a depth value of the displayed subtitles in the 3D format based on a level of sound amplitude corresponding to the audio data that exceeds the threshold.

20. The method of claim 17, wherein the sound characteristic of the received audio data further relates to a waveform, wherein the displayed video comprises a plurality of objects, and wherein each subtitle of the displayed subtitles relates to a corresponding one of the plurality of objects, the method further comprising:

controlling the display, via the controller, to display each subtitle of the displayed subtitles at a location of the display that corresponds with the corresponding one of the plurality of objects.