Multimedia segment analysis in a mobile terminal and control method thereof

• US 10,162,489 B2
• Filed: 09/18/2014
• Issued: 12/25/2018
• Est. Priority Date: 08/09/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Kang, Chae, Hyangseok, Yang, Kwonseung, Kim, Suyeon, Kang, Heesoo, Kim, Eunkyung
• Primary Examiner(s): Bashore, William L
• Assistant Examiner(s): Parcher, Daniel W
• Application Number:
  US14/490,141
• Publication Number:
  US 20150128044A1
• Time in Patent Office: 1,559 Days
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Abstract

A mobile terminal and a method for controlling the same are disclosed. The mobile terminal includes a display and a controller configured to display at least one piece of video content on the display, to extract at least one text from at least one of an image and sound included in at least a portion of the video content and to display the at least one text on at least one specific position of the display, wherein the at least one specific position is related to at least one point of the video content, from which the at least one text is extracted. According to the present invention, video content can be manipulated more conveniently by displaying images and sound included in the video content as text.

Claims

1. A mobile terminal, comprising:

a display; and

a microprocessor configured to;

display video content and a progress bar related to the video content on the display,

receive a touch input for selecting a point of the progress bar,

analyze a sound included in the video content related to the touched point and display the sound as text in a first region adjacent to the progress bar,

display an extraction area including the touched point on the progress bar, wherein the extraction area indicates information about the text,

display an image corresponding to the extraction area in the video content in a second region adjacent to the progress bar,

change at least one of a range and a number of the extraction area according to a drag length in a downward direction of the touch input,

wherein the extraction area includes a first extraction area including the touched point, a second extraction area adjacent to the first extraction area, and a third extraction area adjacent to the second extraction area,

increase the at least one of the range and the number of the extraction area in order of the first, second and third extraction areas according to an increase of the drag length in a downward direction of the touch input, and

increase at least one of a range and a number of the text corresponding to the extraction area and a number of the image corresponding to the extraction area.

2. The mobile terminal of claim 1, wherein the microprocessor is configured to display at least one icon for indicating start and end points of each of the extraction areas at the start and end points.

3. The mobile terminal of claim 1, wherein the microprocessor is configured to extract a plurality of texts from the video content,

wherein the microprocessor is configured to differently display one of positions, sizes and thicknesses for the plurality of texts.

4. The mobile terminal of claim 3, wherein the microprocessor is configured to determine at least one of the positions, the sizes and the thicknesses for the plurality of texts based on frequency of the text.

5. A method for controlling a mobile terminal, comprising:

displaying video content and a progress bar related to the video content on a display;

receiving a touch input for selecting a point of the progress bar,

analyzing a sound included in the video content related to the touched point and displaying the sound as text in a first region adjacent to the progress bar,

displaying an extraction area including the touched point on the progress bar, wherein the extraction area indicates information about the text,

displaying an image corresponding to the extraction area in the video content in a second region adjacent to the progress bar,

changing at least one of a range and a number of the extraction area according to a drag length in a downward direction of the touch input,

wherein the extraction area includes a first extraction area including the touched point, a second extraction area adjacent to the first extraction area, and a third extraction area adjacent to the second extraction area,

increasing the at least one of the range and the number of the extraction area in order of the first, second and third extraction areas according to an increase of the drag length in a downward direction of the touch input, and

increasing at least one of a range and a number of the text corresponding to the extraction area and a number of the image corresponding to the extraction area.

6. The method of claim 5, further comprising displaying at least one icon for indicating start and end points of each of the extraction areas at the start and end points.

7. The method of claim 5, comprising extracting a plurality of texts, and

differently displaying one of positions, sizes and thicknesses for the plurality of texts.

8. The method of claim 5, further comprising extracting, from the video content, at least one image related to the text and displaying the at least one image.