MOBILE TERMINAL AND CONTROL METHOD THEREOF

• US 20150128044A1
• Filed: 09/18/2014
• Published: 05/07/2015
• Est. Priority Date: 08/09/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Kang, Kang, Heesoo, Kim, Eunkyung, Chae, Hyangseok, Yang, Kwonseung, Kim, Suyeon
• Granted Patent: US 10,162,489 B2
• Time in Patent Office: Days
• US Class Current: 715/719
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Abstract

A mobile terminal and a method for controlling the same are disclosed. The mobile terminal includes a display and a controller configured to display at least one piece of video content on the display, to extract at least one text from at least one of an image and sound included in at least a portion of the video content and to display the at least one text on at least one specific position of the display, wherein the at least one specific position is related to at least one point of the video content, from which the at least one text is extracted. According to the present invention, video content can be manipulated more conveniently by displaying images and sound included in the video content as text.

Claims

1. A mobile terminal, comprising:

a display; and

a controller configured to display video content on the display, to extract text based on one of an image and sound in a portion of the video content, and to display the text at a specific area of the display,

wherein the specific area of the display relates to one point of the video content, from which the text is extracted.

2. The mobile terminal of claim 1, wherein the controller is configured to extract the text based on one or more extraction areas including the one point, in response to receiving a selection signal for selecting the one point of the video content.

3. The mobile terminal of claim 2, wherein the controller is configured to change one of a range and a number of the one or more extraction areas according to one of a direction and a length of a touch operation at the display.

4. The mobile terminal of claim 3, wherein the one or more extraction areas include:

a first extraction area including the one point,

a second extraction area adjacent to the first extraction area, and

a third extraction area adjacent to the second extraction area,

wherein the controller is configured to increase an extraction range of the text in order of the first extraction area, the second extraction area and the third extraction area based on an increase in the length of the touch operation.

5. The mobile terminal of claim 2, wherein the controller is configured to display a range of the one or more extraction areas on a progress bar.

6. The mobile terminal of claim 5, wherein the controller is configured to display at least one icon for indicating a start point and an end point of each of the one or more extraction areas.

7. The mobile terminal of claim 5, wherein the controller is configured to display the text in order of the one point on the progress bar.

8. The mobile terminal of claim 1, wherein the controller is configured to extract a plurality of texts from the video content,

wherein the controller is configured to differently display one of positions, sizes and thicknesses for the plurality of texts.

9. The mobile terminal of claim 8, wherein the controller is configured to determine at least one of the positions, sizes and thicknesses for the plurality of texts based on frequency of the text.

10. The mobile terminal of claim 1, wherein the controller is configured to extract the text based on one of a sentence unit, a paragraph unit and a word unit.

11. The mobile terminal of claim 1, wherein the controller is configured to extract, from the video content, one image related to the text and to display the image on the display.

12. The mobile terminal of claim 11, wherein, in response to receiving a selection signal for selecting one of the text and the one image, the controller changes display of the other one of the text and the one image.

13. The mobile terminal of claim 1, wherein the controller is configured to display, as the text, one of information of a person in the image, audio information in the sound, information of an action of a person in the image and information regarding a number of persons in the image.

14. A method for controlling a mobile terminal, comprising:

displaying video content on a display;

extracting text based on one of an image and sound included in a portion of the video content; and

displaying the text on a specific area of the display,

wherein the specific area relates to one point of the video content from which the text is extracted.

15. The method of claim 14, wherein the extracting of the text comprises:

receiving a selection signal to select the one point of the video content;

setting one or more extraction areas including the one point; and

extracting the text from the one or more extraction areas.

16. The method of claim 15, wherein the setting of the one or more extraction areas includes changing one of a range and a number of the one or more extraction areas according to one of a direction and a distance of a touch operation at the display.

17. The method of claim 15, further comprising displaying a range of the one or more extraction areas on a progress bar.

18. The method of claim 17, further comprising displaying at least one icon for indicating a start point and an end point of each of the one or more extraction areas.

19. The method of claim 14, wherein the extracting of the text includes extracting a plurality of texts,

wherein the displaying of the text includes differently displaying one of positions, sizes and thicknesses for the plurality of texts.

20. The method of claim 14, further comprising extracting, from the video content, at least one image related to the text and displaying the at least one image.

21. A mobile terminal, comprising:

a display to display video; and

a controller configured to display the video on the display, to obtain text based on an image or sound corresponding to the video content, and to display the text at a specific area of the display,

wherein the specific area corresponds to a particular point in the video content.

22. The mobile terminal of claim 21, wherein the controller is configured to obtain the text from an extraction area that includes the particular point in response to receiving a selection signal for selecting the particular point of the video content.

23. The mobile terminal of claim 22, wherein the controller is configured to change a range or a number of the extraction areas based on a direction or a length of a touch at the display.

24. The mobile terminal of claim 22, wherein the controller is configured to display a range on a progress bar.

25. The mobile terminal of claim 24, wherein the controller is configured to display a first icon to indicate a start point of an extraction area and a second icon to indicate an end of the extraction area.