MOBILE TERMINAL AND CONTROL METHOD THEREOF

• US 20140015859A1
• Filed: 03/20/2013
• Published: 01/16/2014
• Est. Priority Date: 07/10/2012
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Daehwan, Hong, Yoonki
• Application Number:
  US13/848,001
• Publication Number:
  US 20140015859A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A mobile terminal and a control method thereof, which can obtain an image, are provided. A mobile terminal includes a camera unit, a pictogram extraction unit and a controller. The camera unit obtains image information corresponding to at least one of a still image and a moving image. The pictogram extraction unit extracts at least one pictogram from the obtained image information. The controller detects information related to the extracted pictogram, and displays the detected information to be overlapped with the obtained image information. In the mobile terminal, the controller includes, as the detected information, at least one of previously recorded information and currently searched information related to the extracted pictogram.

Claims

1. A mobile terminal, comprising:

a display unit configured to at least display information;

a camera unit configured to obtain image information corresponding to at least a still image or a moving image;

a pictogram extraction unit configured to extract at least one pictogram from the obtained image information; and

a controller configured to;

detect information related to the extracted at least one pictogram, the detected information comprising at least previously recorded information or currently searched information; and

control the display unit to display the detected information overlapped with the obtained image information.

2. The mobile terminal of claim 1, wherein the pictogram extraction unit is further configured to:

extract at least one feature point of objectives included in the obtained image information based on edge information and outline information of the objectives; and

extract a pictogram from the previously recorded information, the pictogram corresponding to the extracted at least one feature point.

3. The mobile terminal of claim 2, wherein the controller is further configured to control the display unit to display a plurality of pictograms based on the extracted at least one feature point if extraction of the pictogram from the previously recorded information is unsuccessful, the displayed plurality of pictograms having similar feature points as the pictogram corresponding to the extracted at least one feature point.

4. The mobile terminal of claim 3, wherein the controller is further configured to recognize at least one pictogram selected by a user from the displayed plurality of pictograms as a pictogram corresponding to the extracted at least one feature point.

5. The mobile terminal of claim 4, wherein:

the detected information comprises a pictogram image corresponding to the extracted at least one pictogram; and

the controller is further configured to select at least one pictogram included in the obtained image information and control the display unit to display a pictogram image corresponding to each of the selected at least one pictogram together with the corresponding pictogram.

6. The mobile terminal of claim 5, wherein the controller is further configured to select the at least one pictogram included in the obtained image information either based on the user'"'"'s selection or based on at least information related to use frequency or information related to distance to a terminal main body.

7. The mobile terminal of claim 6, wherein the controller is further configured to control the display unit to display the pictogram image corresponding to each of the selected at least one pictogram such that the pictogram image is either overlapped with the corresponding pictogram or displayed at a position adjacent to the corresponding pictogram.

8. The mobile terminal of claim 6, wherein the controller is further configured to control graphic information of each displayed pictogram image based on the at least information related to use frequency or the information related to distance to the terminal main body.

9. The mobile terminal of claim 8, wherein the graphic information comprises at least a color, a shape, a size transparency or a 3D depth of the corresponding displayed pictogram image.

10. The mobile terminal of claim 4, wherein:

the detected information comprises at least information related to a direction toward a destination corresponding to the extracted at least one pictogram or information related to a distance to the destination; and

the controller is further configured to select at least one pictogram included in the obtained image information and control the display unit to display the at least information related to the direction toward the destination or information related to the distance to the destination together with the selected at least one pictogram.

11. The mobile terminal of claim 10, wherein the controller is further configured to display the at least information related to the direction toward the destination or information related to the distance to the destination such that the displayed information is either overlapped with the selected at least one pictogram or displayed at a position adjacent to the selected at least one pictogram.

12. The mobile terminal of claim 11, wherein the controller is further configured to:

receive current position information by using at least a global positioning system (GPS) or an access point (AP);

detect destination position information from the previously recorded information according to the current position information; and

detect the at least information related to the direction toward the destination or information related to the distance to the destination by using the destination position information.

13. The mobile terminal of claim 11, further comprising a gyro sensor configured to sense a direction of the terminal main body,

wherein the controller is further configured to alter the displayed information related to the direction toward the destination based on the sensed direction of the terminal main body.

14. A control method of a mobile terminal, the method comprising:

obtaining image information corresponding to at least a still image or a moving image by using a camera;

extracting at least one pictogram from the obtained image information;

detecting information related to the extracted at least one pictogram, the detected information comprising at least previously recorded information or currently searched information; and

displaying the detected information overlapped with the obtained image information on a display unit.

15. The control method of claim 14, wherein extracting the at least one pictogram comprises:

extracting at least one feature point of objectives included in the obtained image information based on edge information and outline information of the objectives; and

extracting a pictogram from the previously recorded information, the pictogram corresponding to the extracted feature point.

16. The control method of claim 15, further comprising displaying a plurality of pictograms based on the extracted at least one feature point if extracting the pictogram from the previously recorded information is unsuccessful, the displayed plurality of pictograms having similar feature points as the pictogram corresponding to the extracted at least one feature point.

17. The control method of claim 16, further comprising recognizing at least one pictogram selected by a user from the displayed plurality of pictograms as a pictogram corresponding to the extracted at least one feature point.

18. The control method of claim 17, wherein:

the detected information comprises a pictogram image corresponding to the extracted at least one pictogram; and

displaying of the detected information comprises;

selecting at least one pictogram included in the obtained image information; and

displaying a pictogram image corresponding to each of the selected at least one pictogram together with the corresponding pictogram.

19. The control method of claim 18, wherein the at least one pictogram included in the obtained image information is selected either based on the user'"'"'s selection or based on at least information related to use frequency or information related to distance to a terminal main body.

20. The control method of claim 17, wherein the detected information comprises at least information related to a direction toward a destination corresponding to the extracted at least one pictogram or information related to a distance to the destination and further comprising:

selecting at least one pictogram included in the obtained image information; and

displaying the at least information related to the direction toward the destination or information related to the distance to the destination together with the selected at least one pictogram.