MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME

• US 20120105703A1
• Filed: 08/11/2011
• Published: 05/03/2012
• Est. Priority Date: 11/03/2010
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Sunjung, Seo, Kyunghye, Lee, Joowoo
• Granted Patent: US 9,318,151 B2
• Time in Patent Office: Days
• US Class Current: 348/333.11
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A method for controlling a mobile terminal includes displaying a preview image input by a camera in an augmented reality (AR) mode, displaying AR data corresponding to at least one object in the preview image, and providing a user interface for editing at least a portion of the preview image including the AR data in the AR mode in order to generate an edited preview image.

Claims

1. A method for controlling a mobile terminal, the method comprising:

displaying, on a display, a preview image input by a camera in an augmented reality (AR) mode;

displaying, on the display, AR data corresponding to at least one object in the preview image; and

providing, on the display, a user interface for editing at least a portion of the preview image including the AR data in the AR mode in order to generate an edited preview image.

2. The method of claim 1, further comprising storing the edited preview image in a memory.

3. The method of claim 2, further comprising transmitting the stored edited preview image.

4. The method of claim 2, further comprising:

searching at least one stored edited preview image in the AR mode; and

displaying AR data of the searched at least one stored edited preview image that corresponds to at least a same object in the preview image or a position of the preview image,

wherein displaying the AR data is performed by either overlaying at least a portion of the searched at least one stored edited preview image on the preview image or displaying the searched at least one stored edited preview image.

5. The method of claim 1, further comprising transmitting the edited preview image.

6. The method of claim 1, further comprising:

identifying an object in the preview image;

determining whether the object in the preview image is the same as an object in a previously received edited preview image in the AR mode; and

displaying AR data corresponding to the object in the previously received edited preview image on the object in the preview image based on the determination by either overlaying at least a portion of the previously received edited preview image on the preview image or displaying the previously received edited preview image.

7. The method of claim 1, further comprising editing the at least a portion of the preview image by changing an appearance of at least the AR data or the at least one object in response to input received via the user interface in accordance with at least one function.

8. The method of claim 7, wherein the at least one function is used to distinguish at least the AR data or the at least one object in the preview image.

9. The method of claim 7, wherein editing the at least a portion of the preview image comprises zooming-in or zooming-out of the preview image in response to input received via the user interface such that the edited preview image is a zoomed-in or zoomed-out preview image and further comprising storing the zoomed-in or zoomed-out preview image in a memory.

10. The method of claim 9, further comprising:

storing a value representing a magnification power of the zoomed-in or zoomed-out preview image and position information of the zoomed-in or zoomed-out preview image; and

applying the value representing the magnification power to the preview image.

11. The method of claim 7, wherein editing the at least a portion of the preview image comprises inputting a memo or scribble message on the preview image in response to the input received via the user interface and further comprising storing the edited preview image including the memo or scribble message in a memory.

12. The method of claim 1, wherein the user interface provides a function for importing at least one image onto the preview image and merging the at least one image with the preview image in order to generate the edited preview image and further comprising storing the edited preview image including the at least one image in a memory.

13. The method of claim 12, wherein importing the at least one image comprises dragging and dropping the at least one image on a zone within the preview image where the at least one image is to be merged, or designating a zone within the preview image where the at least one image is to be merged.

14. The method of claim 12, wherein importing the at least one image comprises:

designating a first zone within the at least one image;

cropping the at least one image according to the first zone in order to generate at least one cropped image; and

designating a second zone within the preview image where the at least one cropped image is to be merged.

15. The method of claim 12, wherein the user interface further provides a function for receiving a keyword for searching at least the memory or the Internet for at least one image that is related to the keyword.

16. The method of claim 1, wherein the user interface provides a function for linking information to the preview image and further comprising storing the preview image that has been linked in a memory, the information related to the preview image.

17. A method for controlling a mobile terminal, the method comprising:

receiving a transmission including an edited preview image that was previously generated by editing at least a portion of a preview image including augmented reality (AR) data in an AR mode;

determining a current position of the mobile terminal; and

displaying, on a display, the edited preview image when the current position of the mobile terminal is the same as a position corresponding to the edited preview image,

wherein displaying the edited preview image is performed by either overlaying at least a portion of the edited preview image on a current preview image or displaying the entire edited preview image.

18. The method of claim 17, wherein the transmission further includes the position corresponding to the edited preview image.

19. The method of claim 17, further comprising determining the position corresponding to the edited preview image by comparing the edited preview image to a current preview image input by a camera.

20. A mobile terminal comprising:

a display configured to display a preview image input by a camera in an augmented reality (AR) mode and to display AR data corresponding to at least one object in the preview image; and

a controller configured to provide a user interface for editing at least a portion of the preview image including the AR data in the AR mode in order to generate an edited preview image.

21. The mobile terminal of claim 20, wherein the controller is further configured to store the edited preview image in a memory.

22. The mobile terminal of claim 21, wherein the controller is further configured to transmit the stored edited preview image.

23. The mobile terminal of claim 20, wherein the controller is further configured to transmit the edited preview image.

24. The mobile terminal of claim 21, wherein:

the controller is further configured to search at least one stored edited preview image in the AR mode;

the display is further configured to display AR data of the searched at least one stored edited preview image that corresponds to at least a same object in the preview image or a position of the preview image; and

the AR data of the searched edited preview image is displayed by either overlaying at least a portion of the searched at least one stored edited preview image on the preview image or displaying the searched at least one stored edited preview image.

25. The mobile terminal of claim 20, wherein:

the controller is further configured to identify an object in the preview image and determine whether the object in the preview image is the same as an object in a previously received edited preview image in the AR mode; and

the display is further configured to display AR data corresponding to the object in the previously received edited preview image on the object in the preview image based on the determination by either overlaying at least a portion of the previously received edited preview image on the preview image or displaying the previously received edited preview image.

26. The mobile terminal of claim 20, wherein the controller is further configured to edit the at least a portion of the preview image by changing an appearance of at least the AR data or the at least one object in response to input received via the user interface in accordance with at least one function.

27. The mobile terminal of claim 26, wherein the at least one function is used to distinguish at least the AR data or the at least one object in the preview image.

28. The mobile terminal of claim 20, wherein:

the controller is further configured to edit the at least a portion of the preview image by zooming-in or zooming-out of the preview image in response to input received via the user interface such that the edited preview image is a zoomed-in or zoomed-out preview image; and

store the zoomed-in or zoomed-out preview image in a memory.

29. The mobile terminal of claim 28, wherein the controller is further configured to:

store a value representing a magnification power of the zoomed-in or zoomed-out preview image and position information of the zoomed-in or zoomed-out preview image; and

apply the value representing the magnification power to the preview image.

30. The mobile terminal of claim 20, wherein the controller is further configured to:

edit the at least a portion of the preview image by receiving a memo or scribble message input on the preview image via the user interface; and

store the edited preview image including the memo or scribble message in a memory.

31. The mobile terminal of claim 20, the controller is further configured to:

provide the user interface having a function for importing at least one image onto the preview image and merging the at least one image with the preview image in order to generate the edited preview image; and

store the edited preview image including the at least one image in a memory.

32. The mobile terminal of claim 31, wherein importing the at least one image comprises dragging and dropping the at least one image on a zone within the preview image where the at least one image is to be merged or designating a zone within the preview image where the at least one image is to be merged.

33. The mobile terminal of claim 31, wherein importing the at least one image comprises:

designating a first zone within the at least one image;

cropping the at least one image according to the first zone to generate at least one cropped image; and

designating a second zone within the preview image where the at least one cropped image is to be merged.

34. The mobile terminal of claim 31, wherein the controller is further configured to provide the user interface further having a function for receiving a keyword for searching at least the memory or the Internet for the at least one image that is related to the keyword.

35. The mobile terminal of claim 20, wherein the controller is further configured to:

provide the user interface having a function for linking information to the preview image, the information related to the preview image; and

store the preview image that has been linked in a memory.

36. A mobile terminal comprising:

a controller configured to;

receive a transmission including an edited preview image that was previously generated by editing at least a portion of a preview image including augmented reality (AR) data in an AR mode; and

determine a current position of the mobile terminal; and

a display configured to display the edited preview image when the current position of the mobile terminal is the same as a position corresponding to the edited preview image,

wherein the edited preview image is displayed by either overlaying at least a portion of the edited preview image on a current preview image or displaying the entire edited preview image.

37. The mobile terminal of claim 36, wherein the transmission further includes the position corresponding to the edited preview image.

38. The mobile terminal of claim 36, further comprising a camera configured to generate the current preview image and wherein the controller is further configured to determine the position corresponding to the edited preview image by comparing the edited preview image to the current preview image.