PORTABLE DEVICE AND METHOD OF CONTROLLING THEREFOR

• US 20150062163A1
• Filed: 07/07/2014
• Published: 03/05/2015
• Est. Priority Date: 09/02/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: LEE, Doyoung, CHUN, Sinae, KIM, Yongsin, PARK, Hyorim
• Granted Patent: US 9,361,733 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

A portable device is disclosed. A method of controlling a portable device, comprising the steps of capturing an image in front of the portable device, detecting a marker object from the image, displaying a virtual image corresponding to the marker object based on a location of the marker object, and terminating a display of the virtual image corresponding to the marker object, when the detecting of the marker object is terminated, terminate a display of the virtual image based on a first terminate mode if the gaze location of the user is detected at a first location, and terminate the display of the virtual image based on a second terminate mode if the gaze location of the user is detected at a second location.

Claims

1. A portable device, comprising:

a camera unit configured to capture an image in front of the portable device;

a display unit configured to display a virtual image;

a sensor unit configured to detect a gaze location of a user and deliver the detected gaze location to a processor; and

the processor configured to control the camera unit, the display unit and the sensor unit,

wherein the processor is further configured to;

detect a marker object from the image,

display the virtual image corresponding to the marker object based on a location of the marker object,

when detecting of the marker object is terminated,

terminate a display of the virtual image based on a first terminate mode if the gaze location of the user is detected at a first location, and

terminate the display of the virtual image based on a second terminate mode if the gaze location of the user is detected at a second location.

2. The portable device of claim 1, wherein the image is captured based on a viewing angle of the camera unit, and

wherein the processor is further configured to terminate the detecting of the marker object when the marker object is outside the viewing angle of the camera unit.

3. The portable device of claim 2, wherein the processor is further configured to set a location at which the detecting of the marker object is terminated within the image of the first location .

4. The portable device of claim 3, wherein the processor is further configured to set a point within the image other than the first location to the second location.

5. The portable device of claim 3, wherein the processor is further configured to:

set a region within a threshold distance from the first location to a first region, and

terminate the display of the virtual image based on the first terminate mode when the gaze location of the user is detected in the first region.

6. The portable device of claim 5, wherein the processor is further configured to:

set a region other than the first region in the image to a second region, and

terminate the display of the virtual image based on the second terminate mode when the gaze location of the user is detected in the second region.

7. The portable device of claim 1, wherein the processor is further configured to:

if the display of the virtual image is terminated based on the first terminate mode, display the virtual image during dimming time from a time point of detecting of the marker object is terminated and terminate the display of the virtual image.

8. The portable device of claim 7, wherein the processor is further configured to continuously change a display property of the virtual image displayed during the dimming time.

9. The portable device of claim 8, wherein the display property comprises at least one selected from the group consisting of a visibility, a resolution, a transparency, a shape, a size, a color and a brightness.

10. The portable device of claim 7, wherein the processor is further configured to:

if it is detected that the gaze location of the user changes from the first location to the second location during the dimming time, terminate the display of the virtual image when a predetermined time elapses from a time point of the gaze location of the user is changed.

11. The portable device of claim 10, wherein the processor is further configured to:

if it is detected that the gaze location of the user changes from the second location to the first location within the predetermined time from the time point of the gaze location of the user is changed, maintain the display of the virtual image although the predetermined time elapses.

12. The portable device of claim 7, wherein the image is captured based on a viewing angle of the camera unit, and

wherein the processor is further configured to:

if a change of the viewing angle of the camera unit is detected, change the dimming time.

13. The portable device of claim 7, wherein the sensor unit is further configured to detect a moving direction of the user and a moving speed of the user, and

wherein the processor is further configured to set the dimming time based on the moving direction of the user and the moving speed of the user.

14. The portable device of claim 1, wherein the processor is further configured to:

if the display of the virtual image is terminated based on the second terminate mode, terminate the display of the virtual image when the detecting of the marker object is terminated.

15. The portable device of claim 1, wherein the virtual image comprises at least one selected from the group consisting of augmented reality information related to the marker object, information on a display mode, information on a graphic user interface format.

16. A portable device, comprising:

a camera unit configured to capture an image in front of the portable device;

a display unit configured to display a virtual image;

a sensor unit configured to detect whether a user wearing the portable device is moving; and

a processor configured to control the camera unit, the display unit and the sensor unit,

wherein the processor is further configured to;

detect a marker object from the image,

display the virtual image corresponding to the marker object based on a location of the marker object,

move the virtual image based on a location change, when the location change of the marker object is detected from the image,

obtain a first moving speed corresponding to a moving speed of the virtual image or a second moving speed corresponding to a moving speed of the marker object,

if the first moving speed or the second moving speed is determined as faster than a first reference speed, lower the first moving speed to be slower than the first reference speed,

wherein if movement of the user wearing the portable device is detected, lower the first moving speed to be slower than a second reference speed, which is slower than the first reference speed.

17. The portable device of claim 16, wherein the sensor unit is further configured to detect a moving speed and a moving direction of the user wearing the portable device, and

wherein the processor is further configured to determine the second reference speed based on at least one selected from the group consisting of the first moving speed of the virtual image, the second moving speed of the marker object, the moving speed of the user and the moving direction of the user.

18. The portable device of claim 16, wherein the processor is further configured to:

if movement of the user wearing the portable device is detected and a change of a viewing angle of the camera unit is detected, lower the first moving speed to the second reference speed, which is slower than the first reference speed.

19. A method of controlling a portable device, comprising the steps of:

capturing an image in front of the portable device;

detecting a marker object from the image;

displaying a virtual image corresponding to the marker object based on a location of the marker object; and

terminating a display of the virtual image corresponding to the marker object,

when the detecting of the marker object is terminated,

terminate a display of the virtual image based on a first terminate mode if the gaze location of the user is detected at a first location, and

terminate the display of the virtual image based on a second terminate mode if the gaze location of the user is detected at a second location.

20. A method of controlling a portable device, comprising the steps of:

capturing an image in front of the portable device;

detecting a marker object from the image;

displaying a virtual image corresponding to the marker object based on a location of the marker object;

if a location change of the marker object is detected from the image, moving the virtual image based on the location change obtaining a moving speed of the virtual image or a moving speed of the marker object; and

if the moving speed of the virtual image or the moving speed of the marker object is determined as faster than a first reference speed, lowering the moving speed of the virtual image to be slower than the first reference speed,

wherein if movement of the user wearing the portable device is detected, lowering the first moving speed to be slower than a second reference speed, which is slower than the first reference speed.