Portable device supporting videotelephony of a head mounted display and method of controlling therefor

• US 8,866,849 B1
• Filed: 11/14/2013
• Issued: 10/21/2014
• Est. Priority Date: 08/28/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Cho, Eunhyung, Chun, Sinae, Kim, Jongho, Kim, Jihwan
• Primary Examiner(s): Welch, David T
• Application Number:
  US14/080,316
• Time in Patent Office: 341 Days
• Field of Search: 345/633, 345/629, 345/8
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video

Abstract

A method of controlling a portable device according to one embodiment of the present specification includes the steps of pairing with a head mounted display (HMD), detecting a first position of the paired HMD when an incoming call is received, configuring marker information corresponding to the incoming call according to the detected first position of the paired HMD, and transmitting an augmented reality image corresponding to the marker information to the paired HMD.

Claims

1. A portable device, comprising:

a communication unit configured to receive an incoming call and transmit information to a head mounted display (HMD) paired with the portable device, wherein the information includes a sender image received from a sender of the incoming call;

a sensor unit configured to detect a direction of the HMD;

a display unit; and

a controller configured to;

display a marker image for determining a position and a direction of an augmented reality image displayed on the HMD according to a first direction of the HMD paired with the portable device, and

transmit the sender image to the HMD,

wherein the augmented reality image represents the sender and is based on the sender image received from the portable device, and wherein a rotation or a movement of the augmented reality image corresponds to a rotation or a movement of the displayed marker image.

2. The portable device of claim 1, wherein the controller is further configured to transmit the marker image to the HMD.

3. The portable device of claim 1, wherein when the first direction of the HMD is changed to a second direction, the controller is further configured to:

detect the second direction, and

change the marker image according to the second direction of the HMD.

4. The portable device of claim 3, wherein the controller is further configured to rotate the marker image to make a front side of the augmented reality image face the second direction.

5. The portable device of claim 1, wherein the augmented reality image corresponds to a face of the sender of the incoming call.

6. The portable device of claim 1, wherein the HMD is configured to display the augmented reality image according to the marker image.

7. The portable device of claim 1, wherein when the first direction of the HMD recognized by the portable device is changed to a second direction due to a rotation or a movement of the portable device, the controller is further configured to maintain the displayed marker image without changing the displayed marker.

8. The portable device of claim 7, wherein the HMD is further configured to detect that the marker has rotated due to the rotation or the movement of the portable device and wherein the HMD is configured to rotate the augmented reality image according to the marker image of the rotated or moved portable device.

9. The portable device of claim 1, wherein when the first direction of the HMD recognized by the portable device is changed to a second direction due to a movement of the HMD, the controller is further configured to display the marker image by rotating the marker image in response to an angle between the first direction and the second direction.

10. The portable device of claim 1, wherein the HMD is configured to determine the direction of the augmented reality image further based on a shape of the portable device recognized by the HMD according to an angle between the portable device and the HMD.

11. The portable device of claim 10, wherein the HMD is further configured to recognize the shape of the portable device as the marker image corresponding to the augmented reality image.

12. The portable device of claim 10, wherein the controller is further configured to configure the shape of the portable device recognized by the HMD at the first direction as an reference shape and transmit the reference shape to the portable device.

13. The portable device of claim 12, wherein when the first direction of the HMD recognized by the portable device is changed to a second direction due to a rotation or a movement of the portable device, the controller is further configured to maintain the reference shape.

14. The portable device of claim 13, wherein the HMD is configured to display the augmented reality image by rotating the augmented reality image by an angle between the portable device and the HMD based on the reference shape.

15. The portable device of claim 12, wherein when the first direction of the HMD recognized by the portable device is changed to a second direction due to a movement of the HMD, the controller is further configured to change the reference shape in response to an angle between the first direction and the second direction.

16. The portable device of claim 15, wherein the reference shape is changed from the shape of the portable device recognized by a camera of the HMD at the first direction to the shape of the portable device recognized by the camera of the HMD at the second direction.

17. The portable device of claim 1, wherein the portable device corresponds to a smart phone, a smart pad, a music player, a notebook, a smart table, a monitor, a television, or a tablet computer.

18. A method of controlling a portable device, comprising the steps of:

pairing with a head mounted display (HMD);

detecting a first direction of the paired HMD when an incoming call is received;

displaying a marker image for determining a position and a direction of an augmented reality image displayed on the HMD according to the first direction of the HMD paired with the portable device; and

transmitting a sender image received from a sender of the incoming call to the paired HMD,

wherein the augmented reality image represents the sender and is based on the sender image received from the portable device, and wherein a rotation or a movement of the augmented reality image corresponds to a rotation or a movement of the displayed marker image.