HEAD MOUNTED DISPLAY AND METHOD OF VIDEO COMMUNICATION USING THE SAME

• US 20140184724A1
• Filed: 02/21/2013
• Published: 07/03/2014
• Est. Priority Date: 12/28/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: CHO, Eunhyung
• Granted Patent: US 9,225,934 B2
• Time in Patent Office: Days
• US Class Current: 348/14.07
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact

Abstract

A head mounted display (HMD) comprises a display unit configured to output an image; a communication unit configured to transmit and receive video communication image data; a camera unit configured to take an image in a forward direction of the HMD; and a processor configured to control the display unit, the communication unit and the camera unit, wherein the processor is further configured to detect an image of a user wearing the HMD from the taken image, wherein the image of the user includes a camera area of the HMD, recognize an image of a partner from the received video communication image data, provide a video communication interface displaying the image of the partner, wherein the video communication interface displays the image of the partner corresponding to a position of the camera area of the HMD, and transmit a video communication image of the user from the taken image.

Claims

1. A head mounted display (HMD) comprising:

a display unit configured to output an image;

a communication unit configured to transmit and receive video communication image data;

a camera unit configured to take an image in a forward direction of the HMD; and

a processor configured to control the display unit, the communication unit and the camera unit,

wherein the processor is further configured to;

detect an image of a user wearing the HMD from the taken image, wherein the image of the user includes a camera area of the HMD,

recognize an image of a partner from the received video communication image data,

provide a video communication interface displaying the image of the partner, wherein the video communication interface displays the image of the partner corresponding to a position of the camera area of the HMD, and

transmit a video communication image of the user from the taken image.

2. The HMD according to claim 1, wherein the taken image includes an image of the user wearing the HMD that is reflected in a reflector.

3. The HMD according to claim 1, wherein the transmitted video communication image of the user includes an image reversed in left and right direction from the taken image.

4. The HMD according to claim 1, wherein the image of the user includes an image detected within a viewing area of the HMD.

5. The HMD according to claim 1, wherein the processor is configured to display the video communication interface so that the image of the partner is overlaid on the position of the camera area of the HMD.

6. The HMD according to claim 1, wherein the processor is configured to display the video communication interface so that the image of the partner and the position of the camera area of the HMD are located in the same direction within a viewing area of the HMD.

7. The HMD according to claim 1, wherein, when at least a part of the camera area is not detected from the taken image, the processor is further configured to provide a notice indicating that at least a part of the camera area of the HMD is not detected from the taken image.

8. The HMD according to claim 7, wherein the notice represents at least one of a direction and a distance to which the camera area of the HMD should move to be detected.

9. The HMD according to claim 1, wherein, when the image of the user wearing the HMD is not detected from the taken image, the processor further configured to transmit a replacement image.

10. The HMD according to claim 1, wherein the processor further configured to provide a video communication image determination interface that determines whether to transmit the taken image or a replacement image.

11. The HMD according to claim 1, wherein the video communication image of the user includes at least one of the image of the user wearing the HMD and the replacement image.

12. The HMD according to claim 1, wherein the processor is configured to display the image of the partner and the video communication image of the user together in the video communication interface.

13. The HMD according to claim 1, wherein, when the image of the user wearing the HMD is not detected from the taken image, the processor is configured to displays the image taken by the camera of the HMD and the image of the partner in the video communication interface.

14. The HMD according to claim 1, wherein the video communication image of the user includes a peripheral area including the camera area of the HMD in the taken image.

15. The HMD according to claim 1, wherein, when a size of the recognized image of the partner is within a predetermined size range, the processor is configured to display an eye area in the image of the partner to corresponding to the position of the camera area of the HMD.

16. The HMD according to claim 1, wherein, when a size of the recognized image of the partner is not within a predetermined size range, the processor is configured to display a face area in the image of the partner corresponding to the position of the camera area of the HMD.

17. The HMD according to claim 1, wherein, when a size of the recognized image of the partner is not within a predetermined size range, the processor is configured to enlarge the image of the partner and displays the enlarged image in the video communication interface.

18. The HMD according to claim 1, wherein the processor is further configured to control at least one of a position and a depth of the video communication interface.

19. The HMD according to claim 18, wherein the position of the video communication interface is determined on the basis of a size of the image of the partner.

20. The HMD according to claim 18, wherein the position of the video communication interface is determined on the basis of setting of the user.

21. A method of video communication using a head mounted display (HMD), the method comprising the steps of:

detecting an image of a user wearing the HMD, from a taken image, wherein the image of the user includes a camera area of the HMD;

recognizing an image of a partner from received video communication image data;

providing a video communication interface displaying the image of the partner, wherein the video communication interface displays the image of the partner corresponding to a position of the camera area of the HMD; and

transmitting a video communication image of the user from the taken image.