HEAD MOUNTED DISPLAY AND METHOD FOR CONTROLLING THE SAME

• US 20140192085A1
• Filed: 02/26/2013
• Published: 07/10/2014
• Est. Priority Date: 01/04/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: KIM, Jihyun
• Granted Patent: US 9,147,290 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G01S 19/51 Relative positioning
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G07B 11/00 Apparatus for validating or cancelling issued tickets
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area

Abstract

A head mounted display (HMD) and a method for controlling the same are disclosed. Most particularly, the HMD and the method for controlling the same may detect an external device having a ticket stored therein and display augmented reality information related to the stored ticket in a location approximate to an individual carrying an external device, in order to check tickets.

Claims

1. A head mounted display (HMD), comprising:

a camera unit configured to capture an image of a surrounding area of the HMD;

a display unit configured to display augmented reality information associated with the captured image;

a communication unit configured to transmit and receive data to and from an external device;

a sensor unit configured to sense a position of the HMD and to deliver the sensed result to a processor; and

the processor configured to control the camera unit, the display unit, the communication unit, and the sensor unit,

wherein the processor;

requests ticket information to the external device,

receives a response including the ticket information according to the request from the external device,

acquires the augmented reality information associated with the ticket information,

detects an object related to the external device in the captured image, and

displays the augmented reality information associated with the ticket information on a surrounding area of the detected object.

2. The HMD of claim 1, wherein the processor acquires position information of the external device, and

wherein the processor extracts at least one of distance information, direction information, and altitude information of the external device with reference to a position of the HMD from the acquired position information of the external device.

3. The HMD of claim 2, wherein the processor receives the position information according to a global positioning system (GPS) from the external device or acquires the position information by using wireless LAN signal information of the external device and an address information where the HMD is positioned.

4. The HMD of claim 2, wherein the processor captures an image, when the processor detects that the external device is located within an angle of a view zone of the HMD according to the position information of the external device.

5. The HMD of claim 2, wherein the processor detects an object related to the external device in the captured image by using at least one of the distance information, direction information, and altitude information of the external device.

6. The HMD of claim 2, wherein the captured image includes a three-dimensional (3D) image, and wherein the processor extracts depth information of at least one object included in the captured image.

7. The HMD of claim 6, wherein the processor detects an object related to the external device in the captured image by using the depth information and at least one of the distance information, direction information, and altitude information of the external device.

8. The HMD of claim 2, wherein the processor generates an identification area corresponding to a position of the external device within the captured image by using at least one of distance information, direction information, and altitude information of the external device, and

wherein the processor detects an object including the identification area or an object neighboring the identification area.

9. The HMD of claim 1, wherein the processor converts a format of the captured image to a gray mode, extracts a borderline from the converted image, and recognizes an object based on the extracted borderline.

10. The HMD of claim 9, wherein the processor recognizes an object based on a looped curve from the extracted borderline.

11. The HMD of claim 1, wherein the processor requests the ticket information to at least one external object by using a broadcast way.

12. The HMD of claim 1, wherein the ticket information includes valid time information of the ticket, place information of the ticket, and identification information for distinguishing the ticket from other tickets, and

wherein the augmented reality information is matched with the identification information.

13. The HMD of claim 1, wherein the augmented reality information includes the ticket information or a ticket purchase history.

14. The HMD of claim 1, wherein the processor acquires the augmented reality information from a server that has issued the ticket.

15. The HMD of claim 1, wherein the processor acquires the augmented reality information associated with the ticket information, when the ticket information received from the external device is valid.

16. The HMD of claim 1, wherein the processor transmits certification information to the external device, when the ticket information is valid.

17. The HMD of claim 16, wherein the processor transmits the certification information, if the processor detects an eyesight of a user focused on the displayed augmented reality information.

18. A method for controlling a head mounted display (HMD), comprising:

requesting ticket information to an external device;

receiving a response including the ticket information according to the request from the external device;

acquiring augmented reality information associated with the ticket information;

capturing an image of a surrounding area of the HMD;

detecting an object related to the external device in the captured image; and

displaying the augmented reality information associated with the ticket information on a surrounding area of the detected object.

19. The method of claim 18, further comprising:

acquiring position information of the external device; and

extracting at least one of distance information, direction information, and altitude information of the external device with reference to a position of the HMD, based on the acquired position information of the external device.

20. The method of claim 18, wherein the step of detecting an object comprises:

converting a format of the captured image to a gray mode;

extracting a borderline from the converted image;

recognizing an object based on a looped curve from the extracted borderline;

detecting an identification area corresponding to a position of the external device within the captured image by using at least one of the distance information, direction information, and altitude information of the external device; and

detecting an object including the identification area or an object neighboring the identification area.