Head mounted display and method for controlling the same

• US 9,147,290 B2
• Filed: 02/26/2013
• Issued: 09/29/2015
• Est. Priority Date: 01/04/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Jihyun
• Primary Examiner(s): McDowell, Jr., Maurice L
• Assistant Examiner(s): Ricks, Donna J
• Application Number:
  US13/777,678
• Publication Number:
  US 20140192085A1
• Time in Patent Office: 945 Days
• US Class Current: 1/1
• CPC Class Codes: G01S 19/51 Relative positioning
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G07B 11/00 Apparatus for validating or cancelling issued tickets
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area

Abstract

A head mounted display (HMD) and a method for controlling the same are disclosed. Most particularly, the HMD and the method for controlling the same may detect an external device having a ticket stored therein and display augmented reality information related to the stored ticket in a location approximate to an individual carrying an external device, in order to check tickets.

Claims

1. A head mounted display (HMD), comprising:

a camera unit configured to capture an image;

a display unit configured to display augmented reality information;

a communication unit configured to transmit and receive data to and from an external device;

a sensor unit configured to sense a position of the HMD and to deliver the sensed position to a processor; and

the processor configured to control the camera unit, the display unit, the communication unit, and the sensor unit,

wherein the processor is further configured to;

control the communication unit to request ticket information from the external device,

control the communication unit to receive a response including the ticket information according to the request from the external device,

acquire augmented reality information associated with the ticket information, when the ticket information received by the communication unit from the external device is valid,

detect an object related to the external device in the image captured by the camera unit, and

control the display unit to display the augmented reality information associated with the ticket information on a surrounding area of the detected object.

2. The HMD of claim 1, wherein the processor acquires position information of the external device, and

wherein the processor extracts at least one of distance information, direction information, and altitude information of the external device with reference to a position of the HMD from the acquired position information of the external device.

3. The HMD of claim 2, wherein the processor receives the position information according to a global positioning system (GPS) from the external device or acquires the position information by using wireless LAN signal information of the external device and an address information where the HMD is positioned.

4. The HMD of claim 2, wherein the processor captures an image, when the processor detects that the external device is located within an angle of a view zone of the HMD according to the position information of the external device.

5. The HMD of claim 2, wherein the processor detects an object related to the external device in the captured image by using at least one of the distance information, direction information, and altitude information of the external device.

6. The HMD of claim 2, wherein the captured image includes a three-dimensional (3D) image, and wherein the processor extracts depth information of at least one object included in the captured image.

7. The HMD of claim 6, wherein the processor detects an object related to the external device in the captured image by using the depth information and at least one of the distance information, direction information, and altitude information of the external device.

8. The HMD of claim 2, wherein the processor generates an identification area corresponding to a position of the external device within the captured image by using at least one of distance information, direction information, and altitude information of the external device, and

wherein the processor detects an object including the identification area or an object neighboring the identification area.

9. The HMD of claim 1, wherein the processor converts a format of the captured image to a gray mode, extracts a borderline from the converted image, and recognizes an object based on the extracted borderline.

10. The HMD of claim 9, wherein the processor recognizes an object based on a looped curve from the extracted borderline.

11. The HMD of claim 1, wherein the processor requests the ticket information to at least one external object by using a broadcast way.

12. The HMD of claim 1, wherein the ticket information includes valid time information of the ticket, place information of the ticket, and identification information for distinguishing the ticket from other tickets, and

wherein the augmented reality information is matched with the identification information.

13. The HMD of claim 1, wherein the augmented reality information includes the ticket information or a ticket purchase history.

14. The HMD of claim 1, wherein the processor acquires the augmented reality information from a server that has issued the ticket.

15. The HMD of claim 1, wherein the processor transmits certification information to the external device, when the ticket information is valid.

16. The HMD of claim 15, wherein the processor transmits the certification information, if the processor detects an eyesight of a user focused on the displayed augmented reality information.

17. A method for controlling a head mounted display (HMD), the method comprising:

requesting, by a communication unit in the HMD, ticket information from an external device;

receiving, by the communication unit, a response including the ticket information according to the request from the external device;

acquiring, by a processor in the HMD, augmented reality information associated with the ticket information, when the ticket information received by the communication unit from the external device is valid;

capturing, by a camera unit in the HMD, an image;

detecting, by the processor, an object related to the external device in the image captured by the camera unit; and

displaying, by a display unit in the HMD, the augmented reality information associated with the ticket information on a surrounding area of the detected object.

18. The method of claim 17, further comprising:

acquiring, by the processor, position information of the external device; and

extracting, by the processor, at least one of distance information, direction information, and altitude information of the external device with reference to a position of the HMD, based on the acquired position information of the external device.

19. The method of claim 17, wherein the detecting the object comprises:

converting, by the processor, a format of the captured image to a gray mode;

extracting, by the processor, a borderline from the converted image;

recognizing, by the processor, an object based on a looped curve from the extracted borderline;

detecting, by the processor, an identification area corresponding to a position of the external device within the captured image by using at least one of the distance information, direction information, and altitude information of the external device; and

detecting, by the processor, an object including the identification area or an object neighboring the identification area.