Head mounted display and method of controlling therefor

• US 10,664,230 B2
• Filed: 01/22/2016
• Issued: 05/26/2020
• Est. Priority Date: 07/25/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Doyoung, Kim, Jongho, Kim, Jihwan, Chun, Sinae, Kim, Yongsin
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US15/538,231
• Publication Number:
  US 20170364325A1
• Time in Patent Office: 1,586 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A method of controlling a head mounted display (HMD) according to one embodiment of the present specification includes performing a first operation, receiving a first voice input through an audio input unit, processing the first voice input with respect to the first operation while a first contact is detected through a first sensor positioned at a nose pad of the HMD, detecting the first contact being released through the first sensor positioned at a nose pad of the HMD, receiving a second voice input through the audio input unit while the first contact is released, and performing a second operation according to the received second voice input.

Claims

1. A head mounted display (HMD), comprising:

a display unit configured to display digital information;

an audio input unit configured to receive a voice input;

a first sensor configured to detect a first contact, wherein the first sensor is positioned at a nose pad of the HMD and detects the first contact when the nose pad of the HMD contacts a first designated area of a user'"'"'s head;

a second sensor configured to detect a second contact, wherein the second sensor is positioned at a temple of the HMD, and detects the second contact when the temple of the HMD contacts a second designated area of the user'"'"'s head; and

a controller configured to;

perform a first operation,

receive, through the audio input unit, a first voice input while the first contact and the second contact are detected,

process the first voice input with respect to the first operation,

detect, through the first sensor, the first contact being released,

receive, through the audio input unit, a second voice input while the first contact is released and the second contact is maintained, and

perform a second operation according to the received second voice input,

wherein the HMD further comprises a communication unit configured to perform a telecommunication transmission by transmitting the received voice input, wherein the first operation is the telecommunication transmission, and

wherein the controller excludes the second voice input from the telecommunication transmission.

2. The HMD of claim 1, the controller further configured to:

detect the first contact again after being released,

receive, through the audio input unit, a third voice input while the first contact is detected, and

process the third voice input with respect to the first operation.

3. A head mounted display (HMD), comprising:

a display unit configured to display digital information;

an audio input unit configured to receive a voice input;

a first sensor configured to detect a first contact, wherein the first sensor is positioned at a nose pad of the HMD;

a second sensor configured to detect a second contact, wherein the second sensor is positioned at a temple of the HMD; and

a controller configured to;

perform a first operation,

in response to receiving, though the audio input unit, a first voice input while both the first and second contacts are detected and the first operation is being performed, execute a first function for the first voice input related to the first operation while the first operation is still being performed,

detect an event while the first voice input is being received through the audio input unit, the first and second contacts are detected and the first operation is still being performed, and

in response to receiving, though the audio input unit, a second voice input while the first contact is released and the second contact is maintained while the first operation is still being performed, execute a second function for the second voice input related to the event,

wherein the first function is different than the second function.

4. The HMD of claim 3, the controller further configured to:

detect the first contact again after being released,

receive, through the audio input unit, a third voice input while the first contact is detected, and

perform the first operation according to the first voice input and the third voice input.

5. The HMD of claim 3, wherein the event includes an e-mail receiving event, a message receiving event or schedule notifying event.

6. The HMD of claim 3, wherein the controller is further configured to display the second voice input on the display unit.

7. A method of controlling a head mounted display (HMD), comprising:

performing a first operation;

receiving, through an audio input unit, a first voice input;

processing the first voice input with respect to the first operation while a first contact is detected through a first sensor positioned at a nose pad of the HMD and a second contact is detected through a second sensor positioned at a temple of the HMD, wherein the first contact is detected when the nose pad of the HMD contacts a first designated area of a user'"'"'s head, wherein the second contact is detected when the temple of the HMD contacts a second designated area of the user'"'"'s head;

detecting, through the first sensor positioned at the nose pad of the HMD, the first contact being release when the nose pad of the HMD is released from the first designated area of the user'"'"'s head;

receiving, through the audio input unit, a second voice input while the first contact is released and the second contacted is maintained; and

performing a second operation according to the received second voice input,

wherein the first operation is a telecommunication transmission, and

wherein the second voice input is excluded from the telecommunication transmission.

8. The method of claim 7, further comprising:

detecting the first contact again after being released;

receiving, through the audio input unit, a third voice input while the first contact is detected; and

processing the third voice input with respect to the first operation.

9. A method of controlling a head mounted display (HMD), comprising:

detecting an event while a first voice input is being received through an audio input unit and a first contact is detected through a first sensor positioned at a nose pad of the HMD and a second contact is detected through a second sensor positioned at a temple of the HMD, wherein the first voice input is related with a first voice command, wherein the second contact is detected when the temple of the HMD contacts a second designated area of the user'"'"'s head;

detecting, through the first sensor, the first contact being released while a first function is being executed related to the first voice command;

in response to receiving, through the audio input unit, a second voice input with respect to the event while the first contact is released and the second contacted is maintained, executing a second function related to a second voice command,

wherein the first function is different than the second function.

10. The method of claim 9, further comprising:

detecting the first contact again after being release;

receiving, through the audio input unit, a third voice input while the first contact is detected; and

performing the first function related to the first voice command according to the first voice input and the third voice input.

11. The method of claim 9, wherein the second command is not related to the first command.

12. The method of claim 9, wherein the event includes an e-mail receiving event, a message receiving event or schedule notifying event.

13. The method of claim 9, wherein the second voice input is displayed on the display unit.