Head mounted display and method of outputting audio signal using the same

• US 9,374,549 B2
• Filed: 11/27/2012
• Issued: 06/21/2016
• Est. Priority Date: 10/29/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Cho, Eunhyung
• Primary Examiner(s): Mercedes, Dismery
• Application Number:
  US13/686,596
• Publication Number:
  US 20140118631A1
• Time in Patent Office: 1,302 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G05B 2219/35503 Eye tracking associated with head mounted display to detect eye position
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/4398 involving reformatting operations of audio signals details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 5/602 for digital sound signals
• CPC Class Codes: H04R 1/028 associated with devices performing functions other than acoustics, e.g. electric candles
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04R 5/04 : Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2400/11 : Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 : Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 : Control circuits for electronic adaptation of the sound field

Abstract

The invention relates to a head mounded display that outputs an audio signal of an external digital device according to whether the audio signal is directional output signal.

Claims

1. A head mounted display (HMD) comprising:

a processor configured to control an operation of the HMD;

an audio output unit configured to output audio according to a command of the processor, wherein the audio output unit includes a left channel output unit and a right channel output unit;

a sensor unit configured to detect at least one external digital device connected to the HMD and transmitting whether at least one external digital device is connected to the HMD to the processor; and

a communication unit configured to transmit/receive data to/from the external digital device according to a command of the processor,

wherein the processor receives an audio signal of the external digital device,

determines whether to output the received audio signal directionally,

detects location information of the external digital device corresponding to the audio signal when the received audio signal is a directional output signal, wherein the location information represents a relative location of the external digital device with respect to the HMD,

detects a location state of the external digital device based on the location information, wherein the location state includes a first state in which the external digital device is located within a predetermined view angle of the HMD and a second state in which the external digital device is not located within the view angle of the HMD, and

outputs the audio signal based on the detected location information and location state of the external digital device, wherein the audio signal output includes a left channel output and a right channel output, wherein at least one of the left channel output and the right channel output is controlled respectively based on the location information and the location state of the external digital device for outputting directional audio sound,

wherein the processor controls an output level of the audio signal to be less than or equal to a predetermined level or blocks output of the audio signal when the location state of the external digital device corresponds to the second state.

2. The HMD of claim 1, wherein the processor provides a rear view interface, which virtually represents the location information of the external digital device, on the HMD when the location state of the external digital device corresponds to the second state.

3. The HMD of claim 1, wherein the processor controls at least one of an output level difference and an output time difference between the left channel output and the right channel output based on the location information of the external digital device.

4. The HMD of claim 1, wherein the processor converts the audio signal into a 3D audio signal based on the location of the external digital device, wherein the 3D audio signal is a binaural audio signal having 3D effect.

5. The HMD of claim 4, wherein the processor generates a head related transfer function (HRTF) information based on the location information of the external digital device, and

converts the audio signal into the 3D audio signal using the generated HRTF information.

6. The HMD of claim 1, wherein the sensor unit includes a left channel receiving unit configured to receive the audio signal for audio output of the left channel output unit and a right channel receiving unit configured to receive the audio signal for audio output of the right channel output unit,

wherein the processor controls at least one of the left channel output and the right channel output by reflecting a received time difference of the audio signal that the left channel receiving unit and the right channel receiving unit respectively receive.

7. The HMD of claim 6, wherein the audio signal of the external digital device includes an ultrasonic signal, and

the processor converts ultrasonic signals respectively received by the left channel receiving unit and the right channel receiving unit into the left channel output and the right channel output at an audible frequency and outputs the left channel output and the right channel output.

8. The HMD of claim 6, wherein the left channel output unit and the right channel output unit output the audio signal received by the left channel receiving unit and the right channel receiving unit respectively in real time.

9. The HMD of claim 1, wherein the communication unit includes at least one antenna, and

the processor detects the location information of the external digital device using a signal transmitted/received between the HMD and the external digital device through the antenna.

10. The HMD of claim 1, wherein the sensor unit further includes a camera unit,

wherein the processor detects an image of the external digital device using the camera unit, and obtains the location information of the external digital device using the detected image.

11. The HMD of claim 1, wherein the sensor unit further includes a camera unit,

wherein the processor detects a marker corresponding to the external digital device using the camera unit, and obtains the location information of the external digital device using the detected marker.

12. The HMD of claim 11, wherein the marker includes an optical pattern output from the external digital device.

13. The HMD of claim 1, wherein the processor provides an audio output control interface configured to control output of the audio signal of at least one of the external digital device, and

controls an output level of the audio signal of the external digital device based on a user input for the audio output control interface.

14. The HMD of claim 13, wherein the processor displays the audio output control interface of the audio signal at a position corresponding to the external digital device when the audio signal is output directionally.

15. The HMD of claim 13, wherein the audio output control interface includes a user interface configured to convert between directional output and non-directional output, and

converts whether the audio signal is output directionally based on a user input applied to the user interface.

16. The HMD of claim 1, wherein the processor further receives additional data corresponding to the audio signal, wherein the additional data represents whether the audio signal is output directionally.

17. The HMD of claim 1, wherein the processor determines whether the audio signal is output directionally based on device information of the external digital device corresponding to the audio signal.

18. A method of outputting an audio signal using an HMD, the method comprising:

receiving an audio signal of at least one external digital device connected to the HMD;

determining whether to output the received audio signal directionally output signal;

detecting location information of the external digital device corresponding to the audio signal when the audio signal is a directional output signal, wherein the location information represents a relative location of the external digital device with respect to the HMD;

detecting a location state of the external digital device based on the location information, wherein the location state includes a first state in which the external digital device is located within a predetermined view angle of the HMD and a second state in which the external digital device is not located within the view angle of the HMD; and

outputting the audio signal based on the detected location information and location state of the external digital device, wherein the audio signal output includes a left channel output and a right channel output, wherein at least one of the left channel output and the right channel output is controlled respectively based on the location information and the location state of the external digital device for outputting directional audio sound,

wherein the outputting the audio signal controls the output level of the audio signal to be less than or equal to a predetermined level or blocks output of the audio signal when the location state of the external digital device corresponds to the second state.