Method and apparatus for enhancing the generation of three-dimensional sound in headphone devices

• US 8,160,265 B2
• Filed: 05/18/2009
• Issued: 04/17/2012
• Est. Priority Date: 05/18/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Mao, Xiaodong, Rimon, Noam
• Primary Examiner(s): Picardat, Kevin M
• Application Number:
  US12/467,366
• Publication Number:
  US 20100290636A1
• Time in Patent Office: 1,065 Days
• Field of Search: 381/74, 381/309, 702/152
• US Class Current: 381/74
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/004 For headphones
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/304 For headphones

Abstract

A headphone device includes a first and a second ear piece coupled to an assembly, wherein the assembly facilitates the placement of the first and second ear piece in relation to a user'"'"'s ears. A motion transducer is coupled to the first or second ear piece, whereby the motion transducer measures real-time pitch and roll movement associated with the user'"'"'s head. An electronic compass is also coupled to the first or second ear piece, and measures real-time yaw movement associated with the user'"'"'s head. A processing device associated with each of the first and second ear piece processes an audio signal according to a head-related-transfer-function selected from a plurality of head-related-transfer-functions on the basis of the measured pitch, roll, and yaw movement of the user'"'"'s head. The processed audio signal is then applied to the first and second ear piece, and generates a virtual three-dimensional sound corresponding to the selected head-related-transfer-function.

Claims

1. A headphone device comprising:

an assembly;

a first ear piece and a second ear piece coupled to the assembly, wherein the assembly is operable to facilitate the placement of the first and second ear piece in relation to a user'"'"'s ears;

a motion transducer coupled to the first ear piece or the second ear piece, wherein the motion transducer is operable to measure real-time pitch and roll movement associated with the user'"'"'s head;

an electronic compass coupled to the first ear piece or the second ear piece, wherein the electronic compass is operable to measure real-time yaw movement associated with the user'"'"'s head;

a microphone device coupled to the assembly and operable to detect external sound; and

a processing device associated with each of the first ear piece and the second ear piece for processing an audio signal according to a head-related-transfer-function selected from a plurality of head-related-transfer-functions on the basis of the measured pitch, roll, and yaw movement of the user'"'"'s head, and operable to receive the detected external sound, the processing device mixing the detected external sound with the audio signal,

wherein the processed audio signal mixed with the external sound is applied to the first ear piece and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function, and

wherein in a safety utility mode external sound from a particular direction is amplified by the processing device, and

wherein in a preselected sound detection mode external sound of a particular frequency is amplified by the processing device.

2. The headphone device according to claim 1, wherein the motion transducer comprises an accelerometer device.

3. The headphone device according to claim 1, wherein the electronic compass comprises a digital compass.

4. The headphone device according to claim 1, wherein the processing device comprises a programmable digital filter operable to filter the audio signal according to any one of the plurality of head-related-transfer-functions selected.

5. The headphone device according to claim 1, wherein each of the plurality of head-related-transfer-functions are modeled based on listening cues obtained according to different positions of the user'"'"'s head.

6. The headphone device according to claim 1, further comprising a first and a second headphone transducer respectively associated with the first and the second ear piece, wherein the first and the second headphone transducer convert the processed audio signal into an acoustic signal corresponding to the virtual three-dimensional sound.

7. Aheadphone device comprising:

an assembly having a first and a second ear piece, wherein the assembly facilitates the placement of the first and second ear piece in relation to a user'"'"'s ears;

a first sensory device coupled to the assembly and operable to generate first signal information corresponding to a pitch and roll movement associated with the user'"'"'s head;

a second sensory device coupled to the assembly and operable generate second signal information corresponding to a yaw movement associated with the user'"'"'s head;

a microphone device coupled to the assembly and operable to detect external sound; and

a processing device operable to receive the generated first and second signal information, the processing device processing an audio signal according to a head-related-transfer-function selected from a plurality of head-related-transfer-functions on the basis of the generated first and second signal information, and operable to receive the detected external sound, the processing device mixing the detected external sound with the audio signal,

wherein the processed audio signal is applied to the first and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function, and

wherein in a safety utility mode external sound from a particular direction is amplified by the processing device, and

wherein in a preselected sound detection mode external sound of a particular frequency is amplified by the processing device.

8. The headphone device according to claim 7, wherein the generated first and second signal information comprise analog signals.

9. The headphone device according to claim 7, wherein the generated first and second signal information comprise digital signals.

10. A headphone system adapted for use in a gaming environment, the headphone system comprising:

an assembly having a first and a second ear piece, wherein the assembly facilitates the placement of the first and second ear piece in relation to a user'"'"'s ears;

a first sensory device coupled to the assembly and operable to generate first signal information corresponding to a pitch and roll movement associated with the user'"'"'s head;

a second sensory device coupled to the assembly and operable generate second signal information corresponding to a yaw movement associated with the user'"'"'s head;

a communications device operable to receive the first and second signal information for transmission to the gaming environment;

a microphone device coupled to the assembly and operable to detect external sound; and

a processing device coupled to the communication device for receiving third signal information from the gaming environment based on the transmitted first and second signal information, the processing device operable to process an audio signal according to a head-related-transfer-function selected from a plurality of head-transfer-funtions on the basis of the third signal information, and operable to receive the detected external sound, the processing device mixing the detected external sound with the audio signal,

wherein the processed audio signal is applied to the first and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function, and

wherein in a safety utility mode external sound from a particular direction is amplified by the processing device, and

wherein in a preselected sound detection mode external sound of a particular frequency is amplified by the processing device.

11. The headphone system according to claim 10, wherein the gaming environment comprises:

a gaming console; and

a transceiver device coupled to the gaming console,

wherein the gaming console receives the first and the second signal information transmitted from the communications device via the transceiver device, and transmits the third signal information to the communications device via the transceiver device.

12. The headphone system according to claim 11, wherein the selected head-related-transfer-function corresponds to simulate listening cues programmed into a particular game executing on the gaming console.

13. A headphone device comprising:

an assembly having a first and a second ear piece, wherein the assembly facilitates the placement of the first and second ear piece in relation to a user'"'"'s ears;

a first sensory device coupled to the assembly and operable to generate first signal information corresponding to a pitch and roll movement associated with the user'"'"'s head;

a second sensory device coupled to the assembly and operable to generate second signal information corresponding to a yaw movement associated with the user'"'"'s head;

a microphone system coupled to the assembly and operable to detect external sound; and

a processing device operable to receive the generated first and second signal information for detecting position information associated with the user'"'"'s head, and operable to receive the detected external sound for determining the direction of the external sound, the processing device mixing the detected external sound with an audio signal based on the detected position information and the direction of the external sound,

wherein the external sound mixed with the audio signal is processed according to a head-related-transfer-function selected from a plurality of head-related-transfer-functions on the basis of the detected position information, the external sound mixed with the audio signal being applied to the first and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function, and

wherein in a safety utility mode external sound from a particular direction is amplified by the processing device, and

wherein in a preselected sound detection mode external sound of a particular frequency is amplified by the processing device.

14. The headphone device according to claim 13, wherein the microphone system comprises:

a plurality of spatially arranged audio transducers each operative to receive the external sound; and

at least one output operable to couple the detected external sound based on the external sound received by the plurality of spatially arranged audio transducers.

15. A headphone device including a first and a second ear piece, the headphone device comprising:

a motion sensing device operable to;

(i) generate first signal information corresponding to a pitch and roll movement associated with a user'"'"'s head;

(ii) generate second signal information corresponding to a yaw movement associated with the user'"'"'s head;

a microphone device coupled to the assembly and operable to detect external sound; and

a processing device operable to receive the generated first and second signal information, and process an audio signal according to a head-related-transfer-function on the basis of the received first and second signal information, and operable to receive the detected external sound, the processing device mixing the detected external sound with the audio signal,

wherein the processed audio signal is applied to the first and second ear piece and generates a virtual three-dimensional sound corresponding to the selected head-related-transfer-function, and

wherein in a safety utility mode external sound from a particular direction is amplified by the processing device, and

wherein in a preselected sound detection mode external sound of a particular frequency is amplified by the processing device.

16. The headphone device according to claim 15, further comprising an audio sensing device comprising:

a plurality of spatially arranged audio transducers each operative to receive sound external to the headphone device; and

at least one output operable to generate third signal information based on the external sound received by the plurality of spatially arranged audio transducers, wherein the generated third signal information is processed by the processing device for detecting the location of the sound relative to the headphone device, the processor mixing the received sound with an audio signal based on the detected location of the sound,

wherein the sound mixed with the audio signal is processed according to a head-related-transfer-function selected from a plurality of head-related-transfer-functions on the basis of the first and second signal information received by the processing device from the sensing device, wherein the external sound mixed with audio signal applied to the first and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function.

17. A method of generating three-dimensional sound in a headphone device including a first and a second ear piece, the method comprising:

generating first signal information corresponding to a pitch and roll movement associated with a user'"'"'s head;

generating second signal information corresponding to a yaw movement associated with the user'"'"'s head;

processing the generated first and second signal information for determining position information associated the user'"'"'s head;

detecting external sound; and

processing an audio signal according to a head-related-transfer-function selected on the basis of the determined position information;

mixing the detected external sound with the audio signal,

wherein the processed audio signal is applied to the first and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function, and

wherein in a safety utility mode external sound from a particular direction is amplified, and

wherein in a preselected sound detection mode external sound of a particular frequency is amplified.

18. The method according to claim 17, further comprising:

transmitting the first and second signal information to a gaming environment;

receiving third signal information from the gaming environment based on the first and second signal information transmitted to the gamming environment; and

processing the audio signal according to another head-related-transfer-function selected on the basis of the third signal information.

19. The method according to claim 17, further comprising:

detecting external sound;

determining the direction of the external sound; and

mixing the detected external sound with an audio signal based on the determined direction of the external sound.

20. The method according to claim 19, further comprising:

processing the external sound mixed with the audio signal according to another head-related-transfer-function selected from a plurality of head-related-transfer functions on the basis of the determined position information associated with the user'"'"'s head.

21. The method according to claim 20, further comprising:

applying the processed external sound mixed with the audio signal being to the first and second ear piece for generating a virtual three-dimensional sound corresponding to the selected head-related-transfer-function.

22. The method according to claim 17, further comprising:

generating head movement information from the generated first and second signal information;

transmitting the generated head movement information to a computer environment; and

translating the head movement information, at the computer environment, into at least one computer input command.