SYSTEMS AND METHODS FOR SOUND EXTERNALIZATION OVER HEADPHONES

• US 20190313201A1
• Filed: 04/04/2018
• Published: 10/10/2019
• Est. Priority Date: 04/04/2018
• Status: Abandoned Application

• Current Assignee: Bose Corporation
• Original Assignee: Bose Corporation
• Inventors: Torres, Wade P., Tengelsen, Daniel R., Shannon, Mikaela A.
• Application Number:
  US15/945,449
• Publication Number:
  US 20190313201A1
• Time in Patent Office: Days
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/304 For headphones
• CPC Class Codes: H04S 7/306 For headphones

Abstract

A system and method for externalizing sound. The system includes a headphone assembly and a localizer configured to collect information related to a location of the user and of an acoustically reflective surface in the environment. A controller is configured to determine a location of a virtual sound source, and generate head related transfer functions that simulate characteristics of sound from the virtual sound source directly to the user and to the user via a reflection by the reflective surface. A signal processing assembly is configured to create one or more output signals by filtering the sound signal respectively with the HRTFs. Each speaker of the headphone assembly is configured to produce sound in accordance with the output signal.

Claims

1. A sound externalization system, comprising:

a localizer configured to collect information related to a first location of a user in an environment and a second location of an acoustically reflective surface in the environment;

a controller configured to;

determine a third location of a virtual sound source in the environment;

generate a first left head related transfer function (HRTF) and a first right HRTF that simulate characteristics of sound radiated from the virtual sound source directly to the user;

determine a reflected sound path from the virtual sound source to the user that includes reflection of sound by the acoustically reflective surface;

generate a second left HRTF and a second right HRTF that simulates characteristics of sound from the reflective surfaces to the user, wherein the second left HRTF and second right HRTF are different from the first left HRTF and first right HRTF; and

generate a sound signal corresponding to the virtual sound source.

2. The system of claim 1, wherein the controller is configured to determine the reflected sound path by determining a fourth location corresponding to a mirrored reflection of the virtual sound source by the reflective surface, the reflected sound path comprising a direct path from the fourth location to the first location.

3. The system of claim 1, including a plurality of the acoustically reflective surfaces, wherein the reflected sound path represents at least one higher-order reflection off of two or more of the acoustically reflective surfaces.

4. The system of claim 1, further comprising a headphone assembly configured to be worn by the user and having:

a left speaker and a right speaker; and

a signal processing circuit configured to create first left, second left, first right, and second right output signals, respectively, by filtering the sound signal with the first left, second left, first right, and second right HRTFs;

wherein the left speaker is configured to produce sound in accordance with the first and second left output signals and the right speaker is configured to produce sound in accordance with the first and second right output signals.

5. The system of claim 4, wherein the signal processing circuit is configured to sum the first and second left output signals and to sum the first and second right output signals.

6. The system of claim 1, further comprising an acoustic characteristic detector configured to collect data related to reverberation characteristics of the environment or the acoustically reflective surface, wherein the controller is configured to determine an absorption coefficient for the environment or for the acoustically reflective surface from the data.

7. The system of claim 1, further comprising a display configured to display an avatar representing the virtual sound source at the third location when the third location is viewed through the display.

8. The system of claim 7, wherein the display is included by in a smartphone or other mobile computing device.

9. The system of claim 1, wherein the localizer comprises a rangefinder, a proximity sensor, an ultrasonic sensor, a camera, an infrared camera, or a combination including at least one of the foregoing.

10. The system of claim 1, wherein the localizer includes at least one sensor external to or integrated in the headphone assembly.

11. The system of claim 1, wherein the localizer is configured to obtain electronic data representative of a map of the environment that indicates surfaces of the acoustically reflective surface.

12. The system of claim 1, wherein the acoustically reflective surface includes one or more walls, floors, ceilings, or a combination including at least one of the foregoing.

13. The system of claim 1, further comprising a motion tracker configured to collect data related to an orientation of the user.

14. The system of claim 13, wherein the motion tracker includes a proximity sensor, an ultrasonic sensor, an infrared sensor, a camera, an accelerometer, a gyroscope, an inertial motion sensor, an external camera, or a combination including at least one of the foregoing.

15. The system of claim 13, wherein the controller is configured to determine one or more angles between the orientation of the user and a directionality of sound from the third location, from the reflective surface, or both, and the one or more angles are utilized by the controller when generating the first left, second left, first right, and second right HRTFs.

16. The system of claim 1, wherein the controller is configured to recalculate the first left, second left, first right, and second right HRTFs in response the system detecting relative movement between any combination of the user, the third location of the virtual sound source, and the acoustically reflective surface.

17. The system of claim 16, wherein the controller is configured to move the virtual sound source by changing the third location.

18. A sound externalization system, comprising:

a headphone assembly worn by a user;

a sensor configured to detect an acoustically reflective surface in an environment in which the user is located;

a controller configured to;

associate a first location in the environment with a virtual sound source;

determine a second location of the user;

determine reflected sound path simulating sound from the first location to the user that includes a reflection by the acoustically reflective surface at a third location;

generate a first head related transfer function simulating characteristics of sound traveling from the first location to the second location;

generate a second head related transfer function simulating characteristics of sound traveling from the third location to the second location, wherein the second head related transfer function is different from the first head related transfer function;

generate a sound signal for the virtual sound source;

generate a first output signal by filtering the sound signal with the first head related transfer function and a second output signal by filtering the sound signal with the second head related transfer function; and

a speaker of the headphone assembly configured to produce sound in accordance with the first and second output signals.

19. A method for externalizing sound from a headphone assembly worn by a user, comprising:

associating a virtual sound source with a physical location in an environment in which the user is located;

identifying one or more acoustically reflective surfaces in the environment;

determining a reflected sound path from the physical location to the user that includes a reflection by the acoustically reflective surface;

generating a first head related transfer function (HRTF) simulating characteristics of sound received by the user directly from the physical location;

generating a second HRTF simulating characteristics of sound received by the user from the reflection, wherein the second HRTF is different from the first HRTF;

generating a sound signal corresponding to the virtual sound source;

filtering the sound signal with the first HRTF to generate a first output signal;

filtering the sound signal with the second HRTF to generate a second output signal; and

producing sound with a speaker of the headphone assembly in accordance with the first and second output signals.

20. The method of claim 19, further comprising tracking relative movement between any combination of the user, the physical location associated with the virtual sound source, and the acoustically reflective surface, wherein the tracking occurs continuously during the method.