Method and apparatus for personalized audio virtualization

• US 10,070,245 B2
• Filed: 08/19/2016
• Issued: 09/04/2018
• Est. Priority Date: 11/30/2012
• Status: Active Grant

• Current Assignee: DTS, Inc. (Adeia Inc.)
• Original Assignee: DTS, Inc. (Adeia Inc.)
• Inventors: Walsh, Martin, Stein, Edward, Kelly, Michael C., Velagaleti, Prashant
• Primary Examiner(s): Kim, Paul S
• Application Number:
  US15/242,141
• Publication Number:
  US 20160360335A1
• Time in Patent Office: 746 Days
• Field of Search: 381303, 381 17, 381 58, 381300, 381309, 381310
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/304 For headphones
• CPC Class Codes: H04S 7/305 Electronic adaptation of stereophonic audio signals to reverberation of the listening space H04S7/301 takes precedence
• CPC Class Codes: H04S 7/306 For headphones
• CPC Class Codes: H04S 7/307 Frequency adjustment, e.g. tone control H04S7/301 takes precedence
• CPC Class Codes: H04S 7/308 Electronic adaptation dependent on speaker or headphone connection

Abstract

A method and apparatus may be used to perform personalized audio virtualization. The apparatus may include a speaker, a headphone (over-the-ear, on-ear, or in-ear), a microphone, a computer, a mobile device, a home theater receiver, a television, a Blu-ray (BD) player, a compact disc (CD) player, a digital media player, or the like. The apparatus may be configured to receive an audio signal, scale the audio signal, and perform a convolution and reverberation on the scaled audio signal to produce a convolved audio signal. The apparatus may be configured to filter the convolved audio signal and process the filtered audio signal for output.

Claims

1. A method for use in an audio device, the method comprising:

receiving, by the audio device, digital audio content that contains at least one audio channel signal;

transmitting information identifying the audio device to a server;

receiving, from the server, a device profile based on a frequency response parameter of a device;

accessing a room measurement profile based on acoustic measurements of a predetermined room;

accessing a listener hearing profile based on a spectral response curve of a user hearing ability;

configuring at least one digital filter based on said device profile, said room measurement profile and said listener hearing profile;

filtering the at least one audio channel with the corresponding at least one digital filter to produce a filtered audio signal; and

outputting the filtered audio signal to an accessory device coupled to the audio device to reproduce the digital audio content.

2. The method of claim 1, wherein the device profile is based on one or both of a frequency response parameter of a playback device and a frequency response parameter of an accessory device.

3. The method of claim 1, wherein one or more of the room measurement profile, listener hearing profile, and device profile is received as metadata that is multiplexed with the digital audio content.

4. The method of claim 1, wherein one or more of the room measurement profile, listener hearing profile, and device profile is received as metadata in a container file separately from the digital audio content.

5. The method of claim 1, wherein the digital audio content is received as an audio source stream.

6. The method of claim 1, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, an early room response parameter, and a late reverberation parameter.

7. The method of claim 6, wherein the early room response parameter and the late reverberation parameter configure the digital filter to produce a filtered audio signal having acoustic properties substantially similar to the acoustic properties of the predetermined room.

8. The method of claim 7, wherein the late reverberation parameter configures a parametric model of the late reverberation of the predetermined room.

9. The method of claim 1, wherein the step of accessing a room measurement profile includes selecting a room measurement profile based on an acoustic parameter or architectural characteristic of a user'"'"'s current environment.

10. The method of claim 9, wherein the selected room measurement profile is adapted based on an acoustic parameter or architectural characteristic of a user'"'"'s current environment.

11. The method of claim 10, wherein the selected room measurement profile is adapted by time scaling an early response parameter of the predetermined room.

12. The method of claim 10, wherein the selected room measurement profile is adapted by filtering an early response parameter of the predetermined room.

13. The method of claim 1, wherein the step of accessing a room measurement profile is based on a user selected equalization profile.

14. The method of claim 1, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, and wherein the step of accessing a room measurement profile is based on a user selected set of said HRTF filter coefficients.

15. The method of claim 14, wherein the user selected set of HRTF filter coefficients is based on a listening test.

16. An audio device comprising:

an interface configured to

receive digital audio content that contains at least one audio channel signal;

transmit information identifying the audio device to a server; and

receive from the server a device profile that influences the reproduction of the digital audio content; and

a processor configured to

access a room measurement profile based on acoustic measurements of a predetermined room and a listener hearing profile based on a spectral response curve of a user hearing ability; and

configure at least one digital filter based on the device profile, room measurement profile, and listener hearing profile, wherein the processor is configured to filter the at least one audio channel signal with the corresponding at least one digital filter to produce a filtered audio signal;

wherein the processor is configured to output the filtered audio signal to an accessory device coupled to the audio device to reproduce the digital audio content.

17. The audio device of claim 16, wherein the device profile is based on one or both of a frequency response parameter of a playback device and a frequency response parameter of an accessory device.

18. The audio device of claim 16, wherein one or more of the room measurement profile, listener hearing profile, and device profile is received as metadata that is multiplexed with the digital audio content.

19. The audio device of claim 16, wherein one or more of the room measurement profile, listener hearing profile, and device profile is received as metadata in a container file separately from the digital audio content.

20. The audio device of claim 16, wherein the digital audio content is received as an audio source stream.

21. The audio device of claim 16, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, an early room response parameter, and a late reverberation parameter.

22. The audio device of claim 21, wherein the early room response parameter and the late reverberation parameter configure the digital filter to produce a filtered audio signal having acoustic properties substantially similar to the acoustic properties of the predetermined room.

23. The audio device of claim 22, wherein the late reverberation parameter configures a parametric model of the late reverberation of the predetermined room.

24. The audio device of claim 16, wherein the step of accessing a room measurement profile includes selecting a room measurement profile based on an acoustic parameter or architectural characteristic of a user'"'"'s current environment.

25. The audio device of claim 24, wherein the selected room measurement profile is adapted based on an acoustic parameter or architectural characteristic of a user'"'"'s current environment.

26. The audio device of claim 25, wherein the selected room measurement profile is adapted by time scaling an early response parameter of the predetermined room.

27. The audio device of claim 25, wherein the selected room measurement profile is adapted by filtering an early response parameter of the predetermined room.

28. The audio device of claim 16, wherein the step of accessing a room measurement profile is based on a user selected equalization profile.

29. The audio device of claim 16, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, and wherein the step of accessing a room measurement profile is based on a user selected set of said HRTF filter coefficients.

30. The audio device of claim 29, wherein the user selected set of HRTF filter coefficients is based on a listening test.