Method and apparatus for personalized audio virtualization

• US 9,426,599 B2
• Filed: 11/26/2013
• Issued: 08/23/2016
• Est. Priority Date: 11/30/2012
• Status: Active Grant

• Current Assignee: DTS, Inc. (Adeia Inc.)
• Original Assignee: DTS, Inc. (Adeia Inc.)
• Inventors: Walsh, Martin, Stein, Edward, Kelly, Michael C., Velagaleti, Prashant
• Primary Examiner(s): KIM, PAUL
• Application Number:
  US14/091,112
• Publication Number:
  US 20140153727A1
• Time in Patent Office: 1,001 Days
• Field of Search: 381/58, 381/17, 381/61
• US Class Current: 1/1
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/304 For headphones
• CPC Class Codes: H04S 7/305 Electronic adaptation of stereophonic audio signals to reverberation of the listening space H04S7/301 takes precedence
• CPC Class Codes: H04S 7/306 For headphones
• CPC Class Codes: H04S 7/307 Frequency adjustment, e.g. tone control H04S7/301 takes precedence
• CPC Class Codes: H04S 7/308 Electronic adaptation dependent on speaker or headphone connection

Abstract

A method and apparatus may be used to perform personalized audio virtualization. The apparatus may include a speaker, a headphone (over-the-ear, on-ear, or in-ear), a microphone, a computer, a mobile device, a home theater receiver, a television, a Blu-ray (BD) player, a compact disc (CD) player, a digital media player, or the like. The apparatus may be configured to receive an audio signal, scale the audio signal, and perform a convolution and reverberation on the scaled audio signal to produce a convolved audio signal. The apparatus may be configured to filter the convolved audio signal and process the filtered audio signal for output.

Claims

1. A method for use in an audio device, the method comprising:

receiving, by the audio device, digital audio content that contains at least one audio channel signal;

transmitting information identifying the audio device to a server;

receiving, from the server, metadata associated with the audio device that influences the reproduction of the digital audio content, wherein the metadata includes a room measurement profile based on acoustic measurements of a predetermined room and a listener hearing profile based on a spectral response curve of a user hearing ability;

configuring at least one digital filter based on the received metadata;

filtering the at least one audio channel with the corresponding at least one digital filter to produce a filtered audio signal; and

outputting the filtered audio signal to an accessory device coupled to the audio device to reproduce the digital audio content.

2. The method of claim 1, wherein the metadata further includes a playback device profile based on a frequency response parameter of a playback device, and an accessory device profile based on a frequency response parameter of an accessory device.

3. The method of claim 1, wherein the metadata is received multiplexed with the digital audio content.

4. The method of claim 1, wherein the metadata is received in a container file separately from the digital audio content.

5. The method of claim 1, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, an early room response parameter, and a late reverberation parameter.

6. The method of claim 5, wherein the early room response parameter and the late reverberation parameter configure the digital filter to produce a filtered audio signal having acoustic properties substantially similar to the acoustic properties of the predetermined room.

7. The method of claim 6, wherein the late reverberation parameter configures a parametric model of the late reverberation of the predetermined room.

8. An audio device comprising:

a receiver configured to

receiving digital audio content that contains at least one audio channel signal;

transmitting information identifying the audio device to a server;

receiving, from the server, metadata associated with the audio device that influences the reproduction of the digital audio content, wherein the metadata includes a room measurement profile based on acoustic measurements of a predetermined room and a listener hearing profile based on a spectral response curve of a user hearing ability;

a processor configured to configure at least one digital filter based on the received metadata, wherein the processor is configured to filter the at least one audio channel signal with the corresponding at least one digital filter to produce a filtered audio signal; and

wherein the processor is configured to output the filtered audio signal to an accessory device coupled to the audio device to reproduce the digital audio content.

9. The audio device of claim 8, wherein the metadata further includes a playback device profile based on a frequency response parameter of a playback device, and an accessory device profile based on a frequency response parameter of an accessory device.

10. The audio device of claim 8, wherein the metadata is received multiplexed with the digital audio content.

11. The audio device of claim 8, wherein the metadata is received in a container file separately from the digital audio content.

12. The audio device of claim 8, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, an early room response parameter, and a late reverberation parameter.

13. The audio device of claim 12, wherein the processor utilizes the early room response parameter and the late reverberation parameter to configure the digital filter to produce a filtered audio signal having acoustic properties substantially similar to the acoustic properties of the predetermined room.

14. The audio device of claim 13, wherein the processor utilizes the late reverberation parameter to configure a parametric model of the late reverberation of the predetermined room.

15. A method for audio virtualization comprising:

receiving, at a server, results of a user'"'"'s hearing test;

receiving information about at least one playback device associated with the user and at least one accessory device coupled to the playback device;

storing the received test results and information in a virtualization profile associated with the user, the virtualization profile comprising a plurality of parameters for a room measurement profile based on acoustic measurements of a predetermined room, a listener hearing profile based on a spectral response curve of the user'"'"'s hearing ability, a playback device profile based on a frequency response parameter of the playback device, and an accessory device profile based on a frequency response parameter of the accessory device;

receiving request for a virtualization profile from a playback device associated with a user; and

transmitting the requested virtualization profile to the playback device.

16. The method of claim 15, wherein at least one of the plurality of parameters is multiplexed with digital audio content.

17. A method for use in an audio device, the method comprising:

receiving, by the audio device, digital audio content that contains at least one audio channel signal;

transmitting information identifying the audio device to a server;

receiving, from the server, metadata associated with the audio device that influences the reproduction of the digital audio content, wherein the metadata includes a room measurement profile based on acoustic measurements of a predetermined room;

configuring at least one digital filter based on the received metadata;

filtering the at least one audio channel with the corresponding at least one digital filter to produce a filtered audio signal; and

outputting the filtered audio signal to an accessory device coupled to the audio device to reproduce the digital audio content.

18. The method of claim 17, wherein the metadata further includes a playback device profile based on a frequency response parameter of a playback device, and an accessory device profile based on a frequency response parameter of an accessory device.

19. The method of claim 17, wherein the metadata is received multiplexed with the digital audio content.

20. The method of claim 17, wherein the metadata is received in a container file separately from the digital audio content.

21. The method of claim 17, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, an early room response parameter, and a late reverberation parameter.

22. The method of claim 21, wherein the early room response parameter and the late reverberation parameter configure the digital filter to produce a filtered audio signal having acoustic properties substantially similar to the acoustic properties of the predetermined room.

23. The method of claim 22, wherein the late reverberation parameter configures a parametric model of the late reverberation of the predetermined room.

24. An audio device comprising:

a receiver configured to

receive digital audio content that contains at least one audio channel signal; and

transmitting information identifying the audio device to a server;

receiving, from the server, metadata associated with the audio device that influences the reproduction of the digital audio content, wherein the metadata includes a room measurement profile based on acoustic measurements of a predetermined room;

a processor configured to configure at least one digital filter based on the received metadata, wherein the processor is configured to filter the at least one audio channel signal with the corresponding at least one digital filter to produce a filtered audio signal; and

wherein the processor is configured to output the filtered audio signal to an accessory device coupled to the audio device to reproduce the digital audio content.

25. The audio device of claim 24, wherein the metadata further includes a playback device profile based on a frequency response parameter of a playback device, and an accessory device profile based on a frequency response parameter of an accessory device.

26. The audio device of claim 24, wherein the metadata is received multiplexed with the digital audio content.

27. The audio device of claim 24, wherein the metadata is received in a container file separately from the digital audio content.

28. The audio device of claim 24, wherein the room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients, an early room response parameter, and a late reverberation parameter.

29. The audio device of claim 28, wherein the processor utilizes the early room response parameter and the late reverberation parameter to configure the digital filter to produce a filtered audio signal having acoustic properties substantially similar to the acoustic properties of the predetermined room.

30. The audio device of claim 29, wherein the processor utilizes the late reverberation parameter to configure a parametric model of the late reverberation of the predetermined room.