METHOD OF MODIFYING AUDIO CONTENT

• US 20100241256A1
• Filed: 12/07/2009
• Published: 09/23/2010
• Est. Priority Date: 05/20/2006
• Status: Abandoned Application

• Current Assignee: Staton Techiya, LLC
• Original Assignee: Personics Holdings, Inc.
• Inventors: Usher, John, Keady, John P., Goldstein, Steven
• Application Number:
  US12/632,292
• Publication Number:
  US 20100241256A1
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Abstract

At least one exemplary embodiment is directed to a method of generating a Personalized Audio Content (PAC) comprising: selecting Audio Content (AC) to personalize; selecting an Earprint; and generating a PAC using the Earprint to modify the AC.

Claims

1. A method of generating a Personalized Audio Content (PAC) comprising,

selecting Audio Content (AC) to personalize;

selecting an Earprint;

generating a PAC using the Earprint to modify the AC; and

checking the AC to see if at least one portion of the AC is suitable for personalization before the step of generating a PAC, and if the at least one portion of AC is not suitable for personalization then the step of generating a PAC is not enacted and a message stating that the at least one portion of the AC is not suitable for personalization is generated instead, wherein the step of checking suitability includes at least one of;

checking to see if the minimum amplitude of the AC is above an amplitude threshold value;

checking to see if the data bit-rate of the AC is above a bit-rate threshold value;

checking to see if the dynamic range of the AC is above a dynamic-range threshold value;

checking to see if the frequency bandwidth of the AC is above a frequency bandwidth threshold value;

checking to see if the total time-duration of the AC is above a time-duration threshold value;

checking to see if the spectral centroid of the AC is within a predetermined absolute difference from a spectral centroid threshold value; and

checking to see if the interchannel cross-correlation between predetermined AC channels is within a predetermined absolute difference from a cross-correlation threshold value, wherein the Earprint includes at least one of;

a Head Related Transfer Function (HRTF);

an Inverse-Ear Canal Transfer Function (ECTF);

an Inverse Hearing Sensitivity Transfer Function (HSTF);

an Instrument Related Transfer Function (IRTF);

a Developer Selected Transfer Function (DSTF); and

Timbre preference information.

2. The method according to claim 1, wherein the Earprint includes a DSTF, wherein the DSTF includes at least one of:

a Desired Listening Environment Transfer Function (DLETF); and

the locations of audio sources.

3. The method according to claim 1, wherein the Earprint further includes Personal Preferences (PP).

4. The method according to claim 1, wherein the HRTF is at least one of:

an Empirical HRTF;

an Analytic HRTF; and

a Hybrid HRTF

5. The method according to claim 4, wherein the generic HRTF is generated by creating a HRTF that is based upon a selected ear design.

6. The method according to claim 4, wherein the semi-personalized HRTF is selected from a set of standard HRTF based upon user entered criteria.

7. The method according to claim 6, wherein the criteria is at least one of age, height, weight, gender, ear measurements.

8. The method according to claim 7, wherein the ear measurements includes at least one of the cavum concha height, cymba concha height, cavum concha width, fossa height, pinna height, pinna width, intertragal incisure width, and cavum concha depth.

9. The method according to claim 4, wherein the personalized HRTF is created by acoustic diagnostics of the users'"'"' ear.

10. The method according to claim 9, wherein the personalized HRTF includes a right ear personalized HRTF and a left ear personalized HRTF.

18. The method according to claim 1, wherein if the Earprint includes an Inverse-HSTF the method further comprises:

normalizing the AC using the Inverse-HSTF so that each acoustic element in the AC has the same loudness.

11. A method of generating a Personalized Audio Content (PAC) comprising:

selecting Audio Content (AC) to personalize;

selecting an Earprint;

generating a PAC using the Earprint to modify the AC; and

checking the AC to see if at least one portion of the AC is suitable for personalization before the step of generating a PAC, and if the at least one portion of AC is not suitable for personalization then the step of generating a PAC is not enacted and a message stating that the at least one portion of the AC is not suitable for personalization is generated instead, wherein the step of checking suitability includes at least one of;

checking to see if the minimum amplitude of the AC is above an amplitude threshold value;

checking to see if the data bit-rate of the AC is above a bit-rate threshold value;

checking to see if the dynamic range of the AC is above a dynamic-range threshold value;

checking to see if the frequency bandwidth of the AC is above a frequency bandwidth threshold value;

checking to see if the total time-duration of the AC is above a time-duration threshold value;

checking to see if the spectral centroid of the AC is within a predetermined absolute difference from a spectral centroid threshold value; and

checking to see if the interchannel cross-correlation between predetermined AC channels is within a predetermined absolute difference from a cross-correlation threshold value.

12. The method according to claim 11, wherein the step of selecting Audio Content includes at least one of the following:

a user selecting the AC using a web based program (WBP), wherein the AC is stored on a database accessible by the WBP;

a user selecting the AC using a local computer program, wherein the AC is stored on a database accessible by the local computer program;

a user voices a selection that is converted by a computer program into a selection of the AC stored in electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one AC, wherein a computer program automatically selects the AC in order of listing on the electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one AC, wherein a computer program selects the AC from the electronic readable memory based on user selected criteria;

a user inserts a electronic readable memory into a device that includes at least one AC, wherein the user selects an AC from the electronic readable memory using a user interface operatively connected to the device;

an AC is automatically selected from a electronic readable memory based on user selected criteria;

an AC is automatically selected from a electronic readable memory based on automatically selected criteria;

an AC is automatically selected as a result of a computer search program; and

an AC is selected from electronic readable memory by a user using a user interface operatively connected to a device.

13. The method according to claim 11, wherein the step of selecting an Earprint includes at least one of the following:

a user selecting the Earprint using a web based program (WBP), wherein the Earprint is stored on a database accessible by the WBP;

a user selecting the Earprint using a local computer program, wherein the Earprint is stored on a database accessible by the local computer program;

a user voices a selection that is converted by a computer program into a selection of the Earprint stored in electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one Earprint, wherein a computer program automatically selects the Earprint in order of listing on the electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one Earprint, wherein a computer program selects the Earprint from the electronic readable memory based on user selected criteria;

a user inserts a electronic readable memory into a device that includes at least one Earprint, wherein the user selects an Earprint from the electronic readable memory using a user interface operatively connected to the device;

an Earprint is automatically selected from a electronic readable memory based on user selected criteria;

an Earprint is automatically selected from a electronic readable memory based on automatically selected criteria;

an Earprint is automatically selected as a result of a computer search program; and

an Earprint is selected from electronic readable memory by a user using a user interface operatively connected to a device.

14. The method according to claim 11, wherein the step of generating a PAC using the Earprint to modify the AC includes at least one of:

converting the Earprint into frequency space, converting the AC into frequency space, multiplying the converted Earprint by the converted AC to created a PAC in frequency space, and converting the PAC in frequency space into a time domain PAC; and

convolving the Earprint with the AC using a digital time-domain convolution.

15. The method according to claim 11, wherein the selected AC has at least a right channel and a left channel.

16. The method according to claim 11, further comprising:

checking the AC to see which portion is the most suitable for personalization before the step of generating a PAC, and generating a PAC only for the portion.

17. The method according to claim 11, further comprising:

breaking the AC into a plurality of portions.

19. The method according to claim 11, further comprising:

generating a preview audio clip from the PAC.

20. The method according to claim 11 wherein the selected AC is a Sub Audio Content (SAC), wherein the SAC is generated by applying an instrument extraction filter to a First Audio Content (FAC) to generate a first sub audio content associated with a first instrument.

21. The method according to claim 11, wherein the selected AC is a Sub Audio Content (SAC), wherein the SAC is generated by applying a frequency bandwidth extraction filter to a First Audio Content (FAC) to generate a first sub audio content associated with a first instrument.

22. The method of claim 11 further comprising:

generating at least one acoustically Watermarked Audio Content (WAC) comprising;

selecting at least one of a Audio Content (AC), a Personalized Audio Content (PAC) and a Virtualized Audio Content (VAC) to acoustically Watermark;

selecting an Acoustic Watermark (AW); and

generating a WAC by embedding the AW into the at least one of a Audio Content (AC), a Personalized Audio Content (PAC), and a Virtualized Audio Content (VAC).

23. The method according to claim 22, wherein the AW is an ID that identifies a user.

24. The method according to claim 22, wherein the Watermark is a Digital Rights Management (DRM) marker.

25. The method according to claim 22 wherein the audio content is a surround sound audio content.

26. A method of generating a Virtual Audio Content (VAC) comprising:

selecting Audio Content (AC) to virtualize, wherein the AC includes a first impulse response (1IR);

selecting an Environprint, wherein the Environprint includes a second impulse response (21R);

generating a VAC, wherein the 1IR is modified so that the 1IR is replaced with the 21R; and

checking the AC to see if at least one portion of the AC is suitable for virtualization before the step of generating a VAC, and if the at least one portion AC is not suitable virtualization then the step of generating a VAC is not enacted and a message stating that the at least one portion of the AC is not suitable for virtualization is generated instead, wherein the step of checking suitability includes at least one of;

checking to see if the minimum amplitude of the AC is above an amplitude threshold value;

checking to see if the data bit-rate of the AC is above a bit-rate threshold value;

checking to see if the dynamic range of the AC is above a dynamic-range threshold value;

checking to see if the frequency bandwidth of the AC is above a frequency bandwidth threshold value;

checking to see if the total time-duration of the AC is above a time-duration threshold value;

checking to see if the spectral centroid of the AC is within a predetermined absolute difference from a spectral centroid threshold value; and

checking to see if the interchannel cross-correlation between predetermined AC channels is within a predetermined absolute difference from a cross-correlation threshold value.

27. The method according to claim 26, wherein a third impulse response (31R) is applied to the AC to generate the VAC wherein the VAC includes only the 2IR.

28. The method according to claim 26, wherein the 2IR replaces the 1IR using deconvolution.

29. The method according to claim 28, wherein AC is deconvolved with the 1IR forming a Modified Audio Content (MAC), and where the MAC is convolved with the 2IR forming the VAC.

30. The method according to claim 26, wherein the 2IR replaces the 1IR using convolution.

31. The method according to claim 30, wherein AC is convolved with an inverse of the 1IR forming a Modified Audio Content (MAC), and where the MAC is convolved with the 2IR forming the VAC.

32. The method according to claim 26, wherein the 1IR and the 2IR each includes at least one of:

a Room Impulse Response (RIR);

a source distance simulator; and

an Instrument Related Transfer Function (IRTF).

33. The method according to claim 32, wherein the step of generating a VAC results in a VAC wherein a user, being in a first location, hears the VAC as if its in a second location.

34. The method according to claim 33, wherein the first location and the second location are perceived as being in the same environment.

35. The method according to claim 33, wherein the first location is in a first environment and the second location is in a second environment, wherein the first environment is different from the second environment.

36. The method according to claim 35, wherein the first location is positioned in the first environment the same as the second location is positioned in the second environment.

37. The method according to claim 26, wherein the step of selecting Audio Content (AC) includes at least one of the following:

a user selecting the AC using a web based program (WBP), wherein the AC is stored on a database accessible by the WBP;

a user selecting the AC using a local computer program, wherein the AC is stored on a database accessible by the local computer program;

a user voices a selection that is converted by a computer program into a selection of the AC stored in electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one AC, wherein a computer program automatically selects the AC in order of listing on the electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one AC, wherein a computer program selects the AC from the electronic readable memory based on user selected criteria;

a user inserts a electronic readable memory into a device that includes at least one AC, wherein the user selects an AC from the electronic readable memory using a user interface operatively connected to the device;

an AC is automatically selected from a electronic readable memory based on user selected criteria;

an AC is automatically selected from a electronic readable memory based on automatically selected criteria;

an AC is automatically selected as a result of a computer search program; and

an AC is selected from electronic readable memory by a user using a user interface operatively connected to a device.

38. The method according to claim 26, wherein the step of selecting an Environprint includes at least one of the following:

a user selecting the Environprint using a web based program (WBP), wherein the Environprint is stored on a database accessible by the WBP;

a user selecting the Environprint using a local computer program, wherein the Environprint is stored on a database accessible by the local computer program;

a user voices a selection that is converted by a computer program into a selection of the Environprint stored in electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one Environprint, wherein a computer program automatically selects the Environprint in order of listing on the electronic readable memory;

a user inserts a electronic readable memory into a device that includes at least one Environprint, wherein a computer program selects the Environprint from the electronic readable memory based on user selected criteria;

a user inserts a electronic readable memory into a device that includes at least one Environprint, wherein the user selects an Environprint from the electronic readable memory using a user interface operatively connected to the device;

an Environprint is automatically selected from a electronic readable memory based on user selected criteria;

an Environprint is automatically selected from a electronic readable memory based on automatically selected criteria;

an Environprint is automatically selected as a result of a computer search program; and

an Environprint is selected from electronic readable memory by a user using a user interface operatively connected to a device.

39. The method according to claim 26, wherein the selected AC has a right channel and a left channel.

40. The method according to claim 26, further comprising:

checking the AC to see which portion is the most suitable for personalization before the step of generating a VAC, and generating a VAC only for the portion.

41. The method according to claim 26, wherein if the Environprint includes an Inverse-HSTF the method further comprises:

normalizing the AC using the Inverse-HSTF so that each acoustic element in the AC has the same loudness.

42. The method according to claim 26, further comprising:

generating a preview audio clip from the VAC.

43. The method according to claim 26, wherein the selected AC is a Sub Audio Content (SAC), wherein the SAC is generated by applying an instrument extraction filter to a First Audio Content (FAC) to generate a first sub audio content associated with a first instrument.

44. The method according to claim 26, wherein the selected AC is a Sub Audio Content (SAC), wherein the SAC is generated by applying a frequency bandwidth extraction filter to a First Audio Content (FAC) to generate a first sub audio content associated with a first instrument.

45. An audio device comprising:

an audio input;

an audio output; and

a readable electronic memory, wherein the audio input, audio output and readable electronic memory are operatively connected, wherein the readable electronic memory includes a device ID, wherein the device ID includes the audio characteristics of the device that can be used in an Earprint or an Environprint.

46. The audio device according to claim 45, wherein the audio characteristics of the device includes at least one of:

the devices'"'"' inverse filter response;

the devices'"'"' maximum power handling level; and

the devices'"'"' model number.