INTELLIGENT CLIP MIXING

• US 20100232626A1
• Filed: 03/10/2009
• Published: 09/16/2010
• Est. Priority Date: 03/10/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Rottler, Benjamin Andrew, Lindahl, Aram, Paquier, Baptiste Pierre
• Granted Patent: US 8,165,321 B2
• Time in Patent Office: Days
• US Class Current: 381/119
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

Various techniques for controlling the playback of secondary audio data on an electronic device are provided. In one embodiment, a secondary audio clip mixing profile is selected based upon the type of audio output device, such as a speaker or a headset, coupled to the electronic device. The selected mixing profile may define respective digital gain values to be applied to a secondary audio stream at each digital audio level of the electronic device, and may be customized based upon one or more characteristics of the audio output device to substantially optimize audibility and user-perceived comfort. In this manner, the overall user listening experience may be improved.

Claims

1. A method, comprising:

detecting the presence of an audio output device on an electronic device;

determining whether a secondary audio clip mixing profile corresponding to the audio output device is available;

selecting the clip mixing profile corresponding to the audio output device if the clip mixing profile is available;

applying the selected clip mixing profile to an audio processing circuit; and

adjusting an output level of a secondary audio stream processed by the audio processing circuit based upon the secondary audio clip mixing profile.

2. The method of claim 1, comprising:

determining whether an equalization profile corresponding to the output device is available;

selecting the equalization profile corresponding to the audio output device if the equalization profile is available;

applying the selected equalization profile to the audio processing circuit; and

adjusting the secondary audio stream based upon the selected equalization profile.

3. The method of claim 2, wherein the selected equalization profile comprises an equalization transfer function, and wherein adjusting the secondary audio stream based upon the selected equalization profile comprises applying a gain to one or more frequencies of the secondary audio stream in accordance with the equalization transfer function.

4. The method of claim 1, wherein adjusting the output level of the secondary audio stream comprises:

determining a current digital audio level;

determining an adjustment value from the selected clip mixing profile that corresponds to the current digital audio level; and

adjusting the output level based upon the determined adjustment value.

5. The method of claim 1, wherein determining whether a secondary audio clip mixing profile corresponding to the audio output device is available comprises:

receiving identification information from the audio output device using a receiver;

determining whether the clip mixing profile corresponding to the received identification information is stored on the electronic device; and

retrieving the stored clip mixing profile if it is determined that the clip mixing profile corresponding the received identification information is stored on the electronic device.

6. The method of claim 1, comprising:

selecting a default clip mixing profile if the clip mixing profile corresponding to the audio output device is not available; and

applying the selected default clip mixing profile to the audio processing circuit.

7. The method of claim 6, wherein the default clip mixing profile is selected from a plurality of available default clip mixing profiles.

8. The method of claim 7, wherein selecting a default clip mixing profile comprises:

sending a current from a detection circuit to the audio output device;

measuring an impedance value for the audio output device;

evaluating the measured impedance value among a plurality of impedance bins, wherein each impedance bin corresponds to a respective one of the plurality of default clip mixing profiles; and

selecting one of the plurality of default clip mixing profile based upon the evaluation.

9. The method of claim 8, wherein the plurality of impedance bins comprises at least three different impedance bins, including a high-level impedance bin, a mid-level impedance bin, and a low-level impedance bin.

10. A method, comprising:

detecting a feedback event on an electronic device;

selecting at least one secondary audio item based upon the detected feedback event to output to an audio output device coupled to the electronic device;

determining a current digital level based upon a volume setting of the electronic device;

selecting a digital volume adjustment from a clip mixing profile based upon the determined digital level, wherein the clip mixing profile is selected based upon the audio output device;

adjusting the output level of a secondary audio stream corresponding to the at least one secondary audio item by applying the selected digital volume adjustment; and

playing the adjusted secondary audio stream using the audio output device.

11. The method of claim 10, wherein the at least one secondary audio item comprises voice feedback data corresponding to a respective primary audio data item, and wherein the feedback event comprises a track change, a playlist change, or an on-demand request by a user of the electronic device, or some combination thereof.

12. The method of claim 10, wherein the at least one secondary audio item comprises an earcon clip, and wherein the feedback event comprises a detection of a system event, a detection of a system status, or a detection of an interface navigation event, or some combination thereof.

13. The method of claim 10, comprising playing a primary audio stream representing a primary audio item, wherein the primary audio stream and adjusted secondary audio stream are concurrently played for the duration of the secondary audio item.

14. The method of claim 13, wherein outputting the primary audio stream comprises:

playing the primary audio stream at a first output level corresponding to the current digital level based upon default output levels defined by digital-to-analog conversion logic prior to the playback of the adjusted secondary audio stream;

playing the primary audio stream at a second output level for the duration of concurrent playback with the adjusted secondary audio stream, wherein the second output level is attenuated relative to the first output level; and

playing the primary audio stream at the first output level after the playback of the adjusted secondary audio stream has ended.

15. The method of claim 14, wherein the second output level less than or equal to 90 percent of the first output level.

16. The method of claim 14, wherein the amount by which the first output level is attenuated is based at least partially upon the genre of the primary audio stream.

17. The method of claim 16, wherein the first output level is attenuated by a first amount if the primary audio stream comprises primarily music-based data, and wherein the first output level is attenuated by a second amount if the primary audio stream comprises primarily speech-based data, wherein the second amount is greater than the first amount.

18. The method of claim 14, wherein during the period of concurrent playback, the adjusted secondary audio stream is attenuated from the adjusted output level to a third output level, wherein the third output level is greater relative to the second output level.

19. An electronic device, comprising:

an audio output device;

a storage device configured store a plurality of primary audio items, secondary audio items, and secondary audio clip mixing profiles, each of the clip mixing profiles corresponding to a specific audio output device; and

an audio processing circuit comprising;

a mixer configured to mix a primary audio stream and a secondary audio to produce a composite audio stream, wherein the primary audio stream corresponds to a primary audio item, and wherein the secondary audio stream corresponds to a secondary media item;

a detection circuit configured to detect the type of the audio output device and to select a clip mixing profile based upon the detected type of audio output device; and

audio mixing logic configured to apply the selected clip mixing profile to the mixer, wherein the output level of the secondary audio stream is adjusted based upon the selected clip mixing profile.

20. The electronic device of claim 19, wherein the detection logic comprises a receiver configured to communicate with a transmitter in the audio output device using a communication protocol.

21. The electronic device of claim 20, wherein the receiver is configured to receive identification information for the audio output device from the transmitter, wherein the transmitter is configured to automatically send the identification information to the receiver upon connection to the electronic device.

22. The electronic device of claim 19, wherein the secondary audio items comprise one or more of earcons or voice feedback data, and wherein the voice feedback data comprises one or more of artist information, track information, playlist information, or album information, or some combination thereof.

23. The electronic device of claim 22, comprising a memory device configured to store a media player application executable by a processor, wherein the media player application is configured to provide for the playback of primary or voice feedback data in response to inputs from a user of the electronic device.

24. The electronic device of claim 22, wherein the memory device is configured to store an audio user interface executable by a processor, wherein the audio user interface is configured to provide for the playback of earcons in response to a detection of a system event, a system status, or an input from a user of the electronic device, or some combination thereof.

25. The electronic device of claim 24, wherein the electronic device does not comprise a display.

26. The electronic device of claim 19, wherein the detection circuit is configured to select a equalization profile for the secondary audio stream, wherein the selection of the equalization profile is based at least partially upon one of the detected type of audio output device, the type of secondary audio data being played in the secondary audio stream, or the loudness value associated with the secondary audio data, or some combination thereof.

27. A method, comprising:

detecting the presence of an audio output device on an electronic device;

identifying each of an earcon clip mixing profile and a voice feedback clip mixing profile based upon the detected audio output device;

applying both of the earcon clip mixing profile and the voice feedback clip mixing profile to an audio processing circuit;

determining whether a secondary audio stream comprises earcon data or voice feedback data;

adjusting the output level of the secondary audio stream using the earcon clip mixing profile if the secondary audio stream comprises earcon data; and

adjusting the output level of the secondary audio stream using the voice feedback clip mixing profile if the secondary audio stream comprises voice feedback data;

28. The method of claim 27, comprising selecting an equalization transfer function to apply to the secondary audio stream based at least partially upon the detected audio output device.

29. The method of claim 28, wherein the selection of the equalization transfer function is additionally based on one or more of whether the secondary audio stream comprises earcon data or voice feedback data or a loudness value associated with a secondary audio item represented by the secondary audio stream.

30. One or more tangible, computer-readable storage media having instructions encoded thereon for execution by a processor, the instructions comprising:

code to detect a type of an audio output device coupled to an electronic device;

code to select a secondary audio clip mixing profile based upon the detected type of the audio output device; and

code to play a secondary audio stream at an adjusted output level based upon the selected clip mixing profile.

31. The one or more tangible, computer-readable storage media of claim 30, wherein the code for playing the secondary audio stream at an adjusted output level based upon the selected clip mixing profile comprises:

code to determine a current digital audio level;

code to access a look-up table storing the selected clip mixing profile;

code to select a digital volume adjustment value from the look-up table corresponding to the current digital audio level; and

code to adjust the output level of the secondary audio stream based upon the digital volume adjustment value.