Techniques for presenting sound effects on a portable media player

• US 8,300,841 B2
• Filed: 06/03/2005
• Issued: 10/30/2012
• Est. Priority Date: 06/03/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Lindahl, Aram, Williams, Joseph Mark, Girish, Muthya K.
• Primary Examiner(s): FAULK, DEVONA E
• Application Number:
  US11/144,541
• Publication Number:
  US 20060274905A1
• Time in Patent Office: 2,706 Days
• Field of Search: 381/119, 381 61- 63, 846/25, 846/97, 700/94
• US Class Current: 381/61
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G11B 2020/10555 wherein the frequency, the amplitude, or other characteristics of the audio signal is taken into account
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S

Abstract

Improved techniques for presenting sound effects at a portable media device are disclosed. The sound effects can be output as audio sounds to an internal speaker, an external speaker, or both. In addition, the audio sounds for the sound effects can be output together with other audio sounds pertaining to media assets (e.g., audio tracks being played). In one embodiment, the sound effects can serve to provide auditory feedback to a user of the portable media device. A user interface can facilitate a user'"'"'s selection of sound effect usages, types or characteristics.

Claims

1. In a computing device having limited processing resources, a method for adding an original sound effect file to a first media item, the method comprising:

determining one or more formatting characteristics of the first media item;

receiving an indication of the one or more formatting characteristics of the first media item at a conversion unit;

receiving the original sound effect file at the conversion unit;

creating a modified sound effect file by updating the selected formatting characteristics of the original sound effect file to match the one or more formatting characteristics of the first media item, wherein the modified sound effect file is created by the conversion unit;

wherein the updating selected formatting characteristics includes formatting a copy of the original sound effect file so as to have a substantially similar format as the first media item including (i) altering a bit depth of the original sound effect file to match a bit depth of the first media item, (ii) altering a sample rate of the original sound effects file to match a sample rate of the first media item, and (iii) when necessary, altering a channel count of the original sound effect file to match a channel count of the first media item such that the bit depth, the sample rate and the channel count of the modified sound effect file match the bit depth, the sample rate and the channel count of the first media item;

adding the first media item and the modified sound effect file to create a modified first media item by an adder unit; and

outputting the modified first media item or the sound effect file through a first and a second audio output device at essentially the same time, wherein one of the first and second audio output devices is a headphone lack of the portable computing device and the other of the first and second audio output devices is a speaker of the portable computing device.

3. The method of claim 1, wherein the first audio output device is a single speaker on the computing device.

4. The method of claim 1, wherein the creating a modified sound effect file includes:

formatting a copy of the original sound effect file so as to have a substantially similar format as the first media item.

5. The method of claim 4, wherein the formatting includes altering a bit depth of the audio file to match a bit depth of the first media item.

6. The method of claim 4, wherein the formatting includes altering a sample rate of the audio file to match a sample rate of the first media item.

7. The method of claim 4, wherein when the first media item is in stereo, the formatting includes changing the audio file from mono to stereo.

8. The method of claim 4, wherein when the first media item is in mono, the formatting includes changing the audio file from stereo to mono.

2. In a computing device having limited processing resources, a method for adding an original sound effect file to a first media item, the method comprising:

determining one or more characteristics of the first media item;

receiving an indication of the one or more characteristics of the first media item at a conversion unit;

receiving the original sound effect file at the conversion unit;

creating a modified sound effect file by updating the selected characteristics of the original sound effect file to match the one or more characteristics of the first media item, wherein the modified sound effect file is created by the conversion unit;

adding the first media item and the modified sound effect file to create a modified first media item by an adder unit; and

outputting the modified first media item or the sound effect file through a first audio output device and a second audio output device at essentially the same time, wherein the first audio output device is a headphone jack of the portable computing device and the second audio output device is a speaker of the portable computing device.

9. A method for adding an original sound effect file to a first media item on a portable computing device having limited processing resources, the method comprising:

determining a bit rate, sample rate, and stereo characteristics of the first media item;

receiving an indication of the bit rate, sample rate and stereo characteristics of the first media item at a conversion unit;

receiving the original sound effect file at the conversion unit;

creating a modified sound effect file by modifying a bit rate, sample rate, and stereo characteristics of the original sound effect file to match the bit rate, sample rate, and stereo characteristics, respectively, of the first media item;

adding the first media item and the modified sound effect file to create a modified first media item by an adder unit;

retrieving a configuration profile indicating a first audio output device to play the first media item and a second audio output device to play the original sound effect file;

playing the modified first media item or the sound effect file through a first audio output device and a second audio output device at essentially the same time, wherein the first audio output device is a headphone jack of the portable computing device and the second audio output device is a speaker of the portable computing device.

10. The method of claim 9, wherein the configuration profile includes configuration settings that are based partially on whether headphones are currently connected to the headphone jack of the portable computing device.

11. The method of claim 9, further comprising:

storing the modified first media item in a buffer prior to playing it.

12. A portable media device having limited processing resources, comprising:

a memory storing a plurality of media items and a plurality of original sound effect files;

a processor configured to determine one or more formatting characteristics of a first media item;

a conversion unit configured to receive an indication of the one or more formatting characteristics, receive the original sound effect file, and create a modified sound effect file by updating selected formatting characteristics of the original sound effect file to match the one or more formatting characteristics of the first media item;

wherein the conversion unit includes a bit depth converter, a channel count adapter and a sample rate converter, the bit depth converter being arranged to adjust the bit depth of the original sound effect file to match the bit depth of the first media item in the modified sound effect file, and the sample rate converter being arranged to adjust the sample rate of the original sound effect file to match the sample rate of the first media item in the modified sound effect file

an adder unit configured to add the first media item and the modified sound effect file to create a modified first media item; and

a digital-to-analog converter configured to convert the modified first media item into an analog audio data format and send the converted modified first media item to a first audio output device; and

wherein the portable media device is configured to play the modified first media item or the sound effect file through a first audio output device and a second audio output device at essentially the same time, wherein one of the first and second audio output devices is a headphone lack of the portable computing device and the other of the first and second audio output devices is a speaker of the portable computing device.

13. The portable media device of claim 12, further comprising a memory buffer configured to temporarily store the modified first media item prior to it being delivered to the digital-to-analog converter and played.

14. The portable media device of claim 12, wherein the portable media device is a mobile phone.

15. The portable media device of claim 12, wherein the conversion unit further comprises:

a bit depth converter;

a channel count adapter; and

a sample rate converter.

16. An apparatus for seamlessly integrating an original sound effect file with a first media item, the apparatus comprising:

means for determining a bit rate, sample rate, and stereo characteristics of the first media item;

means for receiving an indication of the bit rate, sample rate and stereo characteristics at a conversion unit;

means for receiving the original sound effect file at the conversion unit;

means for creating a modified sound effect file by modifying a bit rate, sample rate, and stereo characteristics of the original sound effect file to match the bit rate, sample rate, and stereo characteristics, respectively, of the first media item;

means for adding the first media item and the modified sound effect file to create a modified first media item by an adder unit;

means for retrieving a configuration profile indicating a first audio output device to play the first media item or the sound effect file and a second audio output device to play the original sound effect file;

means for playing the modified first media item or the original sound effect file through the first audio device and a second audio output device at essentially the same time wherein one of the first and second audio output devices is a headphone lack of a portable media device and the other of the first and second audio output devices is a speaker of the portable media device.

17. The apparatus of claim 16, wherein the means for adding includes means for digitally adding the first media item and the modified sound effect file.

18. The apparatus of claim 16, further comprising means for converting the modified first media item to analog format for playing on the first audio output device.

19. The apparatus of claim 16, wherein the second audio output device is a piezoelectric speaker.

20. A non-transitory program storage device readable by a machine tangibly embodying a program of instructions executable by the machine to add an original sound effect file to a first media item, the program storage device being arranged to:

determine one or more formatting characteristics of the first media item;

receive an indication of the one or more formatting characteristics at a conversion unit;

receive the original sound effect file at the conversion unit;

create creating a modified sound effect file by updating formatting characteristics of the original sound effect file to match the formatting characteristics of the first media item by the conversion unit;

wherein the updating selected formatting characteristics includes formatting a copy of the original sound effect file so as to have a substantially similar format as the first media item including (i) altering a bit depth of the original sound effect file to match a bit depth of the first media item, (ii) altering a sample rate of the original sound effects file to match a sample rate of the first media item, and (iii) when necessary, altering a channel count of the original sound effect file to match a channel count of the first media item such that the bit depth, the sample rate and the channel count of the modified sound effect file match the bit depth, the sample rate and the channel count of the first media item;

add the first media item and the modified sound effect file to create a modified first media item by an adder unit; and

play the modified first media item or the original sound effect file through a first audio output device and a second audio output device at essentially the same time, wherein one of the first and second audio output devices is a headphone jack of a portable media device and the other of the first and second audio output devices is a speaker of the portable media device.

21. The program storage device of claim 20, wherein the first audio output device is a headphone jack of a portable media device and the second audio output device is a single speaker of the portable media device.

22. The program storage device of claim 20, wherein the method further comprises:

playing the original sound effect file through a second audio output device at essentially the same time as the playing of the modified first media item through the first audio output device.

23. The program storage device of claim 20, wherein the first audio output device is a single speaker on the portable media device.

24. A portable media device having limited processing resources, comprising:

a memory for digitally storing a plurality of media items and a plurality of original sound effect files;

an audio decoder arranged to decode a first media item having a first set of media format characteristics;

a conversion unit arranged to receive an original sound effect file having at least one selected media format characteristic that is different from one or more associated media format characteristics of the first media item, and to create a modified sound effect file by updating the selected media format characteristic(s) of the original sound effect file to match the associated characteristic(s) of the first media item;

wherein the conversion unit includes a bit depth converter, a channel count adapter and a sample rate converter, the bit depth converter being arranged to adjust the bit depth of the original sound effect file to match the bit depth of the first media item in the modified sound effect file, and the sample rate converter being arranged to adjust the sample rate of the original sound effect file to match the sample rate of the first media item in the modified sound effect file;

an adder unit configured to add the first media item and the modified sound effect file to create a modified first media item; and

a digital-to-analog converter configured to convert the modified first media item into an analog audio data format and send the converted modified first media item to a first audio output device; and

wherein the portable media device is configured to play the modified first media item or the sound effect file through a first audio output device and a second audio output device at essentially the same time, wherein one of the first and second audio output devices is a headphone lack of the portable media device and the other of the first and second audio output devices is a speaker of the portable media device.

25. A portable media device as recited in claim 24 further comprising:

a memory buffer configured to temporarily store the modified first media item prior to it being played; and

wherein the conversion unit includes a bit depth converter, a channel count adapter, and a sample rate converter; and

wherein the portable media device is selected from the group consisting of a mobile phone, a hand-held media player that can easily be held by and within a single hand of a user; and

a hand-held audio player that can easily be held by and within a single hand of a user.