Techniques for presenting sound effects on a portable media player

• US 9,602,929 B2
• Filed: 10/25/2012
• Issued: 03/21/2017
• Est. Priority Date: 06/03/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Lindahl, Aram, Williams, Joseph Mark, Girish, Muthya K.
• Primary Examiner(s): Goins, Davetta W
• Assistant Examiner(s): SELLERS, DANIEL R
• Application Number:
  US13/660,839
• Publication Number:
  US 20130044883A1
• Time in Patent Office: 1,608 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G11B 2020/10555 wherein the frequency, the amplitude, or other characteristics of the audio signal is taken into account
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S

Abstract

Improved techniques for presenting sound effects at a portable media device are disclosed. The sound effects can be output as audio sounds to an internal speaker, an external speaker, or both. In addition, the audio sounds for the sound effects can be output together with other audio sounds pertaining to media assets (e.g., audio tracks being played). In one embodiment, the sound effects can serve to provide auditory feedback to a user of the portable media device. A user interface can facilitate a user'"'"'s selection of sound effect usages, types or characteristics.

Claims

1. In a computing device, a method for adding an original sound effect file to a first media item during audio playback of the first media item, the method comprising:

receiving an indication of a sound effect event;

identifying an original sound effect file that is associated with the sound effect event;

determining whether a first media item is being played through a first audio output device when the indication of the sound effect event is received and, if so, retrieving a plurality of formatting characteristics of the first media item which is being hosted on a first channel;

modifying one or more formatting characteristics on a second channel to match all of the retrieved plurality of formatting characteristics of the first media item which is being hosted on the first channel, so as to modify the original sound effect file on the second channel to create a modified sound effect file;

adding the modified sound effect file and the first media item to create a modified first media item; and

continuing audio playback of the media item by outputting the modified first media item through the first audio output device.

2. The method of claim 1, wherein the first audio output device is a single speaker on the computing device.

3. The method of claim 1, wherein the creating a modified sound effect file includes:

formatting a copy of the original sound effect file so as to have a substantially similar format as the first media item.

4. The method of claim 3, wherein the formatting includes altering a bit depth of the copy of the original sound effect file to match a bit depth of the first media item.

5. The method of claim 3, wherein the formatting includes altering a sample rate of the copy of the original sound effect file to match a sample rate of the first media item.

6. The method of claim 3, wherein when the first media item is in stereo, the formatting includes changing the copy of the original sound effect file from mono to stereo.

7. The method of claim 3, wherein when the first media item is in mono, the formatting includes changing the copy of the original sound effect file from stereo to mono.

8. A portable media device comprising:

a memory for digitally storing a plurality of media items and a plurality of original sound effect files;

an audio decoder arranged to decode a first media item;

a processor configured to;

receive an indication of a sound effect event and identify an original sound effect file that is associated with the sound effect event;

determine whether the first media item is being played through a first audio output device when the indication of the sound effect event is received and, if so, retrieve a plurality of formatting characteristics of the first media item which is being hosted on a first channel;

modify one or more formatting characteristics on a second channel to match all of the retrieved plurality of formatting characteristics of the first media item which is being hosted on the first channel, so as to modify the original sound effect file on the second channel to create a modified sound effect file;

add the modified sound effect file and the first media item to create a modified first media item; and

continue audio playback by outputting the modified first media item; and

a digital-to-analog converter configured to convert the modified first media item into an analog audio data format and send the converted modified first media item to a first audio output device during audio playback of the first media item.

9. A portable media device as recited in claim 8 further comprising:

a memory buffer configured to temporarily store the modified first media item prior to it being played; and

wherein the processor includes a bit depth converter, a channel count adapter, and a sample rate converter; and

wherein the portable media device is selected from the group consisting of a mobile phone, a hand-held media player that can easily be held by and within a single hand of a user; and

a hand-held audio player that can easily be held by and within a single hand of a user.

10. A method for adding an original sound effect file to a first media item on a portable computing device the method comprising:

determining a bit rate, sample rate, and stereo characteristics of the first media item;

receiving the original sound effect file and the bit rate, sample rate and stereo characteristics of the original sound effect file;

creating a modified sound effect file by modifying one or more of the bit rate, sample rate, and stereo characteristics of the original sound effect file to match the bit rate, sample rate, and stereo characteristics, respectively, of the first media item;

adding the first media item and the modified sound effect file to create a modified first media item;

retrieving a configuration profile indicating a first audio output device to play the first media item and a second audio output device to play the original sound effect file;

playing the modified first media item through the first audio device;

playing the original sound effect file through a second audio output device at essentially the same time as the playing of the modified first media item through the first audio output device.

11. The method of claim 10, wherein the configuration profile includes configuration settings that are based partially on whether headphones are currently connected to a headphone jack of the portable computing device.

12. The method of claim 10, further comprising:

storing the modified first media item in a buffer prior to playing it.

13. A portable media device comprising:

a memory storing a plurality of media items and a plurality of original sound effect files;

a processor adapted to receive an indication of a sound effect event, where the processor is configured to;

identify an original sound effect file that is associated with the sound effect event;

determine whether a first media item is being played through a first audio output device when the indication of the sound effect event is received and, if so, retrieve a plurality of formatting characteristics of the first media item which is being hosted on a first channel;

modify one or more formatting characteristics on a second channel to match all of the retrieved plurality of formatting characteristics of the first media item which is being hosted on the first channel, so as to modify the original sound effect file on the second channel to create a modified sound effect file;

add the modified sound effect file and the first media item to create a modified first media item; and

continue audio playback of the first media item by outputting the modified first media item; and

a digital-to-analog converter configured to convert the modified first media item into an analog audio data format and send the converted modified first media item to a first audio output device during said audio playback.

14. The portable media device of claim 13, further comprising a memory buffer configured to temporarily store the modified first media item prior to it being delivered to the digital-to-analog converter and played.

15. The portable media device of claim 13, wherein the portable media device is a mobile phone.

16. The portable media device of claim 13, wherein the processor that modifies one or more of the formatting characteristics of the original sound effect file comprises:

a bit depth converter;

a channel count adapter; and

a sample rate converter.

17. An apparatus for seamlessly integrating an original sound effect file with a first media item, the apparatus comprising:

means for determining a bit rate, sample rate, and stereo characteristics of the first media item;

means for receiving an indication of the bit rate, sample rate and stereo characteristics at a conversion unit;

means for receiving the original sound effect file at the conversion unit;

means for creating a modified sound effect file by modifying bit rate, sample rate, and stereo characteristics of the original sound effect file to match the bit rate, sample rate, and stereo characteristics, respectively, of the first media item;

means for adding the first media item and the modified sound effect file to create a modified first media item by an adder unit;

means for retrieving a configuration profile indicating a first audio output device to play the first media item and a second audio output device to play the original sound effect file;

means for playing the modified first media item through the first audio device; and

means for playing the original sound effect file through a second audio output device at essentially the same time as the playing of the modified first media item through the first audio output device.

18. The apparatus of claim 17, wherein the means for adding includes means for digitally adding the first media item and the modified sound effect file.

19. The apparatus of claim 17, further comprising means for converting the modified first media item to analog format for playing on the first audio output device.

20. The apparatus of claim 17, wherein the second audio output device is a piezoelectric speaker.

21. A non-transitory program storage device readable by a machine tangibly embodying a program of instructions executable by the machine to perform a method for adding an original sound effect file with a first media item during audio playback of the first media item, the method comprising:

receiving an indication of a sound effect event;

identifying an original sound effect file that is associated with the sound effect event;

determining whether a first media item is being played through a first audio output device when the indication of the sound effect event is received and, if so, retrieving a plurality of formatting characteristics of the first media item which is being hosted on a first channel;

modifying one or more formatting characteristics on a second channel to match all of the retrieved plurality of formatting characteristics of the first media item which is being hosted on the first channel, so as to modify the original sound effect file on the second channel to create a modified sound effect file;

adding the first media item and the modified sound effect file to create a modified first media item; and

during playback of the first media item, playing the modified first media item through a first audio output device.

22. The program storage device of claim 21, wherein the first audio output device is a headphone jack of a portable media device.

23. The program storage device of claim 21, wherein the method further comprises:

playing the original sound effect file through a second audio output device at essentially the same time as the playing of the modified first media item through the first audio output device.

24. The program storage device of claim 21, wherein the first audio output device is a single speaker on a portable media device.