Systems and methods for implementing cross-fading, interstitials and other effects downstream

• US 10,152,984 B2
• Filed: 09/25/2017
• Issued: 12/11/2018
• Est. Priority Date: 11/18/2011
• Status: Active Grant

• Current Assignee: Sirius XM Radio Inc. (Liberty Media Corporation)
• Original Assignee: Sirius XM Radio Inc. (Liberty Media Corporation)
• Inventors: Lowe, Raymond, Ward, Christopher, Christine, Charles W.
• Primary Examiner(s): Baker, Charlotte M
• Application Number:
  US15/714,095
• Publication Number:
  US 20180012611A1
• Time in Patent Office: 442 Days
• Field of Search: 704500
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G11B 27/038 Cross-faders therefor
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios

Abstract

Systems and methods are presented for cross-fading (or other multiple clip processing) of information streams on a user or client device, such as a telephone, tablet, computer or MP3 player, or any consumer device with audio playback. Multiple clip processing can be accomplished at a client end according to directions sent from a service provider that specify a combination of (i) the clips involved; (ii) the device on which the cross-fade or other processing is to occur and its parameters; and (iii) the service provider system. For example, a consumer device with only one decoder, can utilize that decoder (typically hardware) to decompress one or more elements that are involved in a cross-fade at faster than real time, thus pre-fetching the next element(s) to be played in the cross-fade at the end of the currently being played element. The next elements(s) can, for example, be stored in an input buffer, then decoded and stored in a decoded sample buffer, all prior to the required presentation time of the multiple element effect. At the requisite time, a client device component can access the respective samples of the decoded audio clips as it performs the cross-fade, mix or other effect. Such exemplary embodiments use a single decoder and thus do not require synchronized simultaneous decodes.

Claims

1. An audio playback device, comprising:

an input buffer for storing audio clips;

a decoder connected to the input buffer and configured to decode the audio clips stored in the input buffer;

a decoded audio buffer connected to the decoder and configured to store the audio clips decoded by the decoder;

a playout controller configured to;

download the audio clips to be stored by the input buffer; and

play back the decoded audio clips stored in the decoded audio buffer with at least one fade or transition effect at a boundary between successive audio clips; and

a device performance agent configured to;

determine network conditions and performance of hardware of the audio playback device; and

adjust timing of audio clip downloads by the playout controller based on the determined network conditions and the hardware performance.

2. The audio playback device as claimed in claim 1, wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a device profile.

3. The audio playback device as claimed in claim 2, wherein the device profile includes information regarding a type of the audio playback device.

4. The audio playback device as claimed in claim 2, wherein the device profile includes information regarding a number of decoders included in the audio playback device.

5. The audio playback device as claimed in claim 2, wherein the device profile includes information regarding a time required for the decoder to decode an audio frame.

6. The audio playback device as claimed in claim 1, wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a user profile.

7. The audio playback device as claimed in claim 1, wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a channel profile.

8. The audio playback device as claimed in claim 1, wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a genre profile.

9. The audio playback device as claimed in claim 1, wherein the device performance agent is further configured to adjust the timing of audio clip downloads by the playout controller based on a bandwidth restriction.

10. The audio playback device as claimed in claim 1, wherein the device performance agent is further configured to adjust the timing of audio clip downloads by the playout controller based on a latency condition.

11. A method comprising:

playing back, by a playout controller of an audio playback device, a first audio clip;

during the playing back the first audio clip;

determining, by a device management agent of the audio playback device, network conditions and a performance of hardware of the audio playback device;

determining, by the device management agent, a start time for downloading a second audio clip based on the determined network conditions and the hardware performance, such that the second audio clip can be downloaded in time for at least one fade or transition effect to be performed on the first audio clip and the second audio clip;

downloading the second audio clip at the determined start time; and

playing back, by the playout controller, an outro portion of the first audio clip and an intro portion of the second audio clip with the at least one fade or transition effect.

12. The method as claimed in claim 11, wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a device profile.

13. The method as claimed in claim 12, wherein the device profile includes information regarding a type of the audio playback device.

14. The method as claimed in claim 12, wherein the device profile includes information regarding a number of decoders included in the audio playback device.

15. The method as claim in claim 12, wherein the device profile includes information regarding a time required for a decoder of the audio playback device to decode an audio frame.

16. The method as claimed in claim 11, wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a user profile.

17. The method as claimed in claim 11, wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a channel profile.

18. The method as claimed in claim 11, wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a genre profile.

19. The method as claimed in claim 11, wherein the determining the start time for downloading the second audio clip is based on a bandwidth restriction.

20. The method as claimed in claim 11, wherein the determining the start time for downloading the second audio clip is based on a latency condition.