System and method for providing audio in a media file

• US 7,594,218 B1
• Filed: 07/23/2002
• Issued: 09/22/2009
• Est. Priority Date: 07/24/2001
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Lozben, Slavik
• Primary Examiner(s): Kendall; Chuck O
• Application Number:
  US10/201,056
• Time in Patent Office: 2,618 Days
• Field of Search: None
• US Class Current: 717/120
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H04N 21/2335 involving reformatting operations of audio signals, e.g. by converting from one coding standard to another details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/05 Synchronising circuits with arrangements for extending range of synchronisation, e.g. by using switching between several time constants
• CPC Class Codes: H04N 5/602 for digital sound signals

Abstract

A system and method adds audio to a media file. The audio may be received via one or more files in an uncompressed format, a compressed format or both types of files may be received. The system and method can mix multiple sources, and converts the audio received into a compressed version in a manner that facilitates streaming.

Claims

1. A computer-implemented method comprising:

identifying a first audio clip and a second audio clip, wherein the first audio clip and the second audio clip are associated with a graphics frame;

determining that at least a portion of the first audio clip and at least a portion of the second audio clip are to be played simultaneously with respect to the graphics frame;

mixing the first audio clip and the second audio clip to generate a combined audio clip; and

storing the combined audio clip and the graphics frame in a media file.

2. The computer-implemented method of claim 1, further comprising:

determining that at least one of the first audio clip and the second audio clip comprises a compressed audio clip; and

converting each compressed audio clip to a common format prior to mixing the first audio clip and the second audio clip.

3. The computer-implemented method of claim 1, further comprising:

extracting the first audio clip from a first audio source file, wherein the extracted first audio clip corresponds temporally to the graphics frame.

4. The computer-implemented method of claim 3, wherein the first audio source file comprises a streaming file.

5. The computer-implemented method of claim 1, further comprising compressing the combined audio clip.

6. The computer-implemented method of claim 1, wherein the media file is stored in a streaming format on a streaming media server.

7. The computer-implemented method of claim 1, wherein mixing the first audio clip and the second audio clip further comprises:

averaging one or more sample values of the first audio clip with one or more corresponding sample values of the second audio clip.

8. The computer-implemented method of claim 1, wherein the combined audio clip comprises a header and an audio data field.

9. The computer-implemented method of claim 8, wherein the header includes a first field indicating a total number of samples included in the combined audio clip and a second field indicating a first audio sample associated with the graphics frame.

10. A computer program product on a computer readable medium for generating a media file, the computer program product comprising instructions operable to cause data processing apparatus to perform operations comprising:

identifying a first audio clip and a second audio clip, wherein the first audio clip and the second audio clip are associated with a graphics frame;

determining that at least a portion of the first audio clip and at least a portion of the second audio clip are to be played simultaneously with respect to the graphics frame;

mixing the first audio clip and the second audio clip to generate a combined audio clip; and

storing the combined audio clip and the graphics frame in a media file.

11. The computer program product of claim 10, further comprising:

determining that at least one of the first audio clip and the second audio clip comprises a compressed audio clip; and

converting each compressed audio clip to a common format prior to mixing the first audio clip and the second audio clip.

12. The computer program product of claim 10, further comprising:

extracting the first audio clip from a first audio source file, wherein the extracted first audio clip corresponds temporally to the graphics frame.

13. The computer program product of claim 12, wherein the first audio source file comprises a streaming file.

14. The computer program product of claim 10, further comprising compressing the combined audio clip.

15. The computer program product of claim 10, wherein the media file is stored in a streaming format on a streaming media server.

16. The computer program product of claim 10, wherein mixing the first audio clip and the second audio clip further comprises:

averaging one or more sample values of the first audio clip with one or more corresponding sample values of the second audio clip.

17. The computer program product of claim 10, wherein the combined audio clip comprises a header and an audio data field.

18. The computer program product of claim 17, wherein the header includes a first field indicating a total number of samples included in the combined audio clip and a second field indicating a first audio sample associated with the graphics frame.

19. A system comprising:

a storage device configured to store a plurality of files; and

processor electronics configured to perform operations comprising;

identifying a first audio clip and a second audio clip, wherein the first audio clip and the second audio clip are associated with a graphics frame;

determining that at least a portion of the first audio clip and at least a portion of the second audio clip are to be played simultaneously with respect to the graphics frame;

mixing the first audio clip and the second audio clip to generate a combined audio clip; and

storing the combined audio clip and the graphics frame in a media file.

20. The system of claim 19, wherein the processor electronics are further configured to perform operations comprising:

determining that at least one of the first audio clip and the second audio clip comprises a compressed audio clip; and

converting each compressed audio clip to a common format prior to mixing the first audio clip and the second audio clip.

21. The system of claim 19, wherein the processor electronics are further configured to perform operations comprising:

extracting the first audio clip from a first audio source file, wherein the extracted first audio clip corresponds temporally to the graphics frame.

22. The system of claim 21, wherein the first audio source file comprises a streaming file.

23. The system of claim 19, wherein the processor electronics are further configured to perform operations comprising compressing the combined audio clip.

24. The system of claim 19, wherein the processor electronics are further configured to perform operations comprising storing the media file in a streaming format on a streaming media server.

25. The system of claim 19, wherein the processor electronics are further configured to perform operations comprising:

mixing the first audio clip and the second audio clip by averaging one or more sample values of the first audio clip with one or more corresponding sample values of the second audio clip.

26. The system of claim 19, wherein the combined audio clip comprises a header and an audio data field.

27. The system of claim 26, wherein the header includes a first field indicating a total number of samples included in the combined audio clip and a second field indicating a first audio sample associated with the graphics frame.