System and method for providing audio in a media file

• US 8,352,910 B1
• Filed: 08/21/2009
• Issued: 01/08/2013
• Est. Priority Date: 07/24/2001
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Lozben, Slavik
• Primary Examiner(s): KENDALL, CHUCK O
• Application Number:
  US12/545,768
• Time in Patent Office: 1,236 Days
• Field of Search: None
• US Class Current: 717/111
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H04N 21/2335 involving reformatting operations of audio signals, e.g. by converting from one coding standard to another details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/05 Synchronising circuits with arrangements for extending range of synchronisation, e.g. by using switching between several time constants
• CPC Class Codes: H04N 5/602 for digital sound signals

Abstract

A system and method adds audio to a media file. The audio may be received via one or more files in an uncompressed format, a compressed format or both types of files may be received. The system and method can mix multiple sources, and converts the audio received into a compressed version in a manner that facilitates streaming.

Claims

1. A computer-implemented method comprising:

accessing an authoring file including instructions defining a streaming media file;

identifying, based on the authoring file, a first audio segment and a second audio segment corresponding to a portion of the streaming media file;

selecting the first audio segment from a first source audio clip and the second audio segment from a second source audio clip;

combining, in accordance with the instructions, the first audio segment and the second audio segment to generate a combined audio segment; and

storing the combined audio segment in the streaming media file.

2. The computer-implemented method of claim 1, further comprising:

retrieving from a video source file, in accordance with the instructions, a video frame corresponding temporally to the first audio segment and the second audio segment; and

associating the video frame with the combined audio segment in the streaming media file.

3. The computer-implemented method of claim 2, wherein the combined audio segment includes one or more samples corresponding to an immediately preceding video frame.

4. The computer-implemented method of claim 2, further comprising:

representing the combined audio segment in the streaming media file using an audio data field and a header, the header indicating a number of samples included in the audio data field and a first sample in the audio data field corresponding to the video frame.

5. The computer-implemented method of claim 1, further comprising:

retrieving from the authoring file one or more instructions associated with rendering the combined audio segment; and

storing the one or more retrieved instructions in the streaming media file.

6. The computer-implemented method of claim 1, further comprising:

representing the combined audio segment in the streaming media file using an audio data field and a header;

removing a number of samples corresponding to silence from the audio data field; and

inserting into the header an indication of the number of samples removed.

7. The computer-implemented method of claim 1, further comprising:

compressing the combined audio segment prior to storing the combined audio segment in the streaming media file.

8. The computer-implemented method of claim 1, further comprising:

storing in the streaming media file an instruction to begin playing the combined audio segment.

9. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

accessing an authoring file including instructions defining a streaming media file;

identifying, based on the authoring file, a first audio segment and a second audio segment corresponding to a portion of the streaming media file;

selecting the first audio segment from a first source audio clip and the second audio segment from a second source audio clip;

combining, in accordance with the instructions, the first audio segment and the second audio segment to generate a combined audio segment; and

storing the combined audio segment in the streaming media file.

10. The computer program product of claim 9, further operable to cause data processing apparatus to perform operations comprising:

retrieving from a video source file, in accordance with the instructions, a video frame corresponding temporally to the first audio segment and the second audio segment; and

associating the video frame with the combined audio segment in the streaming media file.

11. The computer program product of claim 10, wherein:

the combined audio segment includes one or more samples corresponding to an immediately preceding video frame.

12. The computer program product of claim 10, further operable to cause data processing apparatus to perform operations comprising:

representing the combined audio segment in the streaming media file using an audio data field and a header, the header indicating a number of samples included in the audio data field and a first sample in the audio data field corresponding to the video frame.

13. The computer program product of claim 9, further operable to cause data processing apparatus to perform operations comprising:

retrieving from the authoring file one or more instructions associated with rendering the combined audio segment; and

storing the one or more retrieved instructions in the streaming media file.

14. The computer program product of claim 9, further operable to cause data processing apparatus to perform operations comprising:

representing the combined audio segment in the streaming media file using an audio data field and a header;

removing a number of samples corresponding to silence from the audio data field; and

inserting into the header an indication of the number of samples removed.

15. The computer program product of claim 9, further operable to cause data processing apparatus to perform operations comprising:

compressing the combined audio segment prior to storing the combined audio segment in the streaming media file.

16. The computer program product of claim 9, further operable to cause data processing apparatus to perform operations comprising:

storing in the streaming media file an instruction to begin playing the combined audio segment.

17. A system comprising:

a computer-readable medium storing source audio clips and an authoring file including instructions defining a streaming media file; and

processor electronics configured to perform operations comprising;

accessing the authoring file;

identifying, based on the authoring file, a first audio segment and a second audio segment corresponding to a portion of the streaming media file;

selecting the first audio segment from a first source audio clip and the second audio segment from a second source audio clip;

combining, in accordance with the instructions, the first audio segment and the second audio segment to generate a combined audio segment; and

storing, on the computer-readable medium, the combined audio segment in the streaming media file.

18. The system of claim 17, wherein the processor electronics are further configured to perform operations comprising:

retrieving from a video source file, in accordance with the instructions, a video frame corresponding temporally to the first audio segment and the second audio segment; and

associating the video frame with the combined audio segment in the streaming media file.

19. The system of claim 18, wherein the combined audio segment includes one or more samples corresponding to an immediately preceding video frame.

20. The system of claim 18, wherein the processor electronics are further configured to perform operations comprising:

representing the combined audio segment in the streaming media file using an audio data field and a header, the header indicating a number of samples included in the audio data field and a first sample in the audio data field corresponding to the video frame.

21. The system of claim 17, wherein the processor electronics are further configured to perform operations comprising:

retrieving from the authoring file one or more instructions associated with rendering the combined audio segment; and

storing the one or more retrieved instructions in the streaming media file.

22. The system of claim 17, wherein the processor electronics are further configured to perform operations comprising:

representing the combined audio segment in the streaming media file using an audio data field and a header;

removing a number of samples corresponding to silence from the audio data field; and

inserting into the header an indication of the number of samples removed.

23. The system of claim 17, wherein the processor electronics are further configured to perform operations comprising:

compressing the combined audio segment prior to storing the combined audio segment in the streaming media file.

24. The system of claim 17, wherein the processor electronics are further configured to perform operations comprising:

storing in the streaming media file an instruction to begin playing the combined audio segment.