System and method for media stream synchronization with a base atom index file and an auxiliary atom index file

• US 5,751,280 A
• Filed: 12/11/1995
• Issued: 05/12/1998
• Est. Priority Date: 12/11/1995
• Status: Expired due to Term

• Current Assignee: RPX Corporation
• Original Assignee: Silicon Graphics Incorporated (Graphics Properties Holdings, Inc.)
• Inventors: Abbott, Michael J., Close, Paul, Smith, Kevin P.
• Primary Examiner(s): Burwell, Joseph R.
• Application Number:
  US08/570,497
• Time in Patent Office: 883 Days
• Field of Search: 395/154, 395/600, 395/806, 395/807, 395/613, 395/615, 364/514 A, 348/7
• US Class Current: 715/203
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/483 using metadata automatically derived from the content
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

An indexing method allows a viewer to control the mode of delivery of program material while minimizing the time offset between audio and video data so that the viewer does not perceive a time delay between the audio and video. Video data frames may be grouped together into units referred to as "Groups of Pictures" (GOP'"'"'s) comprising one or more frames. Synchronization is performed by correlating audio frames of the audio data with GOP'"'"'s of the video data. When jumping to various points in an item of program material, this indexing method ensures that a jump is made to the beginning of a GOP. To prevent audio data from being "out of sync", the audio data must be correlated with the corresponding GOP. To do so, an index file for the video data is constructed, and then the video data index file is used to construct an index file for the corresponding audio data. The audio data index file is constructed so that, for the set of audio frames that most closely span the time interval spanned by each GOP, each audio frame in that set is assigned the same atom-relative byte position, which is the beginning of the set of audio frames.

Claims

1. A method for synchronizing media data for delivery to a viewer, comprising:

(1) identifying a base atom containing media data;

(2) identifying at least one auxiliary atom containing media data to be synchronized with media data in said base atom;

(3) constructing a base atom index file for said base atom, wherein said base atom index file contains base atom index boundaries; and

(4) constructing an auxiliary atom index file for each of said at least one auxiliary atom, wherein said auxiliary atom index file contains auxiliary atom index boundaries selected to most closely match said base atom index boundaries, thereby synchronizing media data in said at least one auxiliary atom with media data in said base atom.

2. The method of claim 1, wherein said base atom comprises video data and said base atom index boundaries are group of pictures boundaries.

3. The method of claim 2, wherein one of said at least one auxiliary atom comprises audio data.

4. The method of claim 2, wherein one of said at least one auxiliary atom comprises closed-captioning text data.

5. The method of claim 1, wherein said base atom comprises MPEG-2 encoded video and audio data.

6. The method of claim 5, wherein one of said at least one auxiliary atom comprises closed-captioning text data.

7. The method of claim 1, wherein said base atom index file correlates base atom index numbers with base atom media data positions relative to said base atom, and said auxiliary atom index file correlates auxiliary atom index numbers with auxiliary atom media data positions relative to said auxiliary atom.

8. The method of claim 7, wherein step (3) comprises:

(a) determining said base atom index numbers using an index duration that is a duration of one frame of media data.

9. The method of claim 7, wherein step (3) comprises:

(a) constructing said base atom index file so that each of said base atom index boundaries is a beginning of a group of pictures of media data, said group of pictures including at least one frame of media data.

10. The method of claim 9, wherein said base atom media data position is the same for each of said at least one frame of media data in said group of pictures.

11. The method of claim 7, wherein step (4) comprises:

(a) constructing said auxiliary atom index file so that each of said auxiliary atom index boundaries is a beginning of a group of audio frames of audio data.

12. The method of claim 11, wherein said auxiliary atom media data position is the same for each of said audio frames of audio data in said group of audio frames.

13. The method of claim 7, wherein step (3) comprises:

(a) rounding said base atom index numbers to locate said base atom index boundaries.

14. The method of claim 13, wherein step (a) comprises:

(i) scanning said base atom index file to locate a change in base atom media data positions.

15. An apparatus for synchronizing media data for delivery to a viewer, comprising:

means for identifying a base atom containing media data;

means for identifying at least one auxiliary atom containing media data to be synchronized with media data in said base atom;

means for constructing a base atom index file for said base atom, wherein said base atom index file contains base atom index boundaries; and

means for constructing an auxiliary atom index file for each of said at least one auxiliary atom, wherein said auxiliary atom index file contains auxiliary atom index boundaries selected to most closely match said base atom index boundaries, so that media data in said at least one auxiliary atom is synchronized with media data in said base atom.

16. A computer program product for use with a computer system, said computer program product comprising:

a computer usable medium having computer readable program code means embodied in said medium for enabling a computer system to synchronize data for delivery to a viewer, said computer readable program code means comprising,

computer readable program code means for identifying a base atom containing media data,

computer readable program code means for identifying at least one auxiliary atom containing media data to be synchronized with media data in said base atom,

computer readable program code means for constructing a base atom index file for said base atom, wherein said base atom index file contains base atom index boundaries, and

computer readable program code means for constructing an auxiliary atom index file for said at least one auxiliary atom, wherein said auxiliary atom index file contains auxiliary atom index boundaries selected to most closely match said base atom index boundaries to thereby synchronize media data in said at least one auxiliary atom with media data in said base atom.

17. The computer program product of claim 16, wherein said base atom index file correlates base atom index numbers with base atom media data positions relative to said base atom, and said auxiliary atom index file correlates auxiliary atom index numbers with auxiliary atom media data positions relative to said auxiliary atom.

18. The computer program product of claim 17, wherein said computer readable program code means for constructing a base atom index file comprises:

computer readable program code means for determining said base atom index numbers using an index duration that is a duration of one frame of media data.

19. The computer program product of claim 17, wherein said computer readable program code means for constructing a base atom index file comprises:

computer readable program code means for constructing said base atom index file so that each of said base atom index boundaries is a beginning of a group of pictures of media data, said group of pictures including at least one frame of media data.

20. The computer program product of claim 19, wherein said base atom media data position is the same for each of said at least one frame of media data in said group of pictures.

21. The computer program product of claim 17, wherein said computer readable program code means for constructing an auxiliary atom index file comprises:

computer readable program code means for constructing said auxiliary atom index file so that each of said auxiliary atom index boundaries is a beginning of a group of audio frames of audio data.

22. The computer program product of claim 21, wherein said auxiliary atom media data position is the same for each of said audio frames of audio data in said group of audio frames.

23. The computer program product of claim 17, wherein said computer readable program code means for constructing a base atom index file comprises:

computer readable program code means for rounding said base atom index numbers to locate said base atom index boundaries.

24. The computer program product of claim 23, wherein said computer readable program code means for rounding said base atom index numbers comprises:

computer readable program code means for scanning said base atom index file to locate a change in base atom media data positions.