Apparatus and method for temporal indexing of multiple audio, video and data streams

• US 5,627,936 A
• Filed: 12/21/1995
• Issued: 05/06/1997
• Est. Priority Date: 12/21/1995
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Chary, Ram V., Prasad, Rama R.
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): DIN, LUANNE PAN
• Application Number:
  US08/576,179
• Time in Patent Office: 502 Days
• Field of Search: 358/341, 358/343, 358/335, 348/7, 348/13, 348/462, 348/473, 348/482, 348/484, 348/500, 348/515, 360/19.1, 360/48
• US Class Current: 386/253
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A method, apparatus, and storage medium for temporal indexing of at least two audio, video, and data (AVD) streams, each AVD stream comprising a plurality of AVD stream chunks. A stream information data stream (SIDS) having a plurality of SIDS chunks is stored, each SIDS chunk corresponding to a corresponding AVD stream chunk for each of the at least two AVD streams. A temporal index stream (TIS) having a plurality of TIS chunks is also stored, each TIS chunk corresponding to a corresponding SIDS chunk. Each TIS chunk comprises a time stamp for indicating the current time and an offset for locating the corresponding SIDS chunk. Each SIDS chunk comprises an SIDS chunk entry for each of the at least two AVD streams that is currently active, each SIDS chunk entry comprising an offset for locating the corresponding AVD stream chunk of each active AVD stream of the at least two AVD streams.

Claims

1. A method for temporal indexing of at least two audio, video, and data (AVD) streams, each AVD stream comprising a plurality of AVD stream chunks, the method comprising the steps of:

(a) storing a stream information data stream (SIDS) having a plurality of SIDS chunks, each SIDS chunk corresponding to a corresponding AVD stream chunk for each of the at least two AVD streams; and

(b) storing a temporal index stream (TIS) having a plurality of TIS chunks, each TIS chunk corresponding to a corresponding SIDS chunk;

wherein;

each TIS chunk comprises a time stamp for indicating the current time and an offset for locating the corresponding SIDS chunk; and

each SIDS chunk comprises an SIDS chunk entry for each of the at least two AVD streams that is currently active, each SIDS chunk entry comprising an offset for locating the corresponding AVD stream chunk of each active AVD stream of the at least two AVD streams.

2. The method of claim 1, wherein the current time indicates the time of the corresponding AVD stream chunk for each of the at least two AVD streams.

3. The method of claim 1, wherein:

the SIDS has an SIDS header for describing the SIDS;

the TIS has a TIS header for describing the TIS; and

each TIS chunk has a relatively small fixed size so as to allow for random accessing of selected TIS chunks.

4. The method of claim 3, wherein:

each SIDS chunk further comprises a number of entries field for indicating the number of SIDS chunk entries in each SIDS chunk; and

each SIDS chunk entry of each SIDS chunk further comprises an identifier field for identifying the corresponding AVD stream and a status field for indicating the current status of the corresponding AVD stream.

5. The method of claim 4, wherein:

each offset of each TIS chunk is a 32-bit pointer;

each time stamp of each TIS chunk is a 32-bit time stamp field;

each SIDS offset of each SIDS chunk entry is a second 32-bit pointer;

the SIDS header is a 32-bit SIDS header field;

the TIS header is a 32-bit TIS header field;

each number of entries field of each SIDS chunk is a 32-bit number of entries field;

each identifier field is a 32-bit identifier field; and

each status field is a 32-bit status field.

6. The method of claim 4, wherein:

the at least two AVD streams are AVD streams of a data conference between at least two users;

each AVD stream of the at least two AVD streams has a unique conference identifier; and

the identifier field of each SIDS chunk entry identifies the unique conference identifier for the corresponding AVD stream.

7. The method of claim 4, wherein the status field of each SIDS chunk entry indicates whether the corresponding AVD stream is active paused, active unpaused, or inactive.

8. The method of claim 1, further comprising the step of:

(c) storing the at least two AVD streams;

wherein the TIS and the SIDS are created simultaneously with the storing of step (c).

9. The method of claim 1, wherein each AVD chunk of an AVD stream of the at least two AVD streams is a chunk of data in accordance with whether the AVD stream is an audio, video, or data stream.

10. The method of claim 9, wherein each AVD chunk of an AVD stream of the at least two AVD streams is a video frame if the each AVD chunk is a video stream and an audio sample if the each AVD chunk is an audio stream.

11. An apparatus for temporal indexing of at least two audio, video, and data (AVD) streams, each AVD stream comprising a plurality of AVD stream chunks, the apparatus comprising:

(a) means for storing a stream information data stream (SIDS) having a plurality of SIDS chunks, each SIDS chunk corresponding to a corresponding AVD stream chunk for each of the at least two AVD streams; and

(b) means for storing a temporal index stream (TIS) having a plurality of TIS chunks, each TIS chunk corresponding to a corresponding SIDS chunk;

wherein;

each TIS chunk comprises a time stamp for indicating the current time and an offset for locating the corresponding SIDS chunk; and

each SIDS chunk comprises an SIDS chunk entry for each of the at least two AVD streams that is currently active, each SIDS chunk entry comprising an offset for locating the corresponding AVD stream chunk of each active AVD stream of the at least two AVD streams.

12. The apparatus of claim 11, wherein the current time indicates the time of the corresponding AVD stream chunk for each of the at least two AVD streams.

13. The apparatus of claim 11, wherein:

the SIDS has an SIDS header for describing the SIDS;

the TIS has a TIS header for describing the TIS; and

each TIS chunk has a relatively small fixed size so as to allow for random accessing of selected TIS chunks.

14. The apparatus of claim 13, wherein:

each SIDS chunk further comprises a number of entries field for indicating the number of SIDS chunk entries in each SIDS chunk; and

each SIDS chunk entry of each SIDS chunk further comprises an identifier field for identifying the corresponding AVD stream and a status field for indicating the current status of the corresponding AVD stream.

15. The apparatus of claim 14, wherein:

each offset of each TIS chunk is a 32-bit pointer;

each time stamp of each TIS chunk is a 32-bit time stamp field;

each SIDS offset of each SIDS chunk entry is a second 32-bit pointer;

the SIDS header is a 32-bit SIDS header field;

the TIS header is a 32-bit TIS header field;

each number of entries field of each SIDS chunk is a 32-bit number of entries field;

each identifier field is a 32-bit identifier field; and

each status field is a 32-bit status field.

16. The apparatus of claim 14, wherein:

the at least two AVD streams are AVD streams of a data conference between at least two users;

each AVD stream of the at least two AVD streams has a unique conference identifier; and

the identifier field of each SIDS chunk entry identifies the unique conference identifier for the corresponding AVD stream.

17. The apparatus of claim 14, wherein the status field of each SIDS chunk entry indicates whether the corresponding AVD stream is active paused, active unpaused, or inactive.

18. The apparatus of claim 11, further comprising:

(c) means for storing the at least two AVD streams;

wherein the TIS and the SIDS are created simultaneously with the storing of means (c).

19. The apparatus of claim 11, wherein each AVD chunk of an AVD stream of the at least two AVD streams is a chunk of data in accordance with whether the AVD stream is an audio, video, or data stream.

20. The apparatus of claim 19, wherein each AVD chunk of an AVD stream of the at least two AVD streams is a video frame if the each AVD chunk is a video stream and an audio sample if the each AVD chunk is an audio stream.

21. A storage medium encoded with machine-readable computer program code for temporal indexing of at least two audio, video, and data (AVD) streams, each AVD stream comprising a plurality of AVD stream chunks, the storage medium comprising:

(a) means for causing a computer to store a stream information data stream (SIDS) having a plurality of SIDS chunks, each SIDS chunk corresponding to a corresponding AVD stream chunk for each of the at least two AVD streams; and

(b) means for causing the computer to store a temporal index stream (TIS) having a plurality of TIS chunks, each TIS chunk corresponding to a corresponding SIDS chunk;

wherein;

each TIS chunk comprises a time stamp for indicating the current time and an offset for locating the corresponding SIDS chunk; and

each SIDS chunk comprises an SIDS chunk entry for each of the at least two AVD streams that is currently active, each SIDS chunk entry comprising an offset for locating the corresponding AVD stream chunk of each active AVD stream of the at least two AVD streams.

22. The storage medium of claim 21, wherein the current time indicates the time of the corresponding AVD stream chunk for each of the at least two AVD streams.

23. The storage medium of claim 21, wherein:

the SIDS has an SIDS header for describing the SIDS;

the TIS has a TIS header for describing the TIS; and

each TIS chunk has a relatively small fixed size so as to allow for random accessing of selected TIS chunks.

24. The storage medium of claim 23, wherein:

each SIDS chunk further comprises a number of entries field for indicating the number of SIDS chunk entries in each SIDS chunk; and

each SIDS chunk entry of each SIDS chunk further comprises an identifier field for identifying the corresponding AVD stream and a status field for indicating the current status of the corresponding AVD stream.

25. The storage medium of claim 24, wherein:

each offset of each TIS chunk is a 32-bit pointer;

each time stamp of each TIS chunk is a 32-bit time stamp field;

each SIDS offset of each SIDS chunk entry is a second 32-bit pointer;

the SIDS header is a 32-bit SIDS header field;

the TIS header is a 32-bit TIS header field;

each number of entries field of each SIDS chunk is a 32-bit number of entries field;

each identifier field is a 32-bit identifier field; and

each status field is a 32-bit status field.

26. The storage medium of claim 24, wherein:

the at least two AVD streams are AVD streams of a data conference between at least two users;

each AVD stream of the at least two AVD streams has a unique conference identifier; and

the identifier field of each SIDS chunk entry identifies the unique conference identifier for the corresponding AVD stream.

27. The storage medium of claim 24, wherein the status field of each SIDS chunk entry indicates whether the corresponding AVD stream is active paused, active unpaused, or inactive.

28. The storage medium of claim 21, further comprising:

(c) means for causing the computer to store the at least two AVD streams;

wherein the TIS and the SIDS are created simultaneously with the storing of means (c).

29. The storage medium of claim 21, wherein each AVD chunk of an AVD stream of the at least two AVD streams is a chunk of data in accordance with whether the AVD stream is an audio, video, or data stream.

30. The storage medium of claim 29, wherein each AVD chunk of an AVD stream of the at least two AVD streams is a video frame if the each AVD chunk is a video stream and an audio sample if the each AVD chunk is an audio stream.