System and method for synchronization of multimedia streams

• US 5,420,801 A
• Filed: 11/13/1992
• Issued: 05/30/1995
• Est. Priority Date: 11/13/1992
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Haug, Charles L., Dockter, Michael J., Seppi, Kevin D.
• Primary Examiner(s): Ramirez, Ellis B.
• Application Number:
  US07/976,159
• Time in Patent Office: 928 Days
• Field of Search: 364/514, 364/468, 364/131, 364/419, 364/133, 364/DIG. 1, 364/271.2, 364/271.3, 364/271.4, 364/DIG. 2, 364/945.9, 434/185, 340/825.14, 340/825.2, 340/714, 340/721, 358/140, 358/142, 358/185, 358/182, 360/14.3, 395/152, 395/154, 395/650, 395/250, 377/20, 377/110, 81/603, 84/DIG. 12
• US Class Current: 345/501
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 8/458 Synchronisation, e.g. post-wait, barriers, locks synchronisation among tasks G06F9/52
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

A computer-based multimedia presentation system is provided with a synchronization scheme for recording and playing independent media. The disclosed system and method allows media processes and single medium processes to achieve and maintain synchronization with each other without process interdependence and without interprocess communication. This capability is provided by assigning a common clock for all processes, requiring all participating media processes to reference the common clock, informing each process of, a synchronization basepoint called a "zero-time", and then allowing each process to independently synchronize itself to the common clock. The common clock itself does not provide any stimulus to a media process; it is a passive component in the synchronization. The media process is the active component, referring to the common clock as required to maintain synchronization for the particular media it is handling.

Claims

1. A method for synchronizing initiation of media operations in a multimedia recording and playback system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value, broadcasting the zero-time value to at least one media process; and

in the media process, receiving the zero-time value, upon the current time reaching the zero-time value, initiating the media operations,

thereby, synchronizing initiation of the media operations.

2. A method for synchronizing initiation as recited in claim 1, wherein the media operation is any of image recording, image playback, text recording, text playback, audio recording, and audio playback.

3. A method for synchronizing initiation as recited in claim 1, wherein the clock means is a system real-time clock.

4. A method for synchronizing initiation as recited in claim 1, wherein the media process initiates its media operation independently of other media processes.

5. A method for synchronizing initiation as recited in claim 4, wherein media process receives exactly one zero-time value transmission, and wherein the zero-time value transmission constitutes the only synchronization transmission initiated from the starter process to the media process.

6. A method for synchronizing initiation of media operations in a multimedia recording and playback system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value, broadcasting the zero-time value to at least one media process; and

in the media process, receiving the zero-time value, determining a media start-time by combining an offset time with the zero-time value, and upon the current time reaching the media start-time, initiating the media operation,

thereby, synchronizing initiation of the media operations.

7. A method for synchronizing initiation as recited in claim 6, wherein the media start-time is determined by adding the offset time to the zero-time value.

8. A method for synchronizing media recording in a multimedia recording and playback system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value;

broadcasting the zero-time value to at least one media process; and

in the media process, receiving the zero-time value, upon the current time reaching the zero-time value, repeating for each media event the sub-steps of obtaining the current time from the clock means, determining an event offset based on the zero-time value and the current time, logging the event offset in association with the media event, recording the media event,

thereby, synchronizing the media recording.

9. A method for synchronizing media recording as recited in claim 8, wherein the step of repenting for each media event further comprises the sub-step of, after recording the media event, waiting for arrival of the next media event.

10. A method for synchronizing media recording as recited in claim 8, wherein a media event includes any of a single presentation object and a set of presentation objects.

11. A method for synchronizing media recording as recited in claim 8, wherein the logging step logs the event offset into the data rate of the recorded data.

13. A method for synchronizing media recording as recited in claim 8, wherein the step of determining n zero-time value further includes coding the zero-time value by computing its two'"'"'s complement.

14. A method for synchronizing media recording as recited in claim 8, wherein the media process determines the granularity and number of media events independently of the starter process and other media processes.

15. A method for synchronizing media recording as recited in claim 8, wherein the clock means is a system real-time clock.

16. A method for synchronizing media recording as recited in claim 8, wherein the media process operates independently of other media processes and the starter process.

17. A method for synchronizing media recording as recited in claim 16, wherein the media process receives exactly one zero-time value transmission, and wherein the zero-time value transmission constitutes the only synchronization transmission initiated from the starter process to the media process.

12. A method for synchronizing media recording as recited in claim wherein the event offset is determined by subtracting the zero-time value from the current time.

18. A method for synchronizing media recording in a multimedia recording and playback system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process reparation time to the initialization-time value, broadcasting the zero-time value to at least one media process; and

in the media process, receiving the zero-time value, determining a media start-time by adding an offset time to the zero-time value, upon the current time reaching the media start-time, repeating for each media event the sub-steps of obtaining the current time from the clock means, determining an event offset based on the zero-time value and the current time, logging the event offset in association with the media event, recording the media event,

thereby, synchronizing the media recording.

19. A method for synchronizing media playback in a multimedia recording and playback system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value;

broadcasting the zero-time value to at least one media process; and

in the media process, receiving the zero-time value, accessing a log of event offset times associated with a plurality of media events, for each logged event offset time, performing the sub-steps of readying the associated media event for playing, and when the event offset time arrives, playing the media event,

thereby, synchronizing the media playback.

20. A method for synchronizing media playing as recited in claim 19, wherein the event offset time arrival is determined by comparing the current time with the sum of the zero-time value and the logged event offset time.

21. A method for synchronizing media playing as recited in claim 19, wherein the log of event offset times is provided in the data rate of the recorded data.

22. A method for synchronizing media playing as recited in claim 19, wherein the log of event offset times is created by any of recording and authorship.

23. A method for synchronizing media playing as recited in claim 19, wherein the step of performing sub-steps further comprises the sub-steps of

determining a correction time based on the event offset time, the current time, and zero-time,

for a non-zero correction time, performing a resynchronization action on the next media event.

24. A method for synchronizing media playing as recited in claim 19, wherein the correction time is determined by subtracting the current time from the sum of zero-time and the event offset time.

25. A method for synchronizing media playing as recited in claim 19, wherein for a negative correction time the resynchronization action includes any of compression, truncation, and deletion.

26. A method for synchronizing media playing as recited in claim 19, wherein for a positive correction time the resynchronization action includes any of waiting and elongation.

27. A method for synchronizing media playing as recited in claim 19, wherein the step of determining a zero-time value further includes coding the zero-time value by computing its two'"'"'s complement.

28. A method for synchronizing media playing as recited in claim 19, wherein the clock means is a system real-time clock.

29. A method for synchronizing media playing as recited in claim 19, wherein the media process operates independently of other media processes and the starter process.

30. A method for synchronizing media playing as recited in claim 29, wherein the media process receives exactly one zero-time value transmission, and wherein the zero-time value transmission constitutes the only synchronization transmission initiated from the starter process to the media process.

31. A method for synchronizing media recording as recited in claim 19, wherein the media process terminates itself upon playing its final media event.

32. A method for synchronizing media playback in a multimedia recording and playback system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value;

broadcasting the zero-time value to at least one media process; and

in the media process, receiving the zero-time value, accessing a log of event offset times associated with a plurality of media events, for each logged event offset time, performing the sub-steps of readying the associated media event for playing, and when the event offset time arrives, playing the media event,

thereby, synchronizing the media playback.

33. A method for synchronizing initiation of events in a multiprogramming computer system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value, broadcasting the zero-time value to at least one receiving process; and

in the receiving process, receiving the zero-time value, upon the current time reaching the zero-time value, initiating the event,

thereby, synchronizing initiation of the media events.

34. A method for synchronizing events in a multiprogramming computer system, comprising the steps of:

in a starter process, receiving the current time from a clock means, assigning the received current time as an initialization-time value, determining a zero-time value by adding a process preparation time to the initialization-time value;

broadcasting the zero-time value to at least one receiving process; and

in the receiving process, receiving the zero-time value, upon the current time reaching the zero-time value, repeating for each event the sub-steps of executing the event, determining a next-event time, waiting until the current time reaches the next-event time,

thereby, synchronizing the events.