System and method for synchronization of selectably presentable media streams

• US 9,257,148 B2
• Filed: 03/15/2013
• Issued: 02/09/2016
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: JBF Interlude 2009 Ltd., JBF Interlude 2009 Ltd - Israel
• Original Assignee: JBF Interlude 2009 Ltd.
• Inventors: Zubalsky, Tal, Feldman, Barak, Bloch, Yoni
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): HUNTER, MISHAWN N
• Application Number:
  US13/838,830
• Publication Number:
  US 20140270680A1
• Time in Patent Office: 1,061 Days
• Field of Search: 375/240.01, 386/278, 386/281, 386/282, 386/285, 386/201, 386/239
• US Class Current: 1/1
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/9305 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

A system for synchronizing audio and video of selectably presentable multimedia content includes a memory for storing a plurality of selectably presentable multimedia content segments. Each content segment defines a portion of one or more content paths and includes a decision period during which a user may select a subsequent content segment as the content segment is playing. An assembly engine seamlessly assembles a subset of the content segments into one of the content paths, ultimately forming a multimedia presentation. A configuration manager determines an audio file and a video file to be played based on a content segment that is selected to be played immediately following the currently playing content segment. An audio engine processes the audio file for playback, and a video engine synchronizes playback of the video file with the playback of the audio file.

Claims

1. A system for synchronizing audio and video of selectably presentable multimedia content, the system comprising:

a memory for storing a plurality of selectably presentable multimedia content segments, each content segment defining a portion of one or more content paths and comprising a decision period during which a user may select a subsequent content segment as the content segment is playing;

an assembly engine for seamlessly assembling a subset of the content segments into a multimedia presentation comprising one of the content paths;

a configuration manager for determining an audio file and a video file to be played based on a selected subsequent content segment;

an audio engine for processing the audio file for playback, the processing comprising;

dividing the audio file into a plurality of audio samples, each audio sample comprising a timestamp indicating a time at which the audio sample should be played; and

upon causing one of the audio samples to be played, updating a current system timestamp based on the timestamp of the played audio sample; and

a video engine for synchronizing playback of the video file with the playback of the audio file, the synchronizing comprising;

dividing the video file into a plurality of video frames, each video frame comprising a timestamp indicating a time at which the video frame should be played;

comparing the timestamp of at least one of the video frames with the current system timestamp to determine that the video frame timestamp is earlier than the current system timestamp;

discarding the at least one of the video frames based on the timestamp comparison;

repeating the comparing and discarding functions with consecutive video frames until reaching a video frame having a timestamp that is substantially close to the current system timestamp; and

determining that a maximum number of video frames has been consecutively discarded, and causing a next video frame to be played irrespective of a timestamp associated with the next video frame.

2. The system of claim 1, wherein the synchronizing further comprises:

comparing the timestamp of a second one of the video frames with the current system timestamp to determine that the timestamp of the second video frame is substantially close to the current system timestamp; and

causing the second video frame to be immediately played.

3. The system of claim 1, wherein the synchronizing further comprises:

comparing the timestamp of a second one of the video frames with the current system timestamp to determine that the timestamp of the second video frame is later than the current system timestamp; and

delaying the second video frame.

4. The system of claim 1, further comprising a graphical user interface manager for presenting to the user, during a decision period as a content segment is playing, visual representations of two or more alternative content segments from which a subsequent content segment may be selected by the user.

5. The system of claim 4, wherein the graphical user interface manager is further for presenting to the user, upon reaching the decision period, a visual representation of a time interval representing an amount of time permitted to select one of the alternative content segments.

6. The system of claim 1, wherein the memory is further for storing a plurality of audio files, a plurality of video files, and a configuration file;

and wherein determining the audio file and the video file to be played comprises;

selecting the audio file from the plurality of audio files based on the configuration file and a selected multimedia content segment; and

selecting the video file from the plurality of video files based on the configuration file and the selected multimedia content segment.

7. A method of synchronizing audio and video of selectably presentable multimedia content, the method comprising:

storing a plurality of selectably presentable multimedia content segments, each content segment defining a portion of one or more content paths and comprising a decision period during which a user may select a subsequent content segment as the content segment is playing;

determining an audio file and a video file to be played based on a selected subsequent content segment;

seamlessly appending the selected subsequent content segment onto a currently playing content segment;

processing the audio file for playback, the processing comprising;

dividing the audio file into a plurality of audio samples, each audio sample comprising a timestamp indicating a time at which the audio sample should be played; and

upon causing one of the audio samples to be played, updating a current system timestamp based on the timestamp of the played audio sample; and

synchronizing playback of the video file with the playback of the audio file, the synchronizing comprising;

dividing the video file into a plurality of video frames, each video frame comprising a timestamp indicating a time at which the video frame should be played;

comparing the timestamp of at least one of the video frames with the current system timestamp to determine that the video frame timestamp is earlier than the current system timestamp;

discarding the at least one of the video frames based on the timestamp comparison;

repeating the comparing and discarding functions with consecutive video frames until reaching a video frame having a timestamp that is substantially close to the current system timestamp; and

determining that a maximum number of video frames has been consecutively discarded, and causing a next video frame to be played irrespective of a timestamp associated with the next video frame.

8. The method of claim 7, wherein the synchronizing further comprises:

comparing the timestamp of a second one of the video frames with the current system timestamp to determine that the timestamp of the second video frame is substantially close to the current system timestamp; and

causing the second video frame to be immediately played.

9. The method of claim 7, wherein the synchronizing further comprises:

comparing the timestamp of a second one of the video frames with the current system timestamp to determine that the timestamp of the second video frame is later than the current system timestamp; and

delaying the second video frame.

10. The method of claim 7, further comprising presenting to the user, during a decision period of the currently playing content segment, visual representations of two or more alternative content segments from which the subsequent content segment is selected.

11. The method of claim 10, further comprising presenting to the user, upon reaching the decision period, a visual representation of a time interval representing an amount of time permitted to select one of the alternative content segments.

12. The method of claim 7, further comprising storing a plurality of audio files, a plurality of video files, and a configuration file;

and wherein determining the audio file and the video file to be played comprises;

selecting the audio file from the plurality of audio files based on the configuration file and the selected subsequent content segment; and

selecting the video file from the plurality of video files based on the configuration file and the selected subsequent content segment.