System and method for seamless multimedia assembly

• US 9,607,655 B2
• Filed: 02/24/2011
• Issued: 03/28/2017
• Est. Priority Date: 02/17/2010
• Status: Active Grant

• Current Assignee: JBF Interlude 2009 Ltd.
• Original Assignee: JBF Interlude 2009 Ltd.
• Inventors: Bloch, Jonathan, Feldman, Barak, Zubalsky, Tal, Rotbard, Kfir Y., Burstein, Dmitry
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): Nazar, Ahamed I
• Application Number:
  US13/033,916
• Publication Number:
  US 20110200116A1
• Time in Patent Office: 2,224 Days
• Field of Search: 375/240, 375/E7.027, 375/E7.076, 715/716, 715/723, 369/30.23
• US Class Current: 1/1
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 2210/125 Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Systems and methods are provided for seamless assembly of video/audio segments. To achieve such seamless assembly during streaming/online progressive download of media, a second segment is downloaded to a client during the presentation of a first segment. The first segment is then attached to the beginning of the second segment, where no jitter or gap results with the transition point either in the video or audio portion of the segments. Hence, the merged segments are presented as a seamless assembly of video/audio segments, where the user is “unaware” that the merged segments are the result of two separate or different segments. To effectuate such gapless assembly of segments, a gapless media file is created for encoding the video and audio segments using a gapless audio encoding scheme, such as Ogg Vorbis, where synchronized, gapless audio tags are interleaved in the video segments.

Claims

1. A system for seamless media assembly, comprising:

at least one processing unit;

at least one memory storing data representing a plurality of predefined composition paths, each path comprising a plurality of gapless media files, each gapless media file representing a predefined portion of one or more of the predefined composition paths and including a predefined decision period during which a user may select, in real-time as the respective gapless media file is playing, a subsequent gapless media file to be played automatically and immediately following a conclusion of the respective gapless media file, wherein the decision period of the respective gapless media file begins subsequent to a beginning of the respective gapless media file and ends prior to the conclusion of the respective gapless media file; and

at least one memory storing computer-executable instructions that, when executed by the at least one processing unit, provide;

an encoder located at a remote server and a decoder located at a client device, wherein the remote server and client device communicate over a network,

wherein the encoder is configured to;

create first and second gapless media files by interleaving first and second pluralities of gapless audio segments representative of first and second audio streams with first and second video segments, respectively;

create an alternative second gapless media file by interleaving alternative second pluralities of gapless audio segments representative of an alternative second audio stream, with an alternative second video segment; and

transmit over the network, at least in part, metadata and content of the first, second, and alternative second gapless media files to the decoder located at the client device, wherein the metadata and content of the second gapless media file are simultaneously transmitted over the network to the decoder at least in part with the metadata and content of the alternative second gapless media file during playback of the first gapless media file at the client device; and

wherein the decoder is for creating a seamlessly continuous media stream comprising one of the composition paths, the decoder configured to;

receive over the network, at least in part, from the encoder located at the remote server, the metadata and content of the first, second, and alternative second gapless media files, wherein the metadata and content of the second gapless media file are simultaneously received over the network from the encoder at least in part with the metadata and content of the alternative second gapless media file during playback of the first gapless media file at the client device;

upon a selection of the second gapless media file instead of the alternative second gapless media file;

discontinue receiving over the network the metadata and content of the alternative second gapless media file;

synchronize the first and second audio streams with the first and second video segments, respectively; and

assemble the first and second gapless media files into the seamlessly continuous media stream for playback; and

upon a selection of the alternative second gapless media file instead of the second gapless media file;

discontinue receiving over the network the metadata and content of the second gapless media file;

synchronize the first and alternative second audio streams with the first and alternative second video segments, respectively; and

assemble the first and alternative second gapless media files into the seamlessly continuous media stream for playback.

2. The system of claim 1, wherein the first and second audio streams are encoded in an Ogg Vorbis format.

3. The system of claim 1, wherein the first and second video segments are encoded in a Flash video format.

4. The system of claim 1, wherein the first and second video segments comprise video tags and script tags.

5. The system of claim 1, wherein the decoder is further configured to remove respective headers from the first and second gapless media files prior to assembly of the first and second gapless media files.

6. The system of claim 1, wherein the decoder is further configured to alter respective headers of the first and second pluralities of gapless audio segments prior to assembly of the first and second gapless media files to effectuate the playback of the first and second audio streams at appropriate points in time.

7. The system of claim 1, wherein the encoder is further configured to, prior to creating the first and second gapless media files, analyze the first and second audio streams to determine proper division points resulting in the first and second pluralities of gapless audio segments such that the first and second pluralities of gapless audio segments will be synchronized with first and second pluralities of video tags comprising the first and second video segments.

8. The system of claim 1, wherein the seamless media assembly is performed during one of a progressive download or subsequent to a complete download of the first and second gapless media files at a mobile device, and wherein the decoder operates in real-time.

9. A computer-implemented method, comprising:

storing data representing a plurality of predefined composition paths, each path comprising a plurality of gapless media files, each gapless media file representing a predefined portion of one or more of the predefined composition paths and including a predefined decision period during which a user may select, in real-time as the respective gapless media file is playing, a subsequent gapless media file to be played automatically and immediately following a conclusion of the respective gapless media file, wherein the decision period of the respective gapless media file begins subsequent to a beginning of the respective gapless media file and ends prior to the conclusion of the respective gapless media file;

analyzing, at an encoder located at a remote server, first and second audio streams to determine proper division points resulting in first and second pluralities of gapless audio segments;

creating, with the encoder, first and second gapless media files for seamless assembly by interleaving the first and second pluralities of gapless audio segments representative of the first and second audio streams, with first and second video segments, respectively;

creating, with the encoder, an alternative second gapless media file for seamless assembly with the first gapless media file by interleaving alternative second pluralities of gapless audio segments representative of an alternative second audio stream, with an alternative second video segment;

transmitting over a network, at least in part, by the encoder, metadata and content of the first, second, and alternative second gapless media files to a decoder located at a client device, wherein the metadata and content of the second gapless media file are simultaneously transmitted over the network to the decoder at least in part with the metadata and content of the alternative second gapless media file during playback of the first gapless media file at the client device;

receiving over the network, at least in part, from the encoder located at the remote server, metadata and content of the first, second, and alternative second gapless media files at the decoder, wherein the decoder is configured to create a seamlessly continuous media stream comprising one of the composition paths, wherein the metadata and content of the second gapless media file are simultaneously received over the network from the encoder at least in part with the metadata and content of the alternative second gapless media file during playback of the first gapless media file at the client device;

if a selection of the second gapless media file instead of the alternative second gapless media file is received;

discontinuing receiving over the network the metadata and content of the alternative second gapless media file;

synchronizing, by the decoder, the first and second audio streams with the first and second video segments, respectively; and

assembling, by the decoder, the first and second gapless media files into the seamlessly continuous media stream for playback; and

if a selection of the alternative second gapless media file instead of the second gapless media file is received;

discontinuing receiving over the network the metadata and content of the second gapless media file;

synchronizing, by the decoder, first and alternative second audio streams with first and alternative second video segments, respectively; and

assembling, by the decoder, the first and alternative second gapless media files into the seamlessly continuous media stream for playback.

10. The computer-implemented method of claim 9, wherein the first and second audio streams are encoded in an Ogg Vorbis format.

11. The computer-implemented method of claim 9, wherein the first and second video segments are encoded in a Flash video format.

12. The computer-implemented method of claim 9, wherein the first and second video segments comprise video tags and script tags.

13. The computer-implemented method of claim 9, wherein the synchronizing of the first and second audio streams and the assembling of the first and second gapless media files occurs during one of a progressive download or in real-time subsequent to a complete download of the first and second gapless media files at a mobile device.