System and method for splicing

• US 8,218,651 B1
• Filed: 02/28/2007
• Issued: 07/10/2012
• Est. Priority Date: 02/28/2006
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: ARRIS Group, Inc. (CommScope Holding Company, Inc.)
• Inventors: Eshet, Amit, Assouline, Lior, Stein, Edward
• Primary Examiner(s): Shiferaw, Eleni
• Assistant Examiner(s): Fields, Courtney
• Application Number:
  US11/680,172
• Time in Patent Office: 1,959 Days
• Field of Search: 375/240.26, 375/240.05, 370/504, 348/515
• US Class Current: 375/240.26
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A method for splicing a first data stream that conveys a first single program transport stream (SPTS) and a second data stream that conveys a second SPTS, the method includes: receiving first data stream metadata units representative of first data stream packets, second data stream metadata units representative of second data stream packets and a request to perform a splicing operation at a n′th splicing point; performing, in response to the splicing request, transport stream layer processing of the first data stream metadata units and of the second data stream metadata units such as to provide a control output stream; and transmitting an output stream in response to the control output stream.

Claims

1. A method for splicing a first data stream that conveys a first single program transport stream (SPTS) and a second data stream that conveys a second SPTS, the method comprises:

receiving first data stream metadata units representative of first data stream packets, second data stream metadata units representative of second data stream packets and a request to perform a splicing operation at a n′

th splicing point;

performing, in response to the splicing request, transport stream layer processing of the first data stream metadata units and of the second data stream metadata units to provide a control output stream; and

transmitting an output stream in response to the control output stream;

wherein the performing of the transport stream layer processing comprises;

sorting first data stream metadata units and second data stream metadata units in response to timing information associated with the first and second data stream metadata units and in response to a n′

th video out time, a n′

th video in time, a n′

th audio in time and a n′

th audio out time;

selectively generating output stream metadata units representative of entitled control messages to be inserted between a splicing event from the first SPTS to another splicing event to the first SPTS, wherein the first SPTS is encrypted;

and performing the transport stream layer processing of the first and second data stream metadata units after retrieving the first and second data stream metadata units from a first and second data streams metadata memory unit that differs from an output queue that stores first and second data stream data packets.

2. The method according to claim 1 wherein the transmitting comprises multiplexing between audio data packets and video data packets between a video out point and an audio in point.

3. The method according to claim 2 wherein the multiplexing comprises delaying or splitting video data packets that overlap audio data packets.

4. The method according to claim 1 wherein the transmitting comprises transmitting output stream data packets that comprises an interleaved set of first SPTS audio frames and second SPTS video frames.

5. The method according to claim 1 wherein the stage of performing transport stream layer processing comprises preventing frames of the second SPTS to refer to frames of the first SPTS by adding a transparent frame and nullifying a data packet.

6. The method according to claim 1 wherein the stage of performing transport stream layer processing is preceded by repetitively evaluating whether to perform slicing until receiving a positive evaluation.

7. The method according to claim 1 wherein the second SPTS is an advertisement program.

8. The method according to claim 1 wherein the stage of performing transport stream layer processing comprises sorting first data stream metadata units and second data stream metadata units in response to timing information associated with the first and second data stream metadata units and in response to the n′

th video out time, the n′

th video in time, the e n′

th audio in time and the n′

th audio out time.

9. The method according to claim 1 wherein the stage of performing transport stream layer processing comprises selectively generating output data stream metadata representative of an output stream discontinuity indicator data packet that comprises a transport header, a packetised elementary stream header and a substantially empty packetised elementary stream payload, wherein the transport header comprises a discontinuity indicator;

and wherein the transmitting further comprises transmitting an output stream that comprises at least one output stream discontinuity indicator data packet.

10. The method according to claim 1 wherein the stage of performing transport stream layer processing comprises selectively altering program clock reference, PTS and DTS values and selectively inserting black frames to prevent video buffer overflow and to prevent overlap of video from the first and second SPTS.

11. The method according to claim 1 further comprising receiving a request to perform a splicing operation at a (n+1)^th splicing point;

wherein the first SPTS is characterized by a first video frame interval; and

wherein the stage of performing transport stream layer processing comprises preventing a timing gap between the (n+1)^th video out time and the (n+1)^th video in time that is smaller than the first video frame interval.

12. The method according to claim 11 wherein the preventing comprises reducing the timing gap by inserting at least one blank video frame at the video frame rate of the first SPTS to minimize the timing gap.

13. The method according to claim 11 wherein the stage of performing transport stream layer processing comprises selectively generating output data stream metadata representative of an output stream discontinuity indicator data packet that comprises a transport packet header and a substantially empty transport packet payload, wherein the transport packet header comprises a discontinuity indicator.

14. The method according to claim 1 wherein the first SPTS is encrypted;

and wherein the stage of performing transport stream layer processing comprises selectively generating output stream metadata units representative of entitled control messages to be inserted between a splicing event from the first SPTS to another splicing event to the first SPTS.

15. The method according to claim 14 wherein the stage of performing transport stream layer processing comprises generating a control output stream that is representative of changes in timing of audio conveying data packets transmission;

and wherein the generating of output stream metadata units representative of entitled control messages is responsive to the changes in the timing of the transmissions.

16. The method according to claim 14 wherein the stage of selectively generating output stream metadata units comprises inserting an entitled control messages to enable a decryption of the first SPTS immediately after the (n+1)th video in time.

17. The method according to claim 1 wherein each of the first SPTS and the second SPTS comprises multiple frames, each frame comprises a first frame portion and a second frame portion;

wherein each of the first SPTS and the second SPTS comprises an interleaved sequence of first and second frames portions;

wherein the processing comprises generating a black set output data stream metadata representative of a set of black frames that comprises a first black frame portion, a second black frame portion and a first black portion; and

wherein the assembling comprises assembling a control output stream that comprises the black set output data stream metadata if a last first data stream packet before the video out time ends with a second frame portion and a first second data stream packet after the video out time starts with a second frame portion.

18. The method according to claim 1 wherein the transmitting comprises transmitting an output stream that is characterized by a bit rate that does not exceed a maximal bit rate and has a sustained bit rate that is substantially equal to a sustained bit rate of a selected SPTS out of the first and second SPTS.

19. The method according to claim 1 wherein the stage of performing transport stream layer processing comprises selectively altering PTS and DTS values and selectively inserting mute frames to prevent audio buffer overflow and to prevent overlap of audio from the first and the second SPTS.

20. The method according to claim 1 wherein the transmitting comprises transmitting output stream data packets that comprises an interleaved set of first SPTS audio frames and second SPTS audio frames;

wherein the interleaved set is transmitted at a bit rate that exceeds a maximal bit rate of the first SPTS audio frames and a maximal bit rate of the second SPTS audio frames.

21. The method according to claim 1 wherein the transmitting comprising transmitting output stream data packets that are associated with the second data stream at an output stream bit rate that substantially equals a bit rate of the second data stream.

22. The method according to claim 1 wherein the transmitting comprising limiting a bit rate of the output stream below a maximal allowed bit rate.

23. The method according to claim 1 wherein the stage of transmitting comprises speeding up the transmission of audio conveying data packets.

24. The method according to claim 1 further comprising determining a transmission time of media conveying data packets in response to video timing information associated with the media streams conveyed by the data packets and in response to transmission timing associated with the data packets.

25. The method according to claim 1 further comprising performing data layer processing.

26. The method according to claim 25 further comprising minimizing data layer processing operations.

27. The method according to claim 1 further comprising selectively altering PTS and DTS values and selectively inserting mute frames to prevent audio buffer overflow and to prevent overlap of audio from the first and the second SPTS.

28. The method according to claim 1 further comprising transmitting output stream data packets that comprises an interleaved set of first SPTS audio frames and second SPTS audio frames;

wherein the transmitting comprises transmitting the interleaved set at a bit rate that exceeds a maximal bit rate of the first SPTS audio frames and a maximal bit rate of the second SPTS audio frames.

29. The method according to claim 1 further comprising transmitting output stream data packets that are associated with the second data stream at an output stream bit rate that substantially equals a bit rate of the second data stream.

30. A splicing system adapted to splice a first data stream that conveys a first single program transport stream (SPTS) and a second data stream that conveys a second SPTS, the splicing system comprises:

a memory unit adapted to store first data stream metadata units representative of first data stream packets and second data stream metadata units representative of second data stream packets; and

a processor, adapted to perform, in response a request to perform a splicing operation at a n′

th splicing point, transport stream layer processing of the first data stream metadata units and of the second data stream metadata units to provide a control output stream; and

wherein the system is adapted to transmit an output stream in response to the control output stream;

wherein the processor is arranged to perform transport layer processing that comprises;

sort first data stream metadata units and second data stream metadata units in response to timing information associated with the first and second data stream metadata units and in response to a n′

th video out time, a n′

th video in time, a n′

th audio in time and a n′

th audio out time;

selectively generate output stream metadata units representative of entitled control messages to be inserted between a splicing event from the first SPTS to another splicing event to the first SPTS, wherein the first SPTS is encrypted; and

perform the transport stream layer processing of the first and second data stream metadata units after a retrieval of the first and second data stream metadata units from a first and second data streams metadata memory unit that differs from an output queue that stores first and second data stream data packets.

31. The splicing system according to claim 30 further adapted to multiplex between audio data packets and video data packets between a video out point and an audio in point.

32. The splicing system according to claim 31 wherein the processor is adapted to delay or split video data packet that overlap audio data packets.

33. The splicing system according to claim 30 further adapted to transmit, at a bit rate that exceeds a maximal bit rate of the first SPTS audio frames and a maximal bit rate of the second SPTS video frames, output stream data packets that comprises an interleaved set of first SPTS audio frames and second SPTS video frames.

34. The splicing system according to claim 30 wherein the processor is adapted to prevent frames of the second SPTS to refer to frames of the first SPTS by adding a transparent frame and nullifying a data packet.

35. The splicing system according to claim 30 wherein the processor is adapted to repetitively evaluate whether to perform slicing until receiving a positive evaluation.

36. The splicing system according to claim 30 wherein the processor is adapted to splice a second SPTS that is an advertisement program.

37. The splicing system according to claim 30 wherein the processor is adapted to sort first data stream metadata units and second data stream metadata units in response to timing information associated with the first and second data stream metadata units and in response to the n′

th video out time, the n′

th video in time, the n′

th audio in time and the n′

th audio out time.

38. The splicing system according to claim 30 wherein the processor is adapted to selectively generate output data stream metadata representative of an output stream discontinuity indicator data packet that comprises a transport packet header and a substantially empty transport packet payload, wherein the transport packet header comprises a discontinuity indicator.

39. The splicing system according to claim 30 wherein the processor is adapted to selectively alter program clock reference, DTS and PTS values and selectively insert black frames to prevent video buffer overflow and to prevent overlap of video from the first and second SPTS.

40. The splicing system according to claim 30 wherein the processor is adapted to further prevent a timing gap between a (n+1^)th video out time and a (n+1^)th video in time that is smaller than a video frame interval of the first SPTS.

41. The splicing system according to claim 40 wherein the processor is adapted to reduce the timing gap by inserting at least one blank video frame at video frame rate of the first SPTS.

42. The splicing system according to claim 30 wherein the processor is adapted to selectively generate output data stream metadata representative of an output stream discontinuity indicator data packet that comprises a transport packet header and a substantially empty transport packet payload, wherein the transport packet header comprises a discontinuity indicator.

43. The splicing system according to claim 42 wherein the first SPTS is encrypted;

and wherein the processor is adapted to selectively generate output stream metadata units representative of entitled control messages to be inserted between a splicing event from the first SPTS to another splicing event to the first SPTS.

44. The splicing system according to claim 42 wherein the processor is adapted to generate a control output stream that is representative of changes in timing of transmission audio conveying data packets;

and to generate output stream metadata units representative of entitled control messages in response to the changes in the timing of the transmissions.

45. The splicing system according to claim 42 wherein the processor is adapted to insert an entitled control messages to enable a decryption of the first SPTS immediately after the (n+1)th video in time.

46. The splicing system according to claim 42 wherein each of the first SPTS and the second SPTS comprises multiple frames, each frame comprises a first frame portion and a second frame portion;

wherein each of the first SPTS and the second SPTS comprises an interleaved sequence of first and second frames portions;

wherein the processor is adapted to comprises generate a black set output data stream metadata representative of a set of black frames that comprises a first black frame portion, a second black frame portion and a first black portion; and

to assemble a control output stream that comprises the black set output data stream metadata if a last first data stream packet before the video out time ends with a second frame portion and a first second data stream packet after the video out time starts with a second frame portion.

47. The splicing system according to claim 42 wherein the processor is adapted to transmit an output stream that is characterized by a bit rate that does not exceed a maximal bit rate and has a sustained bit rate that is substantially equal to a sustained bit rate of a selected SPTS out of the first and second SPTS.

48. The splicing system according to claim 30 further adapted to prevent overlaps between video data packets of the second data stream that precede an n′

th audio point in time and between video data packets of the second data stream that start from the n′

th audio in point.

49. The splicing system according to claim 30 further adapted to perform data layer processing.

50. The splicing system according to claim 30 further adapted to minimize data layer processing operations.

51. The splicing system according to claim 30 further adapted to selectively alter PTS and DTS values and selectively insert mute frames to prevent audio buffer overflow and to prevent overlap of audio from the first and the second SPTS.

52. The splicing system according to claim 30 further adapted to transmit output stream data packets that comprises an interleaved set of first SPTS audio frames and second SPTS audio frames;

wherein the splicing system transmits the interleaved set at a bit rate that exceeds a maximal bit rate of the first SPTS audio frames and a maximal bit rate of the second SPTS audio frames.

53. The splicing system according to claim 30 further adapted to transmit output stream data packets that are associated with the second data stream at an output stream bit rate that substantially equals a bit rate of the second data stream.

54. The splicing system according to claim 30 further adapted to limit a bit rate of the output stream below a maximal allowed bit rate.

55. The splicing system according to claim 30 further adapted to speed up the transmission of audio conveying data packets.

56. The splicing system according to claim 30 further adapted to determine a transmission time of media conveying data packets in response to video timing information associated with the media streams conveyed by the data packets and in response to transmission timing associated with the data packets.