METHOD AND APPARATUS FOR SMOOTH STREAM SWITCHING IN MPEG/3GPP-DASH

• US 20130282917A1
• Filed: 04/23/2013
• Published: 10/24/2013
• Est. Priority Date: 04/24/2012
• Status: Abandoned Application

• Current Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Original Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Inventors: Reznik, Yuriy, Asbun, Eduardo, Chen, Zhifeng, Vanam, Rahul
• Application Number:
  US13/868,968
• Publication Number:
  US 20130282917A1
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/8451 using Advanced Video Coding [AVC]

Abstract

A method and apparatus for providing smooth stream switching in video and/or audio encoding and decoding may be provided. Smooth stream switching may include the generation and/or display of one or more transition frames that may be utilized between streams of media content encoded at different rates. The transition frames may be generated via crossfading and overlapping, crossfading and transcoding, post-processing techniques using filtering, post-processing techniques using re-quantization, etc. Smooth stream switching may include receiving a first data stream of media content characterized by a first signal-to-noise ratio (SNR) and a second data stream of the media content characterized by a second SNR. Transition frames may be generated using at least one of frames of the first data stream and frames of the second data stream. The transition frames may be characterized by one or more SNR values that are between the first SNR and the second SNR.

Claims

1. A method of performing smooth stream switching of media content, the method comprising:

receiving a first encoded data stream of the media content, the first encoded data stream characterized by a first signal-to-noise ratio (SNR);

receiving a second encoded data stream of the media content, the second encoded data stream characterized by a second SNR;

generating transition frames using at least one of frames of the first encoded data stream characterized by the first SNR and frames of the second encoded data stream characterized by the second SNR, the transition frames characterized by one or more SNR values that are between the first SNR and the second SNR.

2. The method of claim 1, further comprising:

displaying one or more frames of the first encoded data stream;

displaying the transition frames; and

displaying one or more frames of the second encoded data stream.

3. The method of claim 1, wherein generating the transition frames comprises:

crossfading the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames.

4. The method of claim 3, wherein crossfading comprises:

calculating a weighted average of the frames characterized by the first SNR and the frames characterized by the second SNR to generate the transition frames, wherein the weighted average changes over time.

5. The method of claim 3, wherein the transition frames are characterized by a transition time interval, and wherein crossfading comprises:

calculating a weighted average of the frames characterized by the first SNR and the frames characterized by the second SNR by applying a first weight to the frames characterized by the first SNR and a second weight to the frames characterized by the second SNR; and

wherein at least one of the first weight and the second weight changes over the transition time interval.

6. The method of claim 3, wherein the crossfading is performed using a linear transition between the first date stream and the second encoded data stream.

7. The method of claim 3, wherein the crossfading is performed using a non-linear transition between the first date stream and the second encoded data stream.

8. The method of claim 3, wherein the first encoded data stream and second encoded data stream comprise overlapping frames of the media content;

and

wherein crossfading the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames comprises crossfading the overlapping frames of the first encoded data stream and the second encoded data stream to generate the transition frames.

9. The method of claim 8, wherein the overlapping frames are characterized by corresponding frames of the first encoded data stream and of the second encoded data stream, and wherein the overlapping frames are characterized by an overlap time interval.

10. The method of claim 9, further comprising:

displaying one or more frames of the first encoded data stream before the overlap time interval;

displaying the transition frames during the overlap time interval; and

displaying one or more frames of the second encoded data stream after the overlap time interval;

wherein the one or more frames of the first encoded data stream are characterized by times preceding the overlap time interval and the one or more frames of the second encoded data stream are characterized by times succeeding the overlap time interval.

11. The method of claim 3, further comprising:

transcoding a subset of frames of the first encoded data stream to generate corresponding frames characterized by the second SNR; and

wherein crossfading the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames comprises crossfading the subset of frames of the first encoded data stream with the corresponding frames characterized by the second SNR to generate the transition frames.

12. The method of claim 1, wherein the transition frames are characterized by a transition time interval, and wherein generating the transition frames comprises:

filtering the frames characterized by the first SNR using a low-pass filter characterized by a cutoff frequency that changes over the transition time interval to generate the transition frames.

13. The method of claim 1, wherein generating the transition frames comprises:

transforming and quantizing the frames characterized by the first SNR using one or more of step sizes to generate the transition frames.

14. The method of claim 1, wherein the first SNR is greater than the second SNR.

15. The method of claim 1, wherein the first SNR is less than the second SNR.

16. The method of claim 1, wherein the media content comprises video.

17. A wireless transmit/receive unit (WTRU) comprising:

a processor configured to;

receive a first encoded data stream of the media content, the first encoded data stream characterized by a first signal-to-noise ratio (SNR);

receive a second encoded data stream of the media content, the second encoded data stream characterized by a second SNR;

generate transition frames using at least one of frames of the first encoded data stream characterized by the first SNR and frames of the second encoded data stream characterized by the second SNR, the transition frames characterized by one or more SNR values that are between the first SNR and the second SNR.

18. The WTRU of claim 17, wherein the processor is further configured to:

display one or more frames of the first encoded data stream;

display the transition frames; and

display one or more frames of the second encoded data stream.

19. The WTRU of claim 17, wherein the processor configured to generate the transition frames comprises the processor configured to:

crossfade the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames.

20. The WTRU of claim 19, wherein the processor configured to crossfade the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames comprises the processor configured to:

calculate a weighted average of the frames characterized by the first SNR and the frames characterized by the second SNR to generate the transition frames, wherein the weighted average changes over time.

21. The WTRU of claim 19, wherein the transition frames are characterized by a transition time interval, and wherein the processor configured to crossfade the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames comprises the processor configured to:

calculate a weighted average of the frames characterized by the first SNR and the frames characterized by the second SNR by applying a first weight to the frames characterized by the first SNR and a second weight to the frames characterized by the second SNR; and

wherein at least one of the first weight and the second weight changes over the transition time interval.

22. The WTRU of claim 19, wherein the crossfade is performed using a linear transition between the first date stream and the second encoded data stream.

23. The WTRU of claim 19, wherein the crossfade is performed using a non-linear transition between the first date stream and the second encoded data stream.

24. The WTRU of claim 19, wherein the first encoded data stream and second encoded data stream comprise overlapping frames of the media content;

and

wherein the processor configured to crossfade the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames comprises the processor configured to crossfade the overlapping frames of the first encoded data stream and the second encoded data stream to generate the transition frames.

25. The WTRU of claim 24, wherein the overlapping frames are characterized by corresponding frames of the first encoded data stream and of the second encoded data stream, and wherein the overlapping frames are characterized by an overlap time interval.

26. The WTRU of claim 25, wherein the processor is further configured to:

display one or more frames of the first encoded data stream before the overlap time interval;

display the transition frames during the overlap time interval; and

display one or more frames of the second encoded data stream after the overlap time interval;

wherein the one or more frames of the first encoded data stream are characterized by times preceding the overlap time interval and the one or more frames of the second encoded data stream are characterized by times succeeding the overlap time interval.

27. The WTRU of claim 19, wherein the processor is further configured to:

transcode a subset of frames of the first encoded data stream to generate corresponding frames characterized by the second SNR; and

wherein the processor configured to crossfade the frames characterized by the first SNR with the frames characterized by the second SNR to generate the transition frames comprises the processor configured to crossfade the subset of frames of the first encoded data stream with the corresponding frames characterized by the second SNR to generate the transition frames.

28. The WTRU of claim 17, wherein the transition frames are characterized by a transition time interval, and wherein the processor configured to generate the transition frames comprises the processor configured to:

filter the frames characterized by the first SNR using a low-pass filter characterized by a cutoff frequency that changes over the transition time interval to generate the transition frames.

29. The WTRU of claim 17, wherein the processor configured to generate the transition frames comprises the processor configured to:

transform and quantize the frames characterized by the first SNR using one or more of step sizes to generate the transition frames.

30. The WTRU of claim 17, wherein the first SNR is greater than the second SNR.

31. The WTRU of claim 17, wherein the first SNR is less than the second SNR.

32. The WTRU of claim 17, wherein the media content comprises video.