Stream switching based on gradual decoder refresh

• US 7,552,227 B2
• Filed: 05/19/2004
• Issued: 06/23/2009
• Est. Priority Date: 06/19/2003
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Wang, Ye-Kui
• Primary Examiner(s): Wang; Liangche A
• Application Number:
  US10/848,966
• Publication Number:
  US 20050021814A1
• Time in Patent Office: 1,861 Days
• Field of Search: 709/203, 709/223, 709/224, 709/231, 709/232, 709/238
• US Class Current: 709/231
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip

Abstract

A signaling method and device for use in stream switching in which GDR random access points are used. In order to indicate the GDR switching points in the bitstreams, a Sync Sample Information Box, which is contained in a Sync Sample Box, is used to provide information of such GDR switching points. The information also includes which slice group is the isolated region and which slice group is the leftover region, if slice groups are applied in encoding. The signaling method can be used in video data transmission using Real-time Transport Protocol (RTP), and a Session Description Protocol (SDP) can be used to convey information indicative of the characteristics of the bitstreams.

Claims

1. A signaling method for use in stream switching among a plurality of bitstreams, comprising:

providing in association with the bitstreams information on a switching point at which a first bitstream is caused to switch to a second bitstream, the bitstreams comprising video data indicative of a plurality of video frames, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching, and

providing in association with the second bitstream a distance between the switching point and the recovery point, wherein the switching point is different from the recovery point.

2. The signaling method of claim 1, wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is farther indicative of the isolated region.

3. The signaling method of claim 1,wherein the bitstreams are conveyed from a server device to a client device in a streaming network, and wherein said stream switching is initiated by the server device.

4. The signaling method of claim 1, wherein the bitstreams are conveyed from a server device to a client device in a streaming network, and wherein said stream switching is requested by the client device.

5. The signaling method of claim 1, wherein the signaling method is used in a transmission utilizing Real-time Transport Protocol.

6. The signaling method of claim 4, wherein a Session Description Protocol is used to convey information indicative of characteristics of the first and second bitstreams.

7. The signaling method of claim 1, wherein said stream switching is carried out in transmission of the video data based on transmission conditions between a server device and a client device in a streaming network.

8. A streaming server device adapted for stream switching among a plurality of bitstreams, comprising:

a stream selector configured for selecting from the bitstreams a first bitstream for transmission, wherein the bitstreams comprise at least one switching point at which the first bitstream is caused to switch to a second bitstream, the bitstreams comprising video data indicative of a plurality of video frames, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching; and

a module for providing in association with the bitstreams information on said at least one switching point and providing in association with the second bitstream a distance between the switching point and the recovery point, wherein the stream selector is further configured to select the second bitstream for transmission based on the switching point, and wherein the switching point is different from the recovery point.

9. The streaming server device of claim 8, wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is further indicative of the isolated region.

10. The streaming server device of claim 8, wherein the provided information is used in data transmission utilizing Real-time Transport Protocol.

11. The streaming server device of claim 10, wherein a Session Description Protocol is used to convey information indicative of characteristics of the first and second bitstreams.

12. The streaming server device of claim 8, wherein said stream selector selects the second bitstream for stream switching based on transmission conditions between the streaming server device and a client device in a streaming network.

13. A streaming system adapted for stream switching among a plurality of bitstreams, comprising:

at least one streaming client; and

at least one streaming server for transmitting one of the bitstreams to the streaming client, the bitstreams comprising video data indicative of a plurality of video frames, the streaming client configured to reconstruct the video frames based on the transmitted bitstream, wherein the bitstreams comprise at least one switching point at which a first bitstream is caused to switch to a second bitstream, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching, wherein the streaming server comprises;

a stream selector for selecting from the bitstreams the first bitstream for transmission and for further selecting the second bitstream, and

a module adapted for providing in association with the bitstreams information on said at least one switching point and providing in association with the second bitstream a distance between the switching point and the recovery point, wherein the switching point is different from the recovery point.

14. The streaming system of claim 13, wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is further indicative of the isolated region.

15. The streaming system of claim 13, wherein said stream switching is initiated by the streaming server.

16. The streaming system of claim 13, wherein said stream switching is requested by the streaming client.

17. The streaming system of claim 13, wherein the provided information is used in data transmission utilizing Real-time Transport Protocol.

18. The streaming system of claim 17, wherein a Session Description Protocol is used to convey information indicative of characteristics of the first and second bitstreams.

19. The streaming system of claim 13, wherein said stream selects the second bitstream for stream switching based on transmission conditions between the streaming server and the streaming client.

20. The streaming system of claim 13, further comprising:

a video encoder to convert a video input signal into the video data; and

a coding module, responsive to the video data, for encoding the video data into the plurality of bitstreams.

21. A computer readable storage medium embodied with a software program for use in a streaming system for stream switching among a plurality of bitstreams, said software program comprising:

a code for determining a switching point at which a first bitstream is caused to switch to a second bitstream, the bitstreams comprising video data indicative of a plurality of video frames, and at least one recovery point which defines a first correct or approximately correct picture in output order in the second bitstream decoded subsequent to said stream switching; and

a code for providing in association with the bitstreams information indicating said switching point and providing in association with the second bitstream a distance between the switching point and the recovery point, wherein the switching point is different from the recovery point.

22. The computer readable storage medium of claim 21, wherein each video frame comprises one or more slices and the video frames contain at least one isolated region associated with said one or more slices in the second bitstream decoded subsequent to said stream switching, and wherein the provided information is further indicative of the isolated region.

23. The computer readable storage medium of claim 21, wherein the provided information is used in data transmission utilizing Real-time Transport Protocol.

24. The computer readable storage medium of claim 21, wherein a Session Description Protocol is used to convey information indicative of characteristics of the first and second bitstreams.