Signaling random access points for streaming video data

• US 9,992,555 B2
• Filed: 06/16/2015
• Issued: 06/05/2018
• Est. Priority Date: 06/29/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Ying, Karczewicz, Marta
• Primary Examiner(s): Haque, Md
• Assistant Examiner(s): Haque, Nazmul
• Application Number:
  US14/741,057
• Publication Number:
  US 20150358382A1
• Time in Patent Office: 1,085 Days
• CPC Class Codes: G11B 27/007 reproducing continuously a part of the information, i.e. repeating
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/3027 used signal is digitally coded
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

This disclosure describes techniques relevant to HTTP streaming of media data. According to these techniques, a server device may signal an open decoding refresh (ODR) random access point (RAP) for a movie segmentation of a movie representation. At least one frame of the media segmentation following the ODR RAP frame in decoding order may not be correctly decoded, and wherein each frame of the media segmentation following the ODR RAP frame in display order can be correctly decoded without relying on content of frames prior to the ODR RAP in display order. According to the techniques of this disclosure, a client device may communicate a request to a server device for the streaming of media data based on signaling of the ODR RAP. Also according to the techniques of this disclosure, a client device may commence decoding and/or playback of the movie representation based on signaling of the ODR RAP.

Claims

1. A method comprising:

receiving, at a client device from a server device, an indication of an open decoding refresh (ODR) random access point (RAP) frame of a media segment comprising a media file conforming substantially to International Organization for Standardization (ISO) Base Media File Format or an extension of the ISO Base Media File Format, wherein the ODR RAP frame is an independently decodable frame that is a member of a group of frames including a first frame that precedes the ODR RAP frame in display order but is decoded after the ODR RAP frame, wherein the first frame can only be decoded using content from a second frame outside of the group of frames, and wherein each frame of the media segment that follows the ODR RAP frame in display order can be correctly decoded without relying on content of frames prior to the ODR RAP frame in display order; and

sending, by the client device, a request to the server device to retrieve a stream of media data starting with at least a portion of the media segment that contains the indicated ODR RAP frame.

2. The method of claim 1, further comprising:

receiving, at the client device, at least one indication of whether the ODR RAP frame is the first frame of the media segment; and

wherein sending the request comprises sending the request to the server device to retrieve the stream of media data starting with the media segment that contains the indicated ODR RAP frame.

3. The method of claim 1, further comprising:

receiving, at the client device, at least one indication of an offset between a first frame of the media segment and the ODR RAP frame, if the ODR RAP frame is not the first frame of the media segment, wherein the offset describes a number of frames between the first frame of the media segment and the ODR RAP frame; and

decoding the stream of media data beginning with the ODR RAP frame of the media segment.

4. The method of claim 1, further comprising:

receiving, at the client device, at least one indication of a byte offset between a first byte of the media segment and a first byte of the ODR RAP frame; and

wherein sending the request to the server device to retrieve the stream of media data comprises sending the request to retrieve a portion of the stream of media data from the first byte of the ODR RAP frame to at least an end of the media segment.

5. The method of claim 1, further comprising:

constructing the request as a hypertext transfer protocol (HTTP) Get request to retrieve the stream starting at a beginning of the media segment that contains the ODR RAP frame.

6. The method of claim 1, wherein the indication comprises an indication of a number of frames having a presentation time less than a presentation time of the ODR RAP frame within the media segment, the method further comprising:

skipping decoding of the number of frames having a presentation time less than the presentation time of the ODR RAP frame.

7. A non-transitory computer-readable storage medium comprising instructions that, when executed, cause a processor of a client computing device to:

receive, at a client device from a server device, an indication of an open decoding refresh (ODR) random access point (RAP) frame of a media segment comprising a media file conforming substantially to International Organization for Standardization (ISO) Base Media File Format or an extension of the ISO Base Media File Format, wherein the ODR RAP frame is an independently decodable frame that is a member of a group of frames including a first frame that precedes the ODR RAP frame in display order but is decoded after the ODR RAP frame, wherein the first frame can only be decoded using content from a second frame outside of the group of frames, and wherein each frame of the media segment that follows the ODR RAP frame in display order can be correctly decoded without relying on content of frames prior to the ODR RAP frame in display order; and

send, by the client device, a request to the server device to retrieve a stream of media data starting with at least a portion of the media segment that contains the indicated ODR RAP frame.

8. The non-transitory computer-readable storage medium of claim 7, further comprising instructions that cause the processor to receive at least one indication of whether the ODR RAP frame is the first frame of the media segment, wherein the instructions that cause the processor to send the request comprise instructions that cause the processor to send the request to the server device to retrieve the stream of media data starting with the media segment that contains the indicated ODR RAP frame.

9. The non-transitory computer-readable storage medium of claim 7, further comprising instructions that cause the processor to:

receive, at the client device, at least one indication of an offset between a first frame of the media segment and the ODR RAP frame, if the ODR RAP frame is not the first frame of the media segment, wherein the offset describes a number of frames between the first frame of the media segment and the ODR RAP frame; and

decode the stream of media data beginning with the ODR RAP frame of the media segment.

10. The non-transitory computer-readable storage medium of claim 7, further comprising instructions that cause the processor to receive at least one indication of a byte offset between a first byte of the media segment and a first byte of the ODR RAP frame, wherein the instructions that cause the processor to send the request to the server device to retrieve the stream of media data comprise instructions that cause the processor to send the request to retrieve a portion of the stream of media data from the first byte of the ODR RAP frame to at least an end of the media segment.

11. The non-transitory computer-readable storage medium of claim 7, further comprising instructions that cause the processor to construct the request as a hypertext transfer protocol (HTTP) Get request to retrieve the stream starting at a beginning of the media segment that contains the ODR RAP frame.

12. The non-transitory computer-readable storage medium of claim 7, wherein the indication comprises an indication of a number of frames having a presentation time less than a presentation time of the ODR RAP frame within the media segment, the method further comprising:

skipping decoding of the number of frames having a presentation time less than the presentation time of the ODR RAP frame.

13. A device comprising one or more processors configured to:

receive an indication of an open decoding refresh (ODR) random access point (RAP) frame of a media segment comprising a media file conforming substantially to ISO Base Media File Format or an extension of the International Organization for Standardization (ISO) Base Media File Format, wherein the ODR RAP frame is an independently decodable frame that is a member of a group of frames including a first frame that precedes the ODR RAP frame in display order but is decoded after the ODR RAP frame, wherein the first frame can only be decoded using content from a second frame outside of the group of frames, and wherein each frame of the media segment that follows the ODR RAP frame in display order can be correctly decoded without relying on content of frames prior to the ODR RAP frame in display order; and

send a request to the server device to retrieve a stream of media data starting with at least a portion of the media segment that contains the indicated ODR RAP frame.

14. The device of claim 13, wherein the one or more processors are further configured to receive at least one indication of whether the ODR RAP frame is the first frame of the media segment, and send the request to the server device to retrieve the stream of media data starting with the media segment that contains the indicated ODR RAP frame.

15. The device of claim 13, wherein the one or more processors are further configured to:

receive at least one indication of an offset between a first frame of the media segment and the ODR RAP frame, if the ODR RAP frame is not the first frame of the media segment, wherein the offset describes a number of frames between the first frame of the media segment and the ODR RAP frame; and

decode the stream of media data beginning with the ODR RAP frame of the media segment.

16. The device of claim 13, wherein the one or more processors are further configured to receive at least one indication of a byte offset between a first byte of the media segment and a first byte of the ODR RAP frame, and to send the request to retrieve a portion of the stream of media data from the first byte of the ODR RAP frame to at least an end of the media segment.

17. The device of claim 13, wherein the one or more processors are further configured to construct the request as a hypertext transfer protocol (HTTP) Get request to retrieve the stream starting at a beginning of the media segment that contains the ODR RAP frame.

18. The device of claim 13, wherein the indication comprises an indication of a number of frames having a presentation time less than a presentation time of the ODR RAP frame within the media segment, and wherein the one or more processors are further configured to skip decoding of the number of frames having a presentation time less than the presentation time of the ODR RAP frame.

19. The device of claim 13, wherein the device comprises at least one of:

an integrated circuit;

a microprocessor;

or

a wireless communication device.