Method and apparatus for scrub preview services

• US 9,602,849 B2
• Filed: 09/15/2011
• Issued: 03/21/2017
• Est. Priority Date: 09/17/2010
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Lin, Kui, Yu, Hong Heather, Li, Hongbing
• Primary Examiner(s): Gaffin, Jeffrey A
• Assistant Examiner(s): HUERTAS TORRES, AYESHA E
• Application Number:
  US13/233,928
• Publication Number:
  US 20120070129A1
• Time in Patent Office: 2,014 Days
• Field of Search: 709/206, 715/719, 715/273
• US Class Current: 1/1
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

In accordance with an embodiment of the present invention, a method of streaming a media preview includes delivering a preview data having preview information from a media file to be streamed. The preview data has a multi-dimensional hierarchical data structure has a plurality of layers with increasing content of the preview information in each layer of the plurality of layers. The preview data is configured to provide an adaptive and scalable preview service.

Claims

1. A method of streaming a media preview of a media over a network, the method comprising:

receiving a request to deliver a preview data comprising preview information for a media file being streamed to a client through the network, wherein the preview data comprises a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, wherein the preview data is configured to provide an adaptive and scalable preview service, wherein the preview data comprises scrub description information, wherein the preview data comprises a plurality of preview locations on a timeline of the media file being streamed, and wherein each preview location is associated with a corresponding time frame on the timeline of the media file being streamed; and

delivering preview information to be displayed at the client through the network, wherein the preview information is from a layer of the plurality of layers of the preview data, wherein delivering preview information to be displayed at the client through the network comprises;

receiving a request for the preview data;

determining whether bandwidth is available for sending a manifest file without causing playback jitter while rendering the media file to be streamed;

sending the manifest file in response to determining that bandwidth is available for sending the manifest file; and

performing bit rate adaptation and then sending the manifest file in response to determining that bandwidth is not available for sending the manifest file.

2. The method of claim 1, wherein the adaptive and scalable preview service provides a differentiated preview service.

3. The method of claim 1, wherein the preview data comprises preview data type information.

4. The method of claim 3, wherein delivering preview information to be displayed at the client through the network comprises:

receiving a service request from the client;

generating an instantaneous user service profile identifying a layer of preview data for each type of preview data;

identifying the layer of the preview data in the instantaneous user service profile to be transmitted;

extracting a specific preview information in the layer of the preview data; and

sending the specific preview information to the client.

5. The method of claim 3, wherein delivering preview information to be displayed at the client through the network comprises:

receiving a user parameter from a client over the network;

defining a preview description data and/or network transmission parameters based on the user parameter; and

using the defined preview description data and/or network transmission parameters, sending the preview description data to the client over the network.

6. The method of claim 1, wherein delivering preview information to be displayed at the client through the network comprises:

sending a manifest file comprising additional description and/or metadata;

sending an index file after sending the manifest file; and

sending a scrub description file comprising the scrub description information, wherein the manifest file, the index file, and the scrub description file are sent without causing playback jitter while rendering the media file to be streamed, and wherein the index file describes the structure of the scrub description file.

7. The method of claim 1, wherein delivering preview information to be displayed at the client through the network further comprises:

determining whether bandwidth is available for sending an index file without causing playback jitter while rendering the media file to be streamed;

sending the index file if bandwidth is available for sending the index file, the index file being started to send after completing sending the manifest file; and

performing bit rate adaptation if bandwidth is not available for sending the index file.

8. The method of claim 1, wherein delivering preview information to be displayed at the client through the network further comprises:

determining whether bandwidth is available for sending a first scrub file comprising a first layer of a scrub description without causing playback jitter while rendering the media file to be streamed;

sending the first scrub file if bandwidth is available for sending the first scrub file;

performing bit rate adaptation if bandwidth is not available for sending the first scrub file;

determining whether bandwidth is available for sending a second scrub file comprising a k^th layer of the scrub description without causing playback jitter while rendering the media file to be streamed, wherein the k^th layer is any layer from the plurality of layers of the multi-dimensional hierarchical data structure;

sending the second scrub file if bandwidth is available for sending the second scrub file, the second scrub file being started to send after completing sending the first scrub file; and

performing bit rate adaptation if bandwidth is not available for sending the second scrub file.

9. The method of claim 8, wherein sending of the first scrub file is started after completing sending an index file.

10. The method of claim 1, wherein delivering preview information to be displayed at the client through the network comprises:

determining whether bandwidth is available for sending a first scrub file comprising a k¹ layer of a scrub description without causing playback jitter while rendering the media file to be streamed;

sending the first scrub file if bandwidth is available for sending the first scrub file;

performing bit rate adaptation if bandwidth is not available for sending the first scrub file;

determining whether bandwidth is available for sending a second scrub file comprising a k^q layer of the scrub description without causing playback jitter while rendering the media file to be streamed, wherein the k¹ layer and the k^q layer are layers from the plurality of layers of the multi-dimensional hierarchical data structure, and wherein the k¹ layer and the k^q layer are selected based on a decision criterion;

sending the second scrub file if bandwidth is available for sending the second scrub file, the second scrub file being started to send after completing sending the first scrub file; and

performing bit rate adaptation if bandwidth is not available for sending the second scrub file.

11. The method of claim 10, wherein the decision criterion comprises selecting a level of granularity from the plurality of layers.

12. The method of claim 11, wherein the decision criterion is selected a

13. The method of claim 12, wherein the granularity selection parameter g^q is specified by a media player.

14. The method of claim 12, wherein the granularity selection parameter g^q is specified by a user preference function and/or a bandwidth adaptation function.

15. The method of claim 10, wherein sending of the first scrub file is started after completing sending an index file.

16. The method of claim 1, wherein the preview data comprises scrub description information and keyframe images.

17. The method of claim 16, wherein delivering the preview information to be displayed at the client through the network comprises, at each layer, sending the scrub description information and then sending the keyframe images.

18. The method of claim 16, wherein, at each layer, the scrub description information and keyframe images are combined into a single dual view preview data file, and wherein delivering the preview data comprises sending the single dual view preview data file.

19. The method of claim 1, wherein the preview data comprises scrub preview configured to be displayed when a play-head is moved forward or backward along a preview bar.

20. An apparatus for streaming a media preview of a media over a network, the apparatus comprising:

a preview data sender configured to receive a request to deliver a preview data to a client through the network, the preview data comprising preview information for a media file being streamed, wherein the preview data comprises a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, wherein the preview data sender is configured to provide an adaptive and scalable preview service, wherein the preview data comprises scrub description information, wherein the preview data comprises a plurality of preview locations on a timeline of the media file being streamed, and wherein each preview location is associated with a corresponding time frame on the timeline of the media file being streamed; and

wherein the preview data sender is further configured to deliver the layer of the preview data comprising preview information to be displayed at the client through the network, wherein the preview data sender comprises;

a preview data request receiver configured to receive a request for the preview data;

a manifest file bandwidth determinator configured to determine whether bandwidth is available for sending a manifest file without causing playback jitter while rendering the media file to be streamed;

a manifest file bit rate adaptor configured to perform bit rate adaptation in response to the manifest file bandwidth determinator determining that bandwidth is not available for sending the manifest file; and

a manifest file sender configured to

send the manifest file in response to the manifest file bandwidth determinator determining that bandwidth is available for sending the manifest file,

send the manifest file after performing bit rate adaptation in response to the manifest file bandwidth determinator determining that bandwidth is not available for sending the manifest file.

21. The apparatus of claim 20, wherein the adaptive and scalable preview service provides a differentiated preview service.

22. The apparatus of claim 20, wherein the preview data comprises preview data type information.

23. The apparatus of claim 22, wherein the preview data sender comprises:

a service request receiver configured to receive a service request from a client;

an instantaneous user service profile generator configured to generate an instantaneous user service profile identifying a layer of preview data for each type of preview data;

a layer identifier configured to identify the layer of the preview data in the instantaneous user service profile to be transmitted;

a preview information extractor configured to extract a specific preview information in the layer of the preview data; and

a preview information sender configured to send the specific preview information to the client.

24. The apparatus of claim 22, wherein the preview data sender comprises:

a user parameter receiver configured to receive a user parameter from a client;

a preview description data estimator configured to define a preview description data and/or network transmission parameters based on the user parameter; and

a preview description data sender configured to send the preview description data to the client using the defined preview description data and/or network transmission parameters.

25. The apparatus of claim 20, wherein the preview data sender comprises:

a manifest file sender configured to send a manifest file comprising additional description and/or metadata;

an index file sender configured to send an index file after sending the manifest file; and

a scrub description file sender configured to send a scrub description file comprising the scrub description information, wherein the manifest file, the index file, and the scrub description file are configured to be sent without causing playback jitter while rendering the media file to be streamed, and wherein the index file describes the structure of the scrub description file.

26. The apparatus of claim 20, wherein the preview data sender further comprises:

an index file bandwidth determinator configured to determine whether bandwidth is available for sending an index file without causing playback jitter while rendering the media file to be streamed;

an index file sender configured to send the index file if bandwidth is available for sending the index file, the index file sender configured to start sending the index file after completing sending the manifest file by the manifest file sender; and

an index file bit rate adaptor configured to perform bit rate adaptation if bandwidth is not available for sending the index file.

27. The apparatus of claim 20, wherein the preview data sender comprises:

a first scrub file determinator configured to determine whether bandwidth is available for sending a first scrub file comprising a first layer of a scrub description without causing playback jitter while rendering the media file to be streamed;

a first scrub file sender configured to send the first scrub file if bandwidth is available for sending the first scrub file;

a first scrub file bit rate adaptor configured to perform bit rate adaptation if bandwidth is not available for sending the first scrub file;

a second scrub file determinator configured to determine whether bandwidth is available for sending a second scrub file comprising a k^th layer of the scrub description without causing playback jitter while rendering the media file to be streamed, wherein the k^th layer is any layer from the plurality of layers of the multi-dimensional hierarchical data structure;

a second scrub file sender configured to send the second scrub file if bandwidth is available for sending the second scrub file, the second scrub file sender configured to start sending the second scrub file after the first scrub file sender completes sending the first scrub file; and

a second scrub file bit rate adaptor configured to perform bit rate adaptation if bandwidth is not available for sending the second scrub file.

28. The apparatus of claim 27, wherein the first scrub file sender starts sending the first scrub file after an index file sender completes sending an index file.

29. The apparatus of claim 20, wherein the preview data sender comprises:

a first scrub file determinator configured to determine whether bandwidth is available for sending a first scrub file comprising a k¹ layer of a scrub description without causing playback jitter while rendering the media file to be streamed;

a first scrub file sender configured to send the first scrub file if bandwidth is available for sending the first scrub file;

a first scrub file bit rate adaptor configured to perform bit rate adaptation if bandwidth is not available for sending the first scrub file;

a second scrub file determinator configured to determine whether bandwidth is available for sending a second scrub file comprising a k^q layer of the scrub description without causing playback jitter while rendering the media file to be streamed, wherein the k¹ layer and the k^q layer are layers from the plurality of layers of the multi-dimensional hierarchical data structure, and wherein the k¹ layer and the k^q layer are selected based on a decision criterion;

a second scrub file sender configured to send the second scrub file if bandwidth is available for sending the second scrub file, the second scrub file sender configured to start sending the second scrub file after the first scrub file sender finishes sending the first scrub file; and

a second scrub file bit rate adaptor configured to perform bit rate adaptation if bandwidth is not available for sending the second scrub file.

30. The apparatus of claim 29, wherein the decision criterion comprises a level of granularity from the plurality of layers.

31. The apparatus of claim 30, wherein the decision criterion is given by a formula

32. The apparatus of claim 31, wherein the granularity selection parameter g^q is specified by a media player.

33. The apparatus of claim 31, wherein the granularity selection parameter g^q is specified by a user preference function and/or a bandwidth adaptation function.

34. The apparatus of claim 29, wherein the first scrub file sender starts sending the first scrub file after an index file sender completes sending an index file.

35. The apparatus of claim 20, wherein the preview data comprises scrub description information and keyframe images.

36. The apparatus of claim 35, wherein the preview data sender comprises, at each layer, a scrub description information sender configured to send the scrub description information and then send the keyframe images.

37. The apparatus of claim 35, further comprising a combinator configured to combine the scrub description information and keyframe images into a single dual view preview data file at each layer, and wherein the preview data sender is configured to send the single dual view preview data file.

38. The apparatus of claim 20, wherein the preview data comprises scrub preview configured to be displayed when a play-head is moved forward or backward along a preview bar.