Method and apparatus for scrub preview services

• US 9,445,135 B2
• Filed: 09/15/2011
• Issued: 09/13/2016
• Est. Priority Date: 09/17/2010
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Lin, Kui, Yu, Hong Heather, Li, Hongbing
• Primary Examiner(s): HUYNH, THU V
• Application Number:
  US13/233,882
• Publication Number:
  US 20120070125A1
• Time in Patent Office: 1,825 Days
• Field of Search: 715200-203, 715/234, 715/255
• US Class Current: 1/1
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

In accordance with an embodiment of the present invention, a method of streaming media with a media preview includes generating a preview data by extracting preview information from a media file to be streamed. The preview data has a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers. The preview data is configured to provide a differentiated preview service.

Claims

1. A method of generating a media preview of a media stream, the method comprising:

generating a preview data by extracting preview information from a media file to be streamed, wherein generating the preview data comprises generating a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, wherein the preview data is configured to provide an adaptive and scalable preview service, wherein generating the preview data further comprises

generating all of the plurality of layers of the multi-dimensional hierarchical data structure, and

generating a plurality of service profiles associated with a plurality of subscriber levels, wherein each of the plurality of service profiles corresponds to a layer of the plurality of layers of the preview data, wherein one layer of the plurality of layers is configured to be sent depending on a subscriber level, wherein each of the plurality of service profiles corresponds to a different subscriber level of the plurality of subscriber levels, wherein generating each of the plurality of service profiles comprises;

generating service class types offered for the media stream,

generating service class attributes for each of the service class types, and

generating a maximum allowed service class profile for each of the service class types.

2. The method of claim 1, wherein the adaptive and scalable preview service provides a differentiated preview service.

3. The method of claim 1, wherein the multi-dimensional hierarchical data structure comprises a plurality of time segments in one dimension and the plurality of layers in another dimension.

4. The method of claim 1, wherein a first dimension of the multi-dimensional hierarchical data structure comprises degrees of freedom for a number of alternate previews, wherein a second dimension of the multi-dimensional hierarchical data structure comprises a plurality of time segments in one dimension, and wherein a third dimension of the multi-dimensional hierarchical data structure comprises the plurality of layers.

5. The method of claim 1, wherein the preview data comprises preview data type information.

6. The method of claim 5, wherein the preview data type information comprises a data type from the group consisting of preview video data, preview audio data, keyframe images, preview content description text, preview content description image, preview relevant images, and preview relevant text.

7. The method of claim 5, wherein generating each of the plurality of service profiles comprises:

generating the preview data having the preview data type information and multiple layers;

and

generating a default instantaneous user service profile.

8. The method of claim 7, wherein the default instantaneous user service profile is generated based on user preferences, user profile, and/or subscription level.

9. The method of claim 1, wherein the preview data comprises scrub description information.

10. The method of claim 9, wherein generating a preview data comprises:

generating a scrub description file comprising the scrub description information;

generating an index file describing the structure of the scrub description file; and

generating a manifest file comprising additional description and/or metadata.

11. The method of claim 10, wherein generating a scrub description file comprises:

defining a total length of the media stream;

assigning the plurality of layers to the media stream;

for each layer, dividing the media stream into smaller time segments, a duration of time segments increasing with each layer; and

assigning a preview description data for each time segment in each layer.

12. The method of claim 1, wherein the preview data comprises scrub description information and keyframe images.

13. The method of claim 12, wherein generating a preview data comprises generating a scrub description file comprising the scrub description information, and wherein generating a scrub description file comprises adding layers comprising scrub description information to a keyframe based scrub preview comprising the keyframe images.

14. The method of claim 12, wherein generating a scrub description file comprises extracting keyframe images and extracting scrub description data for each time segment of the media file for each layer of the multi-dimensional hierarchical data structure comprising the plurality of layers.

15. The method of claim 1, wherein the preview data comprises additional information in video, image, graph, and/or text form.

16. A method of receiving a media preview of a media, the method comprising:

sending a preview data request to a preview server, the preview data request comprising a request for preview data for a media file being received; and

receiving a preview data comprising preview information for the media file, wherein the preview data comprises a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, wherein each layer of the plurality of layers of the preview data corresponds to a service profile of a plurality of service profiles, wherein service class types offered for streaming the media, service class attributes for each of the service class types, and a maximum allowed service class profile for each of the service class types were generated when the plurality of service profiles was generated;

wherein a end user device receiving the preview data comprises a subscriber level from a plurality of subscriber levels, wherein one layer of the plurality of layers is configured to be received depending on the subscriber level of the end user device, wherein each of the plurality of service profiles corresponds to a different subscriber level of the plurality of subscriber levels, wherein receiving a preview data comprises

receiving a scrub description file comprising scrub description information,

receiving an index file describing the structure of the scrub description file,

receiving a manifest file comprising additional description and/or metadata, and

extracting preview description information from the scrub description file based on the index file and the manifest file, wherein the preview description information comprises one layer of the plurality of layers depending on the subscriber level of the end user device.

17. The method of claim 16, wherein the preview data comprises preview data type information.

18. The method of claim 17, further comprising:

sending a user specified parameter for preview data type to the preview server, wherein the preview data received is based on the user specified parameter.

19. The method of claim 18, wherein the user specified parameter comprises a parameter from the group consisting of low resolution video, medium resolution video, high resolution video, minimum text description, moderate text description, and maximum text description.

20. The method of claim 18, wherein the user specified parameter comprises a parameter from the group consisting of preview video data, preview audio data, keyframe images, preview content description text, preview content description image, preview relevant images, and preview relevant text.

21. The method of claim 16, wherein receiving the preview data further comprises:

rendering the preview description information to a display of an end user media player.

22. The method of claim 16, wherein receiving a preview data comprises:

receiving a first scrub file comprising a first layer of a scrub description; and

receiving a second scrub file comprising a k^th layer of the scrub description, wherein the k^th layer is any layer from the plurality of layers of the multi-dimensional hierarchical data structure.

23. The method of claim 16, wherein receiving a preview data comprises:

receiving a first scrub file comprising a k¹ layer of a scrub description; and

receiving a second scrub file comprising a k^q layer of the scrub description, wherein the k¹ layer and the k^q layer are layers from the plurality of layers of the multi-dimensional hierarchical data structure, and wherein the k¹ layer and the k^q layer are selected based on a decision criterion of selecting a level of granularity from the plurality of layers.

24. The method of claim 23, further comprising:

sending user specified parameter comprising a desired level of granularity for the decision criterion.

25. An apparatus for generating media preview of a media stream, the apparatus comprising:

a processor; and

a non-transitory computer-readable storage medium storing a program to be executed by the processor, the program including instructions for;

generating a preview data by extracting preview information from a media file to be streamed, wherein generating the preview data comprises generating a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers; and

providing preview data for an adaptive and scalable preview service, wherein instructions for generating the preview data further comprises instructions for

generating all of the plurality of layers of the multi-dimensional hierarchical data structure, and

generating a plurality of service profiles associated with a plurality of subscriber levels, wherein each of the plurality of service profiles corresponds to a layer of the plurality of layers of the preview data, wherein one layer of the plurality of layers is configured to be sent depending on a subscriber level, wherein each of the plurality of service profiles corresponds to a different subscriber level of the plurality of subscriber levels, wherein generating the plurality of service profiles comprises;

generating service class types offered for the media stream, generating service class attributes for each of the service class types, and generating a maximum allowed service class profile for each of the service class types.

26. The apparatus of claim 25, wherein the adaptive and scalable preview service provides a differentiated preview service.

27. The apparatus of claim 25, wherein the multi-dimensional hierarchical data structure comprises a plurality of time segments in one dimension and the plurality of layers in another dimension.

28. The apparatus of claim 25, wherein a first dimension of the multi-dimensional hierarchical data structure comprises degrees of freedom for a number of alternate previews, wherein a second dimension of the multi-dimensional hierarchical data structure comprises a plurality of time segments in one dimension, and wherein a third dimension of the multi-dimensional hierarchical data structure comprises the plurality of layers.

29. The apparatus of claim 25, wherein the preview data comprises preview data type information.

30. The apparatus of claim 29, wherein the preview data type information comprises a data type from the group consisting of preview video data, preview audio data, keyframe images, preview content description text, preview content description image, preview relevant images, and preview relevant text.

31. The apparatus of claim 29, wherein the instructions for generating a plurality of service profiles comprises instructions for:

generating the preview data having the preview data type information and multiple layers;

and

generating a default instantaneous user service profile.

32. The apparatus of claim 31, wherein the instructions for generating the default instantaneous user service profile comprises instructions for generating the default instantaneous user service profile based on user preferences, user profile, and/or subscription level, and wherein each service profile identifies a layer of preview data for each type of preview data.

33. The apparatus of claim 25, wherein the preview data comprises scrub description information.

34. The apparatus of claim 33, wherein instructions for generating the preview data further comprises instructions for:

generating a scrub description file comprising the scrub description information;

generating an index file describing the structure of the scrub description file; and

generating a manifest file comprising additional description and/or metadata.

35. The apparatus of claim 34, wherein the instructions for generating scrub description file comprises instructions for:

defining a total length of the media stream;

assigning the plurality of layers to the media stream;

dividing the media stream into smaller time segments for each layer, a duration of time segments increasing with each layer; and

assigning a preview description data for each time segment in each layer.

36. The apparatus of claim 25, wherein the preview data comprises scrub description information and keyframe images.

37. The apparatus of claim 36, wherein the instructions for generating preview data comprises instructions for generating a scrub description file comprising the scrub description information, and wherein the instructions for generating scrub description file comprise instructions for adding layers comprising scrub description information to a keyframe based scrub preview comprising the keyframe images.

38. The apparatus of claim 36, wherein the instructions for generating preview data comprises instructions for generating a scrub description file comprising the scrub description information, and wherein the instructions for generating scrub description file comprise instructions for extracting keyframe images and scrub description data for each time segment of the media file for each layer of the multi-dimensional hierarchical data structure.

39. The apparatus of claim 25, wherein the preview data comprises additional information in video, image, graph, and/or text form.

40. An apparatus for receiving a media preview of a media, the apparatus comprising:

a processor; and

a non-transitory computer-readable storage medium storing a program to be executed by the processor, the program including instructions for;

sending a preview data request to a preview server, the preview data request comprising a request for a preview data for a media file being received; and

receiving the preview data comprising preview information for the media file, wherein the preview data comprises a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, wherein each layer of the plurality of layers of the preview data corresponds to a service profile of a plurality of service profiles, wherein service class types offered for streaming the media, service class attributes for each of the service class types, and a maximum allowed service class profile for each of the service class types were generated when the plurality of service profiles was generated, wherein the apparatus receiving the preview data comprises a subscriber level from a plurality of subscriber levels, wherein one layer of the plurality of layers is configured to be received depending on the subscriber level, wherein each of the plurality of service profiles corresponds to a different subscriber level of the plurality of subscriber levels, wherein instructions for receiving the preview data comprises instructions for

receiving a scrub description file comprising scrub description information,

receiving an index file describing the structure of the scrub description file,

receiving a manifest file comprising additional description and/or metadata, and

extracting preview description information from the scrub description file based on the index file and the manifest file, wherein the preview description information comprises one layer of the plurality of layers depending on the subscriber level of the apparatus.

41. The apparatus of claim 40, wherein the preview data comprises preview data type information.

42. The apparatus of claim 41, wherein the program further includes instructions for:

sending a user specified parameter for preview data type to the preview server, wherein the preview data receiver is configured to receive preview data based on the user specified parameter sent to the preview server.

43. The apparatus of claim 42, wherein the user specified parameter comprises a parameter from the group consisting of low resolution video, medium resolution video, high resolution video, minimum text description, moderate text description, and maximum text description.

44. The apparatus of claim 42, wherein the user specified parameter comprises a parameter from the group consisting of preview video data, preview audio data, keyframe images, preview content description text, preview content description image, preview relevant images, and preview relevant text.

45. The apparatus of claim 40, wherein the instructions further comprise instructions for:

rendering the preview description information to a display of an end user media player.

46. The apparatus of claim 40, wherein the instructions for receiving preview data comprises instructions for:

receiving a first scrub file comprising a first layer of a scrub description; and

a receiving a second scrub file comprising a k^th layer of the scrub description, wherein the k^th layer is any layer from the plurality of layers of the multi-dimensional hierarchical data structure.

47. The apparatus of claim 40, wherein the instructions for receiving preview data comprises instructions for:

receiving a first scrub file comprising a k¹ layer of a scrub description; and

receiving a second scrub file comprising a k^q layer of the scrub description, wherein the k¹ layer and the k^q layer are layers from the plurality of layers of the multi-dimensional hierarchical data structure, and wherein the k¹ layer and the k^q layer are selected based on a decision criterion of selecting a level of granularity from the plurality of layers.

48. The apparatus of claim 47, wherein the instructions further comprises instructions for:

sending an user specified parameter comprising a desired level of granularity for the decision criterion.