APPARATUS AND METHOD FOR PROVIDING STREAMING CONTENT USING REPRESENTATIONS

• US 20190058746A1
• Filed: 10/24/2018
• Published: 02/21/2019
• Est. Priority Date: 03/16/2011
• Status: Active Grant

• Current Assignee: Helios Streaming, LLC (Ideahub, Inc.)
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: THANG, Truong Cong, LEE, Jin Young
• Granted Patent: US 10,270,830 B2
• Time in Patent Office: Days
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

A method and apparatus for an adaptive Hypertext Transfer Protocol (HTTP) streaming service using metadata of media content are provided. The media content may include a sequence of one or more periods. Each of the periods may include one or more representations. The metadata may include information used to describe a relationship between the representations, and include information for terminals having different display bit depth.

Claims

1. A method for providing a media content performed by a server, comprising:

receive a request for a segment of the media content based on a Media Presentation Description (MPD), from a client; and

transmitting the media content to the client,

wherein the MPD is formalized description of a media presentation related to the media content,

wherein the media presentation includes one or more period

wherein each of the period includes one or more adaptation sets,

wherein each of the adaptation set includes one or more representations

wherein each of the representation includes one or more segments.

2. The method of claim 1, wherein the all representations included in a single adaptation set represent the same media content components, and include one or more media streams that are determined to be perceptually equivalent.

3. The method of claim 1, wherein the MPD includes MPD type comprising at least one of element of ProgramInformation, BaseURL, Location, Period and Metrics.

wherein the ProgramInformation is descriptive information about a program,

wherein the BaseURL is used for reference resolution and alternative URL selection,

wherein the Location is a location at which the MPD is available,

wherein the Period is information of a period,

wherein the Metrics is DASH metrics.

4. The method of claim 1, wherein the MPD includes MPD type comprising at least one of attribute of availabilityStartTime, availabilityEndTime, mediaPresentationDuration, minimumUpdatePeriod and minBufferTime, timeShiftBufferDepth, suggestedPresentationDelay, maxSegmentDuration and maxSubsegmentDuration.

5. The method of claim 1, wherein the period is either regular period and early available period.

6. The method of claim 5, wherein the a PeriodStart time of a regular period is determined as follows:

when a start attribute is present in a period element, wherein the period is the regular period, and the PeriodStart time is equal to a value of the start attribute.

7. The method of claim 5, wherein the a PeriodStart time of a regular period is determined as follows:

when a start attribute is absent, but a previous period element contains duration attribute, then a new period is the regular period, and the start time of a new period PeriodStart is a sum of a start time of the previous period and a value of the duration attribute of the previous period.

8. The method of claim 5, wherein the a PeriodStart time of a regular period is determined as follows:

(i) when a start attribute is absent, (ii) when a period element is the first in the MPD, and (iii) when a type attribute of the MPD is static, the PeriodStart time is set to 0, or

(i) when a start attribute is absent, (ii) when a previous period element does not contain duration attribute, or when the period element is the first in the MPD, and iii) when the type attribute of the MPD is dynamic, the period is the early available period.

9. The method of claim 1, wherein the MPD includes Period type, Adaptation set type or Representation Type comprising at least one of element of SegmentBase, SegmentList, and SegmentTemplate related to segment information.

10. The method of claim 9, wherein the segment information provides information on location, availability and properties of all of one or more segments included in the representation.

11. The method of claim 1, wherein properties of a media content component include at least one of:

1) an attribute related to language,

2) an attribute related to a media component type,

3) an attribute related to a picture aspect ratio,

4) an element related to a role property which specifies information on a role annotation scheme,

5) an element related to an accessibility property which specifies information on an accessibility scheme,

6) an element related to a viewpoint property which specifies information on a viewpoint annotation scheme, and

7) an element related to a rating property which specifies information on a ration rating scheme.

12. The method of claim 1, wherein the MPD includes AdaptationSetType comprising at least one of attribute of minBandWidth, maxBandWidth, minWidth, maxWidth, minHeight, maxHeight, minFramerate, maxFramerate for adaptation set.

13. The method of claim 12, wherein the minBandWidth indicates a minimum value among bandwidth attributes of all representations,

wherein the maxBandWidth indicates a maximum value among bandwidth attributes of all representations,

wherein the minWidth indicates a minimum value among width attributes of all representations,

wherein the maxWidth indicates a maximum value among width attributes of all representations,

wherein the minHeight indicates a minimum value among height attributes of all representations,

wherein the maxHeight indicates a maximum value among height attributes of all representations,

wherein the minFrameRate indicates a minimum value among frame rate attributes of all representations,

wherein the maxFrameRate indicates a maximum value among frame rate attributes of all representations.

14. The method of claim 1, wherein the MPD includes content component element comprising at least one of attribute for id, group, lang, contentType, par.

15. The method of claim 14, wherein the id specifies an identifier of an adaptation set in the scope of the period and is a unique identifier within a scope including the containing Period,

wherein the group specifies an identifier of a group that is unique in the scope of the period,

wherein the lang declares language code of the adaptation set,

wherein the contentType specifies a media content component type of the adaptation set

wherein the par specifies a picture aspect ratio, when the par is present, attributes for width and height for the representations is present.

16. The method of claim 1, wherein the MPD includes at least one of common element related to at least one of FramePacking, AudiochannelConfiguration, and ContentProtection.

17. The method of claim 16, wherein the FramePacking specifies frame-packing arrangement information of a video media component type,

wherein the AudioChannelConfiguration specifies an audio channel configuration of an audio media component type,

wherein the ContentProtection specifies specifies information on content protection schemes used for associated representations.

18. A method for providing a media content performed by a client, comprising:

transmitting a request for a segment of the media content based on a Media Presentation Description (MPD), to a server; and

receiving the media content from the server,

wherein the MPD is formalized description of a media presentation related to the media content,

wherein the media presentation includes one or more period

wherein each of the period includes one or more adaptation sets,

wherein each of the adaptation set includes one or more representations

wherein each of the representation includes one or more segments.

19. The method of claim 18, wherein the all representations included in a single adaptation set represent the same media content components, and include one or more media streams that are determined to be perceptually equivalent.

20. The method of claim 18, wherein the MPD includes MPD type comprising at least one of element of ProgramInformation, BaseURL, Location, Period and Metrics.

wherein the ProgramInformation is descriptive information about a program,

wherein the BaseURL is used for reference resolution and alternative URL selection,

wherein the Location is a location at which the MPD is available,

wherein the Period is information of a period,

wherein the Metrics is DASH metrics.

21. The method of claim 18, wherein the MPD includes MPD type comprising at least one of attribute of availabilityStartTime, availabilityEndTime, mediaPresentationDuration, minimumUpdatePeriod and minBufferTime, timeShiftBufferDepth, suggestedPresentationDelay, maxSegmentDuration and maxSubsegmentDuration.

22. The method of claim 18, wherein the period is either regular period and early available period.

23. The method of claim 22, wherein the a PeriodStart time of a regular period is determined as follows:

when a start attribute is present in a period element, wherein the period is the regular period, and the PeriodStart time is equal to a value of the start attribute.

24. The method of claim 22, wherein the a PeriodStart time of a regular period is determined as follows:

when a start attribute is absent, but a previous period element contains duration attribute, then a new period is the regular period, and the start time of a new period PeriodStart is a sum of a start time of the previous period and a value of the duration attribute of the previous period.

25. The method of claim 22, wherein the a PeriodStart time of a regular period is determined as follows:

(i) when a start attribute is absent, (ii) when a period element is the first in the MPD, and (iii) when a type attribute of the MPD is static, the PeriodStart time is set to 0, or

(i) when a start attribute is absent, (ii) when a previous period element does not contain duration attribute, or when the period element is the first in the MPD, and iii) when the type attribute of the MPD is dynamic, the period is the early available period.

26. The method of claim 18, wherein the MPD includes Period type, Adaptation set type or Representation Type comprising at least one of element of SegmentBase, SegmentList, and SegmentTemplate related to segment information.

27. The method of claim 26, wherein the segment information provides information on location, availability and properties of all of one or more segments included in the representation.

28. The method of claim 18, wherein properties of a media content component include at least one of:

1) an attribute related to language,

2) an attribute related to a media component type,

3) an attribute related to a picture aspect ratio,

4) an element related to a role property which specifies information on a role annotation scheme,

5) an element related to an accessibility property which specifies information on an accessibility scheme,

6) an element related to a viewpoint property which specifies information on a viewpoint annotation scheme, and

7) an element related to a rating property which specifies information on a ration rating scheme.

29. The method of claim 18, wherein the MPD includes AdaptationSetType comprising at least one of attribute of minBandWidth, maxBandWidth, minWidth, maxWidth, minHeight, maxHeight, minFramerate, maxFramerate for adaptation set.

30. The method of claim 29, wherein the minBandWidth indicates a minimum value among bandwidth attributes of all representations,

wherein the maxBandWidth indicates a maximum value among bandwidth attributes of all representations,

wherein the minWidth indicates a minimum value among width attributes of all representations,

wherein the maxWidth indicates a maximum value among width attributes of all representations,

wherein the minHeight indicates a minimum value among height attributes of all representations,

wherein the maxHeight indicates a maximum value among height attributes of all representations,

wherein the minFrameRate indicates a minimum value among frame rate attributes of all representations,

wherein the maxFrameRate indicates a maximum value among frame rate attributes of all representations.

31. The method of claim 18, wherein the MPD includes content component element comprising at least one of attribute for id, group, lang, contentType, par.

32. The method of claim 31, wherein the id specifies an identifier of an adaptation set in the scope of the period and is a unique identifier within a scope including the containing Period,

wherein the group specifies an identifier of a group that is unique in the scope of the period,

wherein the lang declares language code of the adaptation set,

wherein the contentType specifies a media content component type of the adaptation set

wherein the par specifies a picture aspect ratio, when the par is present, attributes for width and height for the representations is present.

33. The method of claim 18, wherein the MPD includes at least one of common element related to at least one of FramePacking, AudiochannelConfiguration, and ContentProtection.

34. The method of claim 33, wherein the FramePacking specifies frame-packing arrangement information of a video media component type,

wherein the AudioChannelConfiguration specifies an audio channel configuration of an audio media component type,

wherein the ContentProtection specifies specifies information on content protection schemes used for associated representations.