Method and apparatus for rate adaptation in motion picture experts group media transport

• US 10,033,658 B2
• Filed: 01/08/2014
• Issued: 07/24/2018
• Est. Priority Date: 06/20/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Bouazizi, Imed, Xu, Meng, Ma, Zhan
• Primary Examiner(s): Maung, Zarni
• Application Number:
  US14/150,591
• Publication Number:
  US 20140379903A1
• Time in Patent Office: 1,658 Days
• CPC Class Codes: H04L 47/74 measures in reaction to resource unavailability
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]

Abstract

Apparatus and methods for a Motion Picture Experts Group (MPEG) media transport (MMT) device for sending or receiving media content is provided. The MMT device comprises a memory unit and a controller. The controller is configured to measure an available bandwidth, receive fragments of a first encoded stream of the media content and fragments of a second encoded stream of the same media content based on the available bandwidth and a current transmission bandwidth. A mixed encoded stream comprises the fragments received from the first encoded stream and the fragments received from the second encoded stream.

Claims

1. A Motion Picture Experts Group (MPEG) media transport (MMT) client device for receiving media content, the MMT client device comprising:

a memory unit; and

a controller configured to;

receive fragments of a first encoded stream of the media content and fragments of a second encoded stream of the same media content based on an available bandwidth and a current transmission bandwidth,

wherein a mixed encoded stream comprises the fragments received from the first encoded stream and the fragments received from the second encoded stream; and

adjust dropping the fragments of the first encoded stream prior to requesting fragments from the second encoded stream,

wherein the adjusting comprises reducing dropping media fragment units (MFUs) if the available bandwidth is not less than the current transmission bandwidth and the available bandwidth is not greater than one of the current transmission bandwidth times a factor of 1+β and

a threshold.

2. The MMT client device of claim 1, wherein:

the adjusting comprises dropping sufficient MFUs if the available bandwidth is less than the current transmission bandwidth and the current bandwidth minus the available bandwidth is less than a sum of a size of one or more disposable media units.

3. The MMT client device of claim 1, wherein:

the second encoded stream is associated with a lower bitrate and is switched to if the available bandwidth is less than the current transmission bandwidth and the current bandwidth minus the available bandwidth is not less than a sum of a size of one or more disposable media units, and

the second encoded stream is associated with a higher bitrate and is switched to if the available bandwidth is not less than the current transmission bandwidth and the available bandwidth is greater than one of the current transmission bandwidth times a factor of 1+β and

a threshold.

4. The MMT client device of claim 1, wherein the fragments sent of the first encoded stream and the fragments sent of the second encoded stream have a minimal time overlap not exceeding one or more media samples.

5. The MMT client device of claim 1, wherein:

the adjusting is based on additional metadata from a content provider,

the additional metadata is configured to indicate a minimum frame rate for a specific period of time,

the dropping is stopped if the frame rate from the dropping is lower than a recommended frame rate, and

the second encoded stream is associated with a lower bitrate and is switched to if the frame rate from the dropping is lower than the recommended frame rate.

6. The MMT client device of claim 1, wherein information in an MMT Fragment Header and information in MFU of the media content is used to pre-calculate which MFUs are to be dropped.

7. A Motion Picture Experts Group (MPEG) media transport (MMT) server device for sending media content, the MMT device comprising:

a memory unit; and

a controller configured to;

measure an available bandwidth;

in response to determining a need for rate adaptation, switch from sending fragments of a first encoded stream of the media content to sending fragments of a second encoded stream of the same media content based on a comparison between the available bandwidth and a current transmission bandwidth,

wherein the switch is performed at a movie fragment level, and

wherein a mixed encoded stream comprises the fragments sent of the first encoded stream and the fragments sent of the encoded second stream; and

adjust dropping the fragments of the first encoded stream prior to the switching from the first encoded stream to the second encoded stream,

wherein the adjusting comprises reducing dropping media fragment units (MFUs) if the available bandwidth is not less than the current transmission bandwidth and the available bandwidth is not greater than one of the current transmission bandwidth times a factor of 1+β

or a threshold.

8. The MMT server device of claim 7, wherein:

the adjusting comprises dropping sufficient MFUs if the available bandwidth is less than the current transmission bandwidth and the current bandwidth minus the available bandwidth is less than a sum of a size of one or more disposable media units.

9. The MMT server device of claim 7, wherein:

the second encoded stream is associated with a lower bitrate and the switching comprises switching to the lower bitrate if the available bandwidth is less than the current transmission bandwidth and the current bandwidth minus the available bandwidth is not less than a sum of a size of one or more disposable media units, and

the second encoded stream is associated with a higher bitrate and the switching comprises switching to the higher bitrate if the available bandwidth is not less than the current transmission bandwidth and the available bandwidth is greater than one of the current transmission bandwidth times a factor of 1+β and

a threshold.

10. The MMT server of claim 7, wherein the fragments sent of the first encoded stream and the fragments sent of the second encoded stream have a minimal time overlap not exceeding one or more media samples.

11. The MMT server device of claim 7, wherein:

the adjusting is based on additional metadata from a content provider,

the additional metadata is configured to indicate a minimum frame rate for a specific period of time,

the dropping is stopped if the frame rate from the dropping is lower than a recommended frame rate, and

the second encoded stream is associated with a lower bitrate and the switching comprises switching to the lower bitrate if the frame rate from the dropping is lower than the recommended frame rate.

12. The MMT server device of claim 7, wherein information in a Motion Picture Experts Group (MPEG) media transport (MMT) Fragment Header and information in a MFU of the media content is used to pre-calculate which MFUs are to be dropped.

13. A method for transferring media content, the method comprising:

measuring an available bandwidth;

in response to determining a need for rate adaptation, switching from sending fragments of a first encoded stream of the media content to sending fragments of a second encoded stream of the same media content based on a comparison between the available bandwidth and a current transmission bandwidth,

wherein the switch is performed at a movie fragment level, and

wherein a mixed encoded stream comprises the fragments sent of the first encoded stream and the fragments sent of the second encoded stream; and

adjusting dropping the fragments of the first encoded stream prior to the switching from the first encoded stream to the second encoded stream,

wherein the adjusting comprises reducing dropping media fragment units (MFUs) if the available bandwidth is not less than the current transmission bandwidth and the available bandwidth is not greater than one of the current transmission bandwidth times a factor of 1+β and

a threshold.

14. The method of claim 13, wherein:

the adjusting comprises dropping sufficient MFUs if the available bandwidth is less than the current transmission bandwidth and the current bandwidth minus the available bandwidth is less than a sum of a size of one or more disposable media units.

15. The method of claim 13, wherein:

the second encoded stream is associated with a lower bitrate and the switching comprises switching to the lower bitrate if the available bandwidth is less than the current transmission bandwidth and the current bandwidth minus the available bandwidth is not less than a sum of a size of one or more disposable media units, and

the second encoded stream is associated with a higher bitrate and the switching comprises switching to the higher bitrate if the available bandwidth is not less than the current transmission bandwidth and the available bandwidth is greater than one of the current transmission bandwidth times a factor of 1+β and

a threshold.

16. The method of claim 13, wherein the fragments sent of the first encoded stream and the fragments sent of the second encoded stream have a minimal time overlap not exceeding one or more media samples.

17. The method of claim 13, wherein:

the adjusting is based on additional metadata from a content provider,

the additional metadata is configured to indicate a minimum frame rate for a specific period of time,

the dropping is stopped if the frame rate from the dropping is lower than a recommended frame rate, and

the second encoded stream is associated with a lower bitrate and the switching comprises switching to the lower bitrate if the frame rate from the dropping is lower than the recommended frame rate.