DISTRIBUTION OF LAYERED MULTI-MEDIA STREAMS OVER MULTIPLE RADIO LINKS

• US 20140201329A1
• Filed: 06/11/2012
• Published: 07/17/2014
• Est. Priority Date: 06/11/2012
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Himayat, Nageen, Gupta, Vivek, Somayazulu, Vallabhajosyula S.
• Application Number:
  US13/976,944
• Publication Number:
  US 20140201329A1
• Time in Patent Office: Days
• US Class Current: 709/219
• CPC Class Codes: H04L 12/6418 Hybrid transport
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols

Abstract

Embodiments of apparatus, computer-implemented methods, systems, devices, and computer-readable media are described herein for encoding and transmitting layered multi-media streams over multiple radio links. In various embodiments, a first layer of a multi-media stream may be received at a multi-radio computing device through a first radio link. In various embodiments, a second layer of the multi-media stream may be received at the multi-radio computing device through a second radio link. In various embodiments, feedback about the first and second radio links may be transmitted, by the multi-radio computing device through the first or second radio link, to a remote computing device configured to distribute layers of the multi-media stream among the first and second radio links.

Claims

1-65. -65. (canceled)

66. A computer-implemented method, comprising:

receiving, at a computing device through a first radio link, a first layer of a multi-media stream;

receiving, at the computing device through a second radio link, a second layer of the multi-media stream; and

transmitting, by the computing device through the first or second radio link, to a remote computing device configured to distribute layers of the multi-media stream among the first and second radio links, feedback about the first and second radio links.

67. The computer-implemented method of claim 66, wherein the remote computing device is a remote content server configured to encode the multi-media stream.

68. The computer-implemented method of claim 66, wherein the first radio link is between the computing device and a first radio network access node, and the second radio link is between the computing device and a second radio network access node that is different from the first radio network access node.

69. The computer-implemented method of claim 66, wherein the remote computing device is a radio network access node.

70. The computer-implemented method of claim 69, wherein the radio network access node is a multi-radio base station configured to communicate with the computing device over the first and second radio links.

71. The computer-implemented method of claim 69, wherein the radio network access node is a multi-radio evolved Node B configured to communicate with the computing device over the first and second radio links.

72. The computer-implemented method of claim 66, wherein receiving a first layer of a multi-media stream further comprises receiving the first layer of the multi-media stream at a first wireless interface of the computing device having a first Internet Protocol address, and wherein receiving a second layer of a multi-media stream further comprises receiving the second layer of the multi-media stream at a second wireless interface of the computing device having a second Internet Protocol address.

73. The computer-implemented method of claim 66, wherein receiving a first layer of a multi-media stream further comprises receiving the first layer of the multi-media stream at a first wireless interface of the computing device having an Internet Protocol address, and wherein receiving a second layer of a multi-media stream further comprises receiving the second layer of the multi-media stream at a second wireless interface of the computing device having the Internet Protocol address.

74. The computer-implemented method of claim 66, wherein the feedback comprises one or more of link quality data, quality of experience data or information about capabilities of the computing device.

75. The computer-implemented method of claim 66, wherein the feedback comprises information about a display resolution supported the computing device, a number of multi-media stream layers requested by the computing device, or a resolution or data rate per layer of the multi-media stream.

76. The computer-implemented method of claim 66, wherein at least one of the first or second layers is received using the real-time transport protocol (“

RTP”

), and the feedback is encoded for transmission using the RTP control protocol (“

RTCP”

).

77. The computer-implemented method of claim 76, wherein the multi-media stream is a layered video stream, and at least one of the first or second layers is received using the H.264 Scalable Video Coding (“

SVC”

) standard.

78. The computer-implemented method of claim 66, wherein the receipt of the first and second layers and transmission of the feedback together comprise a session, wherein the session is initiated using the Session Initiation protocol (“

SIP”

) and described using the Session Description Protocol (“

SDP”

).

79. The computer-implemented method of claim 66, wherein the first or second layer of the multi-media stream is received by the computing device using a user datagram control protocol, and the feedback about the first and second radio links is transmitted by the computing device using a transport control protocol.

80. The computer-implemented method of claim 66, further comprising:

collecting, by the computing device, information usable to determine which of the first and second radio links is more reliable; and

including, by the computing device, in the feedback, the information usable to determine which of the first and second radio links is more reliable.

81. The computer-implemented method of claim 66, further comprising:

determining, by the computing device, which of the first and second radio links has more bandwidth; and

including, by the computing device, in the feedback, information about which of the first and second radio links has more bandwidth.

82. The computer-implemented method of claim 66, wherein the multi-media stream is a layered video stream, and the method further comprises generating, by the computing device, the feedback to inform the remote computing device about which of the first and second radio links is better suited to receive a base layer of the video stream, and which of the first and second radio links is better suited to receive an enhancement layer of the video stream.

83. A system, comprising:

a processor;

a memory operably coupled to the processor;

a first communication interface to a first communication link;

a second communication interface to a second communication link; and

a control module configured to;

receive, through the first communication interface, a first layer of a layered multi-media stream;

receive, through the second communication interface, a second layer of the layered multi-media stream; and

transmit, through the first or second communication interface, to a remote computing device configured to distribute layers of the layered multi-media stream among the first and second communication links, feedback to cause the remote computing device to adjust the distribution of the layers among the first and second communication links.

84. The system of claim 83, wherein the layered multi-media stream comprises a layered video stream, and the feedback comprises information about a display resolution supported the system, a number of video stream layers requested by the system, or a resolution or data rate per layer of the video stream.

85. The system of claim 83, further comprising a touch screen display.

86. A system, comprising:

a processor;

a memory operably coupled to the processor; and

a sender control module configured to;

receive feedback about first and second radio links through which a remote client computing device is configured to receive at least two layers of a video stream;

determine, based on the received feedback, a scheme for distributing at least one base layer and at least one enhancement layer of a video stream among the first and second radio links to the remote client computing device; and

control transmission of the at least one base layer and the at least one enhancement layer of the video stream to the remote client computing device in accordance with the determined scheme.

87. The system of claim 86, wherein the system further comprises:

a first radio interface to the first radio link; and

a second interface to the second radio link;

wherein the sender control module is further configured to transmit, to the remote client computing device, based on the determined scheme, the at least one base layer of the video stream through the first radio interface and the at least one enhancement layer of the video stream through the second radio interface.

88. The system of claim 86, wherein the sender control module is further configured to generate the at least one base layer of the video stream for transmission over the first radio link, and to generate the at least one enhancement layer of the video stream for transmission over the second radio link, in accordance with the determined scheme.

89. The system of claim 86, wherein the sender control module is further configured to determine, based on the received feedback, which of the first and second radio links is better suited for receiving the at least one base layer of the video stream, and which of the first and second radio links is better suited for receiving the at least one enhancement layer of the video stream.

90. The system of claim 86, wherein the sender control module is further configured to utilize an SDP connection descriptor to specify multiple unicast IP addresses for a single RTP session with the client computing device.