Multiple Video Stream Capability Negotiation

• US 20090231415A1
• Filed: 03/14/2008
• Published: 09/17/2009
• Est. Priority Date: 03/14/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Moore, Timothy M., Crinon, Regis J., Wang, Shiwei, Qiu, Jingyu, Khan, Humayun Mukhtar, Niu, Ling
• Granted Patent: US 8,144,187 B2
• Time in Patent Office: Days
• US Class Current: 348/14.90
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 7/14 Systems for two-way working H04N7/12, H04N7/173 take precedence
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

Video send and receive capabilities of participants are determined by the respective machines determining available combinations, as well as preferences for the receivers. Receiver capabilities are forwarded to the source for computation of negotiated video capabilities through a logic intersection of the determined capabilities based on desired number of streams and resolutions. If a resolution of a send capability exists within the receive capability, the highest frame and/or bit rate may be selected for transmission.

Claims

1. A method to be executed at least in part in a computing device for facilitating a video conference employing video capability negotiation, the method comprising:

receiving a receiver'"'"'s video receive capabilities comprising a first list of video stream combinations supported by the receiver, each video stream combination including at least one video stream type defined by a resolution, a frame rate, and a bit rate;

determining a sender'"'"'s video send capabilities comprising a second list of video stream combinations supported by the sender, each video stream combination including at least one video stream type;

determining a set of negotiated capabilities based on comparing the first list and the second list of video stream combinations and if a video stream combination exists on both lists selecting that video stream combination;

providing the set of negotiated capabilities to the receiver; and

facilitating the video conference by using a selected video stream combination by the receiver.

2. The method of claim 1, further comprising:

receiving the receiver'"'"'s video preferences for each video stream in the video receive capabilities;

if the video preferences match the negotiated capabilities, providing the video preferences for facilitating the video conference.

3. The method of claim 1, further comprising:

selecting a lower one of the frame rates of the video stream combinations that exist in both the first list and the second list.

4. The method of claim 1, further comprising:

selecting a lower one of the bit rates of the video stream combinations that exist in both the first list and the second list.

5. The method of claim 1, wherein the receiver'"'"'s video receive capabilities are received employing Session Description Protocol (SDP), and wherein the resolution includes one of:

High Definition (HD), Video Graphics Array (VGA), Common Intermediate Format (CIF), and Quarter Common Intermediate Format (QCIF) resolution.

6. The method of claim 1, wherein the video receive capabilities are determined based on at least one from a set of:

the receiver'"'"'s processing capacity, the receiver'"'"'s available memory size, currently active programs at the receiver, currently active video applications at the receiver, the receiver'"'"'s display resolution, the receiver'"'"'s decoding capabilities, and the receiver'"'"'s downlink bandwidth.

7. The method of claim 1, wherein the video send capabilities are determined based on at least one from a set of:

the sender'"'"'s processing capacity, the sender'"'"'s available memory size, currently active programs at the sender, currently active video applications at the sender, the sender'"'"'s camera resolution, the sender'"'"'s encoding capabilities, and the sender'"'"'s uplink bandwidth.

8. The method of claim 1, wherein the video preferences are determined based on at least one from a set of:

a display window size of the receiver, a desired sharpness of displayed image at the receiver, a desired frame rate at the receiver, and a video conference scenario.

9. The method of claim 1, wherein at least one of the video send and video receive capabilities are determined as a separate set for each device attribute.

10. The method of claim 1, wherein the video receive and the video send capabilities are maintained as tables, and wherein the negotiated capabilities are determined through an intersection of the tables such that X_S=X_R and Y_S=Y_R and FPS_R>

=FPS_S and BR_R>

=BR_S, where X and Y denote a video resolution of a display along horizontal and vertical dimensions, respectively, FPS denotes frame rate, BR denotes bit rate, and the subscripts S and R denote send and receive, respectively.

11. The method of claim 1, wherein the negotiated capabilities are determined at one of:

a client device acting as the sender and a Multipoint Control Unit (MCU) facilitating the video conference.

12. The method of claim 1, further comprising:

dynamically adjusting the negotiated capabilities in response to a change in one of;

number of participants in the video conference, the sender'"'"'s video send capabilities, and at least one receiver'"'"'s video receive capabilities.

13. The method of claim 2, wherein the video receive and the video send capabilities are static and the negotiated capabilities are determined at a beginning of video conference, while the video preferences are determined based on dynamic choices made by the receiver.

14. A video conference client device for providing video source to a video conference employing video capabilities negotiation, the device comprising:

a video capture device;

a processor coupled to the video capture device, the processor configured to;

maintain a set of video send capabilities comprising video stream combinations supported by the device based on its characteristics, attributes, and applications executed on the device, wherein each video stream combination includes at least one video stream type defined by a resolution, a frame rate, and a bit rate;

receive a set of receive video capabilities from each receiver comprising video stream combinations supported by each receiver and a set of video preferences from each receiver;

determine a set of negotiated video capabilities based on comparing the set of video send capabilities to the received video receive capabilities and selecting video stream combinations that exist on both sets with a lower one of the bit rate and the frame rate for each receiver;

if a receiver'"'"'s video preferences are equal or less to the determined negotiated capabilities for that receiver, provide video streams defined by the video preferences to that receiver;

else

provide the video stream combination defined by the negotiated video capability to each corresponding receiver.

15. The device of claim 14, wherein the processor is further configured to:

receive the set of receive video set capabilities and provide the negotiated video capabilities to the receivers through an MCU that is one of;

a standalone hardware device, a software program executed by a computing device facilitating the video conference, and a combination of a standalone hardware device and a software program.

16. The device of claim 14, wherein the processor is further configured to:

adjust the negotiated video capabilities based on a number of video conference participants and available bandwidth for transmitting video streams.

17. The device of claim 14, wherein the send video capabilities and the receive video capabilities are based on one of:

hardware capabilities of the video conference client device and each of the receivers, respectively, and an administrator defined configuration for managing video conference parameters that include at least one from a set of;

maximum resolution, frame rate, bit rate, and bandwidth usage.

18. The device of claim 14, wherein the client device and the receiver are capable of using only one of the available video stream combinations in the negotiated video capabilities at any given time, and wherein the client device is configured to select another video stream combination in response to a change in one of:

client device characteristics, receiver characteristics, number of receivers, and network bandwidth conditions.

19. A computer-readable storage medium with instructions stored thereon for facilitating a video conference with video capability negotiation, the instructions comprising:

maintaining a table of video send capabilities comprising video stream combinations supported by a current source client based on its characteristics, attributes, and applications executed on the source client, wherein each video stream combination includes at least one video stream type defined by a resolution, a frame rate, and a bit rate;

receiving a set of receive video capabilities from each receiver comprising video stream combinations supported by each receiver when joining the video conference;

comparing the received sets of receive video capabilities with the send video capabilities and determining a set of negotiated video capabilities for each receiver by selecting a video stream combination such that X_S=X_R and Y_S=Y_R and FPS_R>

=FPS_S and BR_R>

=BR_S, where X and Y denote x and y axes pixel numbers of a display for defining the resolution, FPS denotes the frame rate, BR denotes the bit rate, and the subscripts S and R denote “

send” and

“

receive”

, respectively; and

facilitating the video conference by enabling each receiver to select at least one video stream from the negotiated video stream combination.

20. The computer-readable storage medium of claim 19, wherein the video streams are provided for a main video channel and a panoramic video channel simultaneously.