Dynamic adaption of a continuous presence videoconferencing layout based on video content

• US 9,294,726 B2
• Filed: 04/05/2013
• Issued: 03/22/2016
• Est. Priority Date: 05/21/2007
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Decker, Eran, Wagner, Niv, Barazany, Avihay, Vistuch, Roni
• Primary Examiner(s): Anwah, Olisa
• Application Number:
  US13/857,746
• Publication Number:
  US 20130222529A1
• Time in Patent Office: 1,082 Days
• Field of Search: 348/14.01, 348/14.07, 348/14.12, 348/14.16
• US Class Current: 1/1
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

Dynamically adapting a continuous presence (CP) layout in a videoconference enhances a videoconferencing experience by providing optimum visibility to regions of interest within the CP layout and ignoring regions of no interest. Based on the CP layout, a CP video image can be built, in which a conferee at a receiving endpoint can observe, simultaneously, several other participants'"'"' sites in the conference. For example, more screen space within the CP layout is devoted to presenting the participants in the conference and little or no screen space is used to present an empty seat, an empty room, or an unused portion of a room. Aspect ratios of segments of the CP layout (e.g., landscape vs. portrait) can be adjusted to optimally present the regions of interest. The CP layout can be adjusted as regions of interest change depending on the dynamics of the video conference.

Claims

1. An apparatus for controlling building a continuous presence video image in a video conference, comprising:

a control module, configured to perform actions comprising actions that cause the control module to;

receive parameters of a region of interest from a first endpoint of a plurality of endpoints;

design a continuous presence layout based on the parameters of the region of interest; and

an editor module, associated with a second endpoint of the plurality of endpoints, configured to perform actions comprising actions that cause the editor module to;

receive instructions on how to manipulate and place a video image generated by the first endpoint in a continuous presence video image according to the continuous presence layout for display by the second endpoint.

2. The apparatus of claim 1, further comprising:

a network interface module, coupled to the control module, wherein the control module is communicatively coupled to the plurality of endpoints via the network interface module.

3. The apparatus of claim 1, wherein the instructions to manipulate the video image comprise instructions to crop or scale the video image.

4. The apparatus of claim 1, wherein control module designs the continuous presence layout at least in part according to management instructions.

5. The apparatus of claim 1, wherein continuous presence layout includes only video images that have an identified region of interest.

6. The apparatus of claim 1, wherein the parameters of the region of interest are received from a face detector.

7. The apparatus of claim 1, wherein the control module is embedded within a multipoint control unit.

8. The apparatus of claim 1, wherein the editor module is embedded within a multipoint control unit.

9. The apparatus of claim 1, wherein the continuous presence layout is periodically updated.

10. The apparatus of claim 1, wherein the continuous presence layout is adapted to the size of the region of interest.

11. The apparatus of claim 1, wherein the parameters of the region of interest are periodically updated by analyzing a frame of uncompressed video data generated by the first endpoint and determining updated parameters of the region of interest.

12. The apparatus of claim 11, wherein the control module redesigns the continuous presence layout based on the updated parameters of the region of interest.