Smart cropping of video images in a videoconferencing session

• US 8,289,371 B2
• Filed: 05/21/2007
• Issued: 10/16/2012
• Est. Priority Date: 05/21/2007
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Wagner, Niv, Gavish, Zigi
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US11/751,558
• Publication Number:
  US 20080291265A1
• Time in Patent Office: 1,975 Days
• Field of Search: 348 1401- 1416
• US Class Current: 348/14.16
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

Systems and methods are disclosed for controlling cropping areas of video images to match the allocated area associated with the image in a video conferencing layout. The disclosed methods can protect regions of interest from being cropped. A region of interest within a video image is identified to adjust the cropping in such a way that the region of interest is preserved within the cropped image. The region of interest may be identified based on motion detection or flesh tone detection, for example.

Claims

1. A method of formatting a video image associated with an endpoint for display in a videoconference, the method comprising:

determining a region of interest within the video image by analyzing one or more motion parameters and one or more color parameters within the video image; and

cropping the video image to match an associated segment in a conferencing image, wherein the cropping preserves the region of interest.

2. The method of claim 1, wherein preserving the region of interest comprises adjusting a camera at the endpoint to keep the region of interest within the cropped image.

3. The method of claim 2, wherein adjusting the camera comprises presenting an impression of a cropped image to the endpoint and prompting a user at the endpoint to adjust the camera so that the region of interest remains within the cropped image.

4. The method of claim 2, wherein adjusting the camera comprises remotely adjusting the camera from an MCU.

5. The method of claim 1, wherein determining a region of interest comprises presenting an impression of a cropped image to the endpoint and allowing a user at the endpoint to determine the region of interest.

6. The method of claim 1, wherein analyzing one or more motion parameters within the video image comprises sampling an encoder'"'"'s motion vector frame memory.

7. The method of claim 1 wherein analyzing one or more color parameters of the video image comprises sampling an encoder'"'"'s reference frame memory.

8. The method of claim 7, wherein analyzing one or more color parameters comprises determining if the color parameter corresponds to a flesh tone.

9. The method of claim 1 wherein cropping the video image comprises transmitting coordinates of the region of interest to a multipoint control unit.

10. The method of claim 1 wherein cropping the video image is performed within an encoder of an endpoint.

11. An apparatus for conducting a videoconference, comprising:

one or more region of interest detector modules configured to determine a region of interest within a video image wherein the one or more region of interest detector modules comprise at least one motion detector and at least one flesh tone detector; and

a cropping manager module configured to define cropping instructions for video image to create a cropped image wherein the determined region of interest is within the cropped image.

12. The apparatus of claim 11, further comprising a module adapted to deliver an impression of the cropped image to an endpoint.

13. The apparatus of claim 12, wherein the apparatus is adapted to prompt a user at the endpoint to adjust a camera at the endpoint according to the impression of the cropped image.

14. The apparatus of claim 11 wherein the cropping manager module is configured to pass the cropping instructions to a video encoder within the apparatus.

15. The apparatus of claim 11 wherein the cropping manager module is configured to pass the cropping instructions to a multipoint control unit.

16. An apparatus for conducting a videoconference, comprising:

one or more input modules adapted to receive and decode compressed video images transmitted by a video stream;

one or more region of interest detector modules configured to determine a region of interest within a decoded a video image, wherein the one or more region of interest detector modules comprise at least one motion detector and at least one flesh tone detector;

a cropping manager module configured to define cropping instructions for the decoded video image to create a cropped image wherein the determined region of interest is within the cropped image; and

one or more output modules is adapted to generate a continuous presence video image from one or more of the decoded video images streams wherein the continuous presence video image comprises the cropped image.

17. The apparatus of claim 16, wherein the output module is adapted to send a cropped self image to an endpoint.

18. The apparatus of claim 17, wherein the output module is adapted to prompt a user at the endpoint to adjust a camera at the endpoint according to the cropped self image.

19. The apparatus of claim 16, further comprising a far end camera control module adapted to adjust a camera at an endpoint so that the region of interest is within the cropped image.