Panoramic image placement to minimize full image interference

• US 9,843,770 B2
• Filed: 08/30/2016
• Issued: 12/12/2017
• Est. Priority Date: 10/05/2015
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Nimri, Alain Elon, Gao, Shu, Schaefer, Stephen, Murphy, Robert
• Primary Examiner(s): WOO, STELLA L
• Application Number:
  US15/252,093
• Publication Number:
  US 20170099461A1
• Time in Patent Office: 469 Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G10L 21/0272 Voice signal separating
• CPC Class Codes: G10L 21/028 using properties of sound source
• CPC Class Codes: G10L 25/72 for transmitting results of analysis
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

An automatic process for producing professional, directed, production crew quality, video for videoconferencing is described. Rule based logic is integrated into an automatic process for producing director quality video for videoconferencing. An automatic process can include a method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video. The method can include determining a region of interest in a panoramic view video using motion detection and presence sensors, and preparing the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon the location of persons in the panoramic view video. The method includes determining placement of panoramic view video on a composite display to prevent the panoramic view video overlaying display of an active talker on the active talker video stream.

Claims

1. A method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video, the method comprising:

determining, using a processor, a region of interest in a panoramic view video using motion detection and presence sensors;

preparing, using the processor, the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon location of persons in the panoramic view video; and

determining, using the processor and responsive to a change in position of an active talker, where to place the panoramic view video on a composite display to prevent the panoramic view video from overlaying display of the active talker in the active talker video stream while maintaining a scale of the active talker video stream.

2. The method of claim 1 wherein the step of determining where to place the panoramic view video comprises:

determining the location of the active talker and placing the panoramic view video at bottom of a display.

3. The method of claim 1 wherein the step of determining where to place the panoramic view video comprises:

placing the panoramic view video at top of display.

4. The method of claim 1 wherein the step of determining where to place the panoramic view video comprises removing the panoramic view video from display.

5. The method of claim 1 further comprising shifting the active talker video stream lower so that an upper portion of the active talker video stream is cropped.

6. The method of claim 1 further comprising shifting the active talker video stream higher so that a lower portion of the active talker video stream is cropped.

7. A multipoint control unit (MCU) for intelligently displaying an active talker video stream and a panoramic view video stream having more than one person in video, the MCU comprising:

at least one display device;

at least one camera coupled to the at least one display device;

a processor coupled to the at least one camera and the at least one display device, the processor having a set of computer readable instructions associated therewith, the processor configured to, upon execution of the instructions, cause the MCU to;

determine a region of interest in a panoramic view video using motion detection and presence sensors;

prepare the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon location of persons in the panoramic view video; and

determine, responsive to a detection of a change in position of an active talker within the active talker video stream, where to display the panoramic view video on a composite display rendered on the at least one display device to prevent the panoramic view video from overlaying display of the active talker on the active talker video stream, while keeping constant scaling of the active talker video stream.

8. The MCU of claim 7 wherein the instructions further comprise instructions to determine where to place the panoramic view video based on determining the location of the active talker and placing the panoramic view video at bottom of the at least one display device.

9. The MCU of claim 7 wherein determining where to place the panoramic view video comprises:

placing the panoramic view video at top of the at least one display device.

10. The MCU of claim 7 wherein determining where to place the panoramic view video comprises removing the panoramic view video from the at least one display device.

11. The MCU of claim 7;

further configured to shift the position of the active talker video stream lower so that an upper portion of the active talker video stream is cropped.

12. The MCU of claim 7, further configured to shift the active talker video stream higher so that a lower portion of the active talker video stream is cropped.

13. A method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video, the method comprising:

determining a region of interest in a panoramic view video using motion detection and presence sensors;

preparing for display the panoramic view video including centering the region of interest and zooming towards location of one or more persons in the panoramic view video; and

automatically arranging a composite display on a display device, the composite display including both the active talker video stream and the prepared panoramic view video, wherein the panoramic view video overlays a portion of the active talker video stream and does not overlay a display of an active talker in the active talker video stream, and scaling of the active talker video stream is constant throughout any change of position of the active talker therein.

14. The method of claim 13 wherein the active talker is centrally displayed on the display device.

15. The method of claim 13 wherein arranging a composite display comprises shifting display of active talker video stream lower on the display device.

16. The method of claim 13 wherein arranging a display further comprises shifting display of the active talker video stream higher on the display device.

17. A multipoint control unit (MCU) for intelligently displaying an active talker video stream and a panoramic view video stream having more than one person in video, the MCU comprising:

at least one display device;

at least one camera coupled to the display device;

a processor coupled to the camera and display device, the processor having a set of computer readable instructions associated therewith, the processor configured to, upon execution of the instructions, control the MCU to;

determine a region of interest in a panoramic view video using motion detection and presence sensors;

prepare for display the panoramic view video including centering the region of interest and zooming towards location of one or more persons in the panoramic view video; and

arrange a composite display on the display device, the composite display including both the active talker video stream and the prepared panoramic view video, wherein the panoramic view video overlays a portion of the active talker video stream and does not overlay a display of an active talker in the active talker video stream, and scaling of the active talker video stream is constant throughout any change of position of the active talker therein.

18. The MCU of claim 17 wherein the instructions further comprise instructions to control the MCU to centrally display the active talker on the display device.

19. The MCU of claim 17 wherein arranging a composite display comprises shifting lower display of active talker video lower on the display device.

20. The MCU of claim 17 wherein the panoramic view includes at least one of closed captioning information, pre-recorded video, or other graphical information.