System and method for mirror utilization in meeting rooms

• US 9,936,163 B1
• Filed: 10/05/2016
• Issued: 04/03/2018
• Est. Priority Date: 10/05/2016
• Status: Active Grant

• Current Assignee: Arlington Technologies, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Avaya Incorporated
• Inventors: Lubelsky, Eyal, Popovich, Yoel, Sanado, Ami, Dayan, Ilan, Cohen, Azaria, Barzuza, Tamar
• Primary Examiner(s): Patel, Hemant
• Application Number:
  US15/286,356
• Publication Number:
  US 20180098027A1
• Time in Patent Office: 545 Days
• Field of Search: 348 1401- 1416, 370259-271, 370351-357
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A video-enabled communication system that includes a processor, coupled with a camera, the camera acquiring an image of an object of interest during a video communication session and a computer readable medium, coupled with the processor, comprising instructions that cause the processor to select a reflected image of the object of interest for use in providing image information to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in a mirror having a line-of-sight to the camera.

Claims

1. A video-enabled communication system, comprising:

a control unit, coupled with a camera, the camera acquiring an image of an object of interest during a video communication session, wherein the control unit comprises;

a processor; and

a computer readable medium comprising a mirror selector that causes the processor to select, from among multiple possible images in multiple mirrors that can be or have been captured by the camera, a reflected image of the object of interest for provision to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in at least one of the multiple mirrors having a line-of-sight to the camera.

2. The system of claim 1, wherein the at least one of the multiple mirrors is positioned transverse to an optical axis of the camera, wherein the processor bases the reflected image selection on information describing a local participant and/or context of the video communication session and wherein the processor, at a first time, selects a non-reflected image of the object of interest captured by the camera for provision to the remote endpoint and, at a second time, selects the reflected image of the object of interest to provide to the remote endpoint.

3. The system of claim 2, wherein the object of interest is a local participant, wherein, at the first time, the local participant is facing the camera and, at the second time, the local participant is facing the at least one of the multiple mirrors.

4. The system of claim 1, wherein the processor, at a first time, selects a non-reflected image of the object of interest captured by the camera for provision to the remote endpoint and, at a second time, selects the reflected image of the object of interest to provide to the remote endpoint, wherein the camera is a wide angle and high resolution digital camera, and wherein the non-reflected image and reflected image are extracted, at different times, from image information captured by a field of view of the camera at common pan, tilt, and zoom settings.

5. The system of claim 1, wherein the processor controls a pan, tilt, or zoom of the camera based on an electronic mirror map for the multiple mirrors comprising one or more of a mirror location defined by set of spatial coordinates, a mirror type, mirror size, and angle of a mirror relative to an optical axis of the camera and wherein the object of interest is a presentation on a presentation surface.

6. The system of claim 4, wherein the processor, at the first time, substitutes a selected image for the reflected image in the image information captured by the field of view of the camera.

7. The system of claim 1, wherein the processor upscales and/or enlarges the reflected image of the object of interest to resemble a size of the object of interest in a non-reflected image captured by the camera, wherein the object of interest is an item on a table or desk, and wherein the at least one of the multiple mirrors is positioned on a horizontal surface of the table or desk to reflect, for capture by the camera, the reflected of the item.

20. The system of claim 1, wherein the processor uses the reflected image to correct image distortion in the image information.

8. A method for controlling a camera during a video communication session, comprising:

selecting, by a processor, from among multiple possible images that can be or have been captured by the camera, a reflected image of an object of interest for provision to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in a mirror having a line-of-sight to the camera;

selecting, by the processor, at a first time, a non-reflected image of the object of interest captured by the camera for provision to the remote endpoint;

selecting, by the processor, at a second time, the reflected image of the object of interest to provide to the remote endpoint, wherein the camera is a wide angle and high resolution digital camera and wherein the non-reflected image and reflected image are extracted, at different times, from image information captured by a field of view of the camera at common pan, tilt, and zoom settings; and

providing, by the processor during the video communication session, the reflected image to the remote endpoint.

9. The method of claim 8, wherein the mirror is positioned transverse to an optical axis of the camera, wherein the processor bases the reflected image selection on information describing a local participant and/or context of the video communication session.

10. The method of claim 9, wherein the object of interest is a local participant, and wherein, at the first time, the local participant is facing the camera and, at the second time, the local participant is facing the mirror.

11. The method of claim 8, further comprising:

controlling, by the processor, a pan, tilt, or zoom of the camera based on an electronic mirror map comprising one or more of a mirror location defined by set of spatial coordinates, a mirror type, mirror size, and angle of the mirror relative to an optical axis of the camera and wherein the object of interest is a presentation on a presentation surface.

12. The method of claim 8, wherein the processor, at the first time, substitutes a selected image for the reflected image in the image information captured by the field of view of the camera.

13. The method of claim 8, wherein the processor upscales and/or enlarges the reflected image of the object of interest to resemble a size of the object of interest in a non-reflected image captured by the camera, wherein the object of interest is an item on a table or desk, and wherein the mirror is positioned on a horizontal surface of the table or desk to reflect, for capture by the camera, the reflected image of the object.

14. A video-enabled communication system, comprising:

a processor, coupled with a camera, the camera acquiring an image of an object of interest during a video communication session; and

a computer readable medium, coupled with the processor, comprising instructions that cause the processor to select a reflected image of the object of interest for use in providing image information to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in a mirror having a line-of-sight to the camera and wherein the processor extracts the reflected image from a common image captured by the camera, the common image including a non-reflected image of an object other than the object of interest.

15. The system of claim 14, wherein the reflected image is used as an input to generate a three-dimensional image of the object of interest and wherein the image information comprises the three-dimensional image.

16. The system of claim 15, wherein the processor superimposes, on the reflected image, a second image of the object of interest to generate the three-dimensional image and wherein the reflected image and second image of the object of interest are captured at a same time by the camera.

17. The system of claim 14, wherein the processor uses the reflected image to correct image distortion in the image information.

18. The system of claim 14, wherein the object of interest is a participant and wherein the processor uses face detection and motion detection analysis of the reflected image to determine that the object of interest is an active speaker.

19. The system of claim 14, wherein the image information comprises the reflected image.