Display selection for video conferencing

• US 9,374,554 B1
• Filed: 03/25/2014
• Issued: 06/21/2016
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Poulad, Navid
• Primary Examiner(s): El-Zoobi, Maria
• Application Number:
  US14/225,219
• Time in Patent Office: 819 Days
• Field of Search: 348 1401- 1409
• US Class Current: 1/1
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 9/3141 Constructional details thereof details not peculiar to the presence of an electronic spatial light modulator G03B21/14

Abstract

A video conferencing device has a projector that can be controlled to project far-end video onto different available display surfaces. A panoramic camera is mounted so that it captures a horizontal panorama that includes near-end users. When projecting far-end video, a display surface is selected based on the position of the users. Specifically, a display surface is selected such that when gazing at the far-end video the faces of the user are visible from the panoramic camera.

Claims

1. A video conferencing system, comprising:

a video projector that is controllable to project far-end video;

a video camera configured to capture, as captured video, video encompassing a 360 degree horizontal panorama;

wherein the video projector is controllable to pan and tilt independently of the video camera; and

operating logic configured to perform actions comprising;

determining a first display area suitable to receive the far-end video projected by the video projector;

determining a second display area suitable to receive the far-end video projected by the video projector;

analyzing the captured video to determine a first location of a first user;

selecting the first display area such that the video camera is between the first location and the first display area;

controlling the video projector to project the far-end video onto the first display area based at least in part on determining that the first user is speaking;

analyzing the captured video to determine a second location of a second user;

selecting the second display area such that the video camera is between the second location and the second display area;

determining that the second user is speaking;

controlling the video projector to project the far-end video onto the second display area; and

extracting a portion of the captured video that contains a face of the first user to produce near-end video.

2. The video conferencing system of claim 1, wherein analyzing the captured video to determine the first display area and the second display area is performed upon initiating a video conference.

3. The video conferencing system of claim 1, the actions further comprising

selecting a display area such that the video camera is between the second location and the first display area.

4. A device, comprising:

a projector positioned within a first environment;

a camera; and

logic configured to perform actions comprising;

receiving an image from the camera, the image associated with the first environment;

determining, based at least in part on the image, a first display area suitable to receive content projected by the projector;

determining, based at least in part on the image, a second display area suitable to receive the content projected by the projector;

selecting the first display area such that the camera is between a first user and the first display area;

controlling the projector to project the content onto the first display area, the content associated with a second environment remote from the first environment;

selecting the second display area such that the camera is between a second user and the second display area; and

controlling the projector to project the content onto the second display area.

5. The device of claim 4, wherein the camera is configured to capture video encompassing a 360 degree horizontal panorama.

6. The device of claim 4, wherein the projector is configured to pan about a vertical axis.

7. The device of claim 4, wherein:

the projector is configured to pan about vertical and horizontal axes; and

the camera is configured to maintain a constant horizontal attitude.

8. The device of claim 4, the actions further comprising:

receiving the content from a remote site; and

transmitting the image to the remote site.

9. The device of claim 4, the actions further comprising determining a direction of a gaze associated with the first user and wherein the first display area is visible to the first user.

10. The device of claim 4, wherein the image includes the second user.

11. The device of claim 4, the actions further comprising detecting the second user within the first environment.

12. A method, comprising:

detecting a first location of a first user relative to a camera;

determining a first area suitable to display content;

determining a second area suitable to display the content;

selecting the first area based at least in part on the first location of the first user, wherein the first area is selected such that the camera is between the first area and the first location;

displaying the content at the first area;

capturing an image of the first user with the camera;

detecting a second location of a second user relative to the camera;

selecting the second area based at least in part on the second location of the second user, wherein the second area is selected such that the camera is between the second area and the second location; and

alternatively displaying the content at the first area and the second area.

13. The method of claim 12, wherein detecting the first location comprises:

capturing a panoramic image with the camera, wherein the panoramic image encompasses 360 degrees;

detecting a position of a face of the first user in the panoramic image relative to the 360 degrees encompassed by the panoramic image; and

determining a direction of the face of the first user relative to the camera based on the position of the face of the first user in the panoramic image relative to the 360 degrees encompassed by the panoramic image.

14. The method of claim 12, further comprising:

receiving the content from a remote site; and

transmitting the image to the remote site.

15. The method of claim 12, wherein the first location comprises at least a direction relative to the camera.

16. The method of claim 12, further comprising:

selecting the first area such that the camera is between the first area and the second location; and

capturing an additional image of the second user with the camera.