Method and apparatus to virtualize people with 3D effect into a remote room on a telepresence call for true in person experience

• US 8,487,977 B2
• Filed: 01/26/2010
• Issued: 07/16/2013
• Est. Priority Date: 01/26/2010
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Saleh, Youssef, Paripally, Gopal
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US12/694,109
• Publication Number:
  US 20110181685A1
• Time in Patent Office: 1,267 Days
• Field of Search: 313/417, 313/496, 313/495, 315/154, 315/382, 345/102, 345/175, 345/547, 345/602, 348/14.07, 348/14.08, 348/211.12, 348/446, 348/453, 348/602, 348/14.16, 358/1.9, 358/1.15, 358/474, 362/430, 374/162, 399/66, 434/98, 455/550.1, 353/60
• US Class Current: 348/14.08
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

A video conference system provides “in the room” telepresence to near end participants. The video conference system includes a frameless or bezelless display device placed in front of a front wall for displaying edge-to-edge 3D images of far end participants. Color of the near end front wall is configured to be the same as the color of the far end rear wall. As a result, images displayed on the display device can merge or blend into the near end front wall, giving the near end participants the perception that the far end participants are actually in the near end conference room. Brightness of the faces/bodies of the near end participants can also be adjusted to match the brightness of the face/bodies of the images of the far end participants as they appear on the display device—therefore enhancing the in the room perception of the far end participants.

Claims

1. A telepresence video conference unit comprising:

a display device adapted to be placed in front of a near end front wall and configured to display an image of at least a portion of a far end rear wall; and

a controller configured to control at least one color light source to illuminate at least a portion of the near end front wall such that a perceived color of the portion of the near end front wall matches a color of the image of the portion of the far end rear wall,

wherein the display device is devoid of a frame or bezel.

2. The telepresence video conference unit of claim 1, wherein the at least one color light source is positioned on a side of the display device that faces the near end front wall.

3. The telepresence video conference unit of claim 1, wherein the controller is further configured to control one or more near end conference room lights such that a brightness of the face or body of at least one near end participant is substantially the same as a brightness of an image of the face or body of at least one far end participant displayed on the display screen.

4. The telepresence video conferencing unit of claim 1, wherein the display device is configured to display images in 3D.

5. The telepresence video conference unit of claim 1, wherein the color of the image of the portion of the far end rear wall is received from the far end conference unit.

6. The telepresence video conference unit of claim 5, wherein the controller determines the color of the image of the portion of the far end rear wall from at least one video frame received from the far end conference unit.

7. The telepresence video conference unit of claim 5, wherein the controller determines the color of the image of the portion of the far end rear wall from at least one identification tag received from the far end conferencing unit.

8. The telepresence video conference unit of claim 6, wherein the controller determines the color of the image of the portion of the far end rear wall from at least one subframe of the at least one video frame received from the far end conference unit.

9. The telepresence video conference unit of claim 3, wherein information of the brightness of an image of the face or body of at least one far end participant displayed on the display screen is received from the far end conference device.

10. The telepresence video conference unit of claim 9, wherein information of the brightness of an image of the face or body of at least one far end participant displayed on the display screen is determined by the controller from at least one video frame received from the far end conference unit.

11. The telepresence video conference unit of claim 9, wherein the controller determines the brightness of an image of the face or body of at least one far end participant from at least one identification tag received from the far end conferencing unit.

12. A method for telepresence video conferencing between a near end conference unit a far end conferencing unit comprising:

displaying an image of at least a portion of a far end rear wall on a display device adapted to be placed in front of a near end front wall; and

illuminating at least a portion of the near end front wall such that a perceived color of the portion matches a color of the image of the portion of the far end rear wall,

wherein the display device is devoid of a frame or bezel.

13. The method of claim 12, further comprising positioning the at least one color light source on a side of the display device that faces the near end front wall.

14. The method of claim 12, further comprising controlling one or more near end conferencing room lights such that a brightness of the face or body of at least one near end participant matches a brightness of an image of the face or body of at least one far end participant displayed on the display screen.

15. The method of claim 12, further comprising displaying an image of at least one far end participant on the display device in 3D.

16. The method of claim 12, further comprising receiving information on the color of the image of the portion of the far end rear wall from the far end conferencing unit.

17. The method of claim 16, further comprising determining the color of the image of the portion of the far end rear wall from at least one video frame received from the far end conference unit.

18. The method of claim 16, further comprising determining the color of the image of the portion of the far end rear wall from at least one identification tag received from the far end conference unit.

19. The method of claim 14, further comprising receiving information of the brightness of the image of the face or body of at least one far end participant from the far end conferencing unit.

20. The method of claim 19, further comprising determining the brightness of the image of the face or body of at least one far end participant displayed on the display screen from at least one video frame received from the far end conferencing unit.

21. The method of claim 19, further comprising determining the brightness of the image of the face or body of at least one far end participant from at least one identification tag received from the far end conference unit.

22. A telepresence video conferencing unit comprising:

a controller configured to transmit color information of at least one portion of a near end rear wall and at least one label for identifying the color information to be associated with the at least one portion of the near end rear wall.

23. The telepresence video conferencing unit of claim 22, wherein the controller is further configured to transmit brightness information of a face or body of at least one near end participant and at least one label identifying the brightness information to be associated with the face or body of at least one near end participant.

24. The telepresence video conferencing unit of claim 22, wherein the controller determines color information of the at least one portion of the near end wall from pixels associated with the at least one portion of the near end wall in a near end video frame.

25. The telepresence video conferencing unit of claim 23, wherein the controller determines brightness information of the face or body of the at least one near end participant from pixels associated with the face or body of the at least one near end participant in a near end video frame.