Controlling light sources of a directional backlight

• US 9,872,007 B2
• Filed: 06/30/2016
• Issued: 01/16/2018
• Est. Priority Date: 06/17/2013
• Status: Active Grant

• Current Assignee: Reald Spark, LLC
• Original Assignee: Reald Spark, LLC
• Inventors: Woodgate, Graham J., Robinson, Michael G., Hill, Adrian J.
• Primary Examiner(s): Laekemariam, Yosef K
• Application Number:
  US15/199,106
• Publication Number:
  US 20160316188A1
• Time in Patent Office: 565 Days
• Field of Search: 348 1407, 348 1408, 348 47, 348 48, 348 E5058, 348E13024, 348E13044, 348E13049
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 2213/001 Constructional or mechanical details
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Teleconferencing is performed between two telecommunication devices having a display device and a stereoscopic pair of cameras positioned outside opposed sides of the display device at the same level partway along those sides. The separation between the centers of the cameras is in a range having a lower limit of 60 mm and an upper limit of 110 mm to improve the perceived roundness in a displayed stereoscopic image of a head. In captured stereo images that are video images, a head is segmented and the segmented backgrounds are replaced by replacement images that have a lower degree of perceived stereoscopic depth to compensate for non-linear depth perception in the displayed stereo images. Images are shifted vertically to position an eye-line of a detected face at the level of the stereoscopic pair of cameras of the telecommunication device where the images are displayed, improving the naturalness of the displayed image.

Claims

1. A teleconferencing method for a source telecommunication device and a destination telecommunication device, the method comprising:

transmitting delivery images captured by one or both of a stereoscopic pair of cameras of the source telecommunication device from the source telecommunication device to the destination telecommunication device over a telecommunication network, the stereoscopic pair of cameras positioned outside opposed sides of a display device of the source telecommunication device at the same level partway along the opposed sides;

transmitting return images captured by at least one camera of the destination telecommunication device from the destination telecommunication device to the source telecommunication device over the telecommunication network;

detecting a face in the return images;

shifting the return images vertically to position an eye-line of the detected face at the level of the stereoscopic pair of cameras of the source telecommunication device in a predetermined orientation in which the vertical sides of the return images are aligned with said opposed sides of the display device; and

displaying the shifted return images on the display device of the source telecommunication device in said predetermined orientation.

2. A teleconferencing method according to claim 1, wherein said step of transmitting delivery images comprises transmitting stereo delivery images captured by both of the stereoscopic pair of cameras of the source telecommunication device.

3. A teleconferencing method according to claim 1, wherein the destination telecommunication device comprises a second stereoscopic pair of cameras positioned outside opposed sides of a display device of the destination telecommunication device.

4. A teleconferencing method according to claim 3, wherein said step of transmitting return images comprises transmitting stereo return images captured by both of the second stereoscopic pair of cameras of the destination telecommunication device, and

displaying the shifted return images comprises displaying the shifted return images on the display device of the source telecommunication device autostereoscopically.

5. A teleconferencing method according to claim 3, further comprising:

detecting a second face in the delivery images;

shifting the delivery images to position an eye-line of the detected second face at the level of the second stereoscopic pair of cameras of the destination telecommunication device in a second predetermined orientation in which the vertical sides of the delivery images are aligned with said opposed sides of the display device of the destination telecommunication device; and

displaying the shifted delivery images on the display device of the destination telecommunication device in said second predetermined orientation.

6. A teleconferencing method according to claim 1, further comprising displaying the delivery images on a display device of the destination telecommunication device.

7. A teleconferencing method according to claim 1, wherein the display device of the source telecommunication device is rectangular, having one pair of opposed sides that is longer than the other pair of opposed sides, said stereoscopic pair of cameras of the source telecommunication device being positioned outside the longer opposed sides of the display device.

8. A teleconferencing method according to claim 7, wherein said stereoscopic pair of cameras of the source telecommunication device are positioned at the same level less than half-way along the longer opposed sides below the side of the display device of the source telecommunication device that is the upper side with respect to said predetermined orientation.

9. A teleconferencing method according to claim 1, further comprising shifting the return images horizontally to position the center line of the detected face centrally in the predetermined orientation.

10. A teleconferencing method according to claim 1, wherein detecting a face in the return images comprises detecting features of the face including eye features, said eye-line of the detected face defined relative to the detected eye features.

11. A teleconferencing method according to claim 1, wherein the images are video images.

12. A teleconferencing method according to claim 1, wherein detecting faces and shifting the return images is performed in the source telecommunication device.

13. A teleconferencing method according to claim 1, wherein shifting the return images is performed in the destination telecommunication device.

14. A teleconferencing method according to claim 1, wherein the return images are transmitted through a server in the telecommunication network between the source telecommunication device and the destination telecommunication device, the steps of detecting faces and shifting the return images being performed in the server.

15. A source telecommunication device for providing teleconferencing, comprising:

a display device;

a stereoscopic pair of cameras positioned outside opposed sides of the display device at the same level partway along those sides, the source telecommunication device being arranged to transmit delivery images captured by one or both of the stereoscopic pair of cameras of the source telecommunication device to a destination telecommunication device over a telecommunication network, and to receive return images captured by at least one camera of the destination telecommunication device over the telecommunication network; and

an image processing section arranged to detect a face in the return images and to shift the return images to position an eye-line of the detected face at the level of the stereoscopic pair of cameras in a predetermined orientation in which the vertical sides of the return images are aligned with said opposed sides of the display device, the source telecommunication device being arranged to display the shifted return images on the display device in the predetermined orientation.

16. A destination telecommunication device for providing teleconferencing, comprising:

a display device of the destination telecommunication device;

at least one camera, the destination telecommunication device being arranged to transmit return images captured by the at least one camera to a source telecommunication device that comprises a display device of the source telecommunication device and a stereoscopic pair of cameras positioned outside opposed sides of the display device at the same level partway along those sides, over a telecommunication network, and to receive delivery images captured by the source telecommunication device over the telecommunication network; and

a processing section arranged to shift the return images to position an eye-line of a detected face in the return images at the level of the stereoscopic pair of cameras in a predetermined orientation in which the vertical sides of the return images are aligned with said opposed sides of the display device of the source telecommunication device.