ADAPTIVE ADJUSTMENT OF DEPTH CUES IN A STEREO TELEPRESENCE SYSTEM

• US 20110316984A1
• Filed: 06/28/2010
• Published: 12/29/2011
• Est. Priority Date: 06/28/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lanier, Jaron Zepel, Lee, Johnny Chung, Akeley, Kurt Barton
• Granted Patent: US 8,692,870 B2
• Time in Patent Office: Days
• US Class Current: 348/51
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity

Abstract

Described is a stereoscopic display (telepresence) system that includes a depth cue adjustment mechanism for changing screen disparity to move a fixation distance of a viewer (subject) closer to a focus distance, thereby providing more desirable viewing conditions. In one aspect, the depth cue adjustment mechanism adjusts a depth cue by moving the fixation distance forward, and/or by moving the focus distance backward. Also described is detecting encroachment, where the object is perceived as being too close to the subject viewer for comfort, and adjusting one or more depth cues (e.g., object scale) to counteract the sensation of the encroachment.

Claims

1. A system comprising, a stereoscopic display on which a subject views an object, the display coupled to a mechanism that adjusts stereo screen disparity to reduce the disparity between a fixation distance of the subject and a focus distance of the subject.

2. The system of claim 1 wherein the stereoscopic display is part of a telepresence system.

3. The system of claim 1 wherein the mechanism adjusts the stereo screen disparity by shifting left and right stereoscopic images relative to one another as perceived by the subject to move the fixation distance closer to the focus distance.

4. The system of claim 1 wherein the mechanism adjusts the stereo screen disparity by sensing focus and dynamically providing sharp images at a focus distance that is close to the fixation distance.

5. The system of claim 1 wherein the mechanism adjusts one or more depth cues when likely encroachment is detected to counteract a sensation of encroachment.

6. The system of claim 5 wherein the likely encroachment is detected based on processing video of the subject to determine the likely encroachment from one or more reactions of the subject.

7. The system of claim 5 wherein when likely encroachment is detected, the mechanism adjusts one or more depth cues to make the object appear farther away as perceived by the subject.

8. The system of claim 5 wherein when likely encroachment is detected, the mechanism shifts left and right stereoscopic images relative to one another as perceived by the subject to move the fixation distance farther from the focus distance at a relatively fast rate, scales the object smaller to make the object appear farther away as perceived by the subject at a relatively slow rate, and shifts the left and right stereoscopic images relative to one another to move the fixation distance back closer to the focus distance.

9. The system of claim 1 wherein the mechanism adjusts screen the disparity at one or more various times in an attempt to reduce fatigue.

10. The system of claim 1 wherein the one or more depth cues comprise fixation distance, scale, retinal disparity, stereo screen disparity, focus depth, or depth of field blur, or any combination of fixation distance, scale, retinal disparity, stereo screen disparity, focus depth, or depth of field blur.

11. A method performed on at least one processor, comprising, adjusting screen disparity to move a fixation distance of a stereoscopic image comprising left and right images closer to a focus distance, sensing for likely encroachment, and if detected, altering one or more depth cues to counteract the encroachment.

12. The method of claim 11 wherein the stereoscopic image comprises frames received by a subject component corresponding to an object in a telepresence system, and further comprising, sending video signals of a subject to a display corresponding to the object.

13. The method of claim 11 wherein adjusting the screen disparity comprises shifting the left and right images relative to one another.

14. The method of claim 11 wherein adjusting the screen disparity comprises blurring to move the focus distance.

15. The method of claim 11 wherein altering the one or more depth cues comprises scaling at least part of the stereoscopic image to make the image appear farther from a viewer.

16. The method of claim 11 further comprising, adjusting at least one depth cue over time in an attempt to reduce fatigue.

17. The method of claim 11 wherein sensing for likely encroachment comprises processing video of a subject viewing the stereoscopic image to detect for one or more reactions indicative of sensed encroachment.

18. A system comprising, a telepresence system that receives left and right stereo images of an object over a plurality of frames, the telepresence system adjusting screen disparity to reduce a difference between a fixation distance of stereoscopic video corresponding to a sequence of the left and right stereo images closer to a focus distance, and dynamically adjusting one or more depth cues to counteract encroachment.

19. The system of claim 18 wherein adjusting the screen disparity comprises moving the fixation distance forward.

20. The system of claim 18 wherein adjusting the screen disparity comprises moving the focus distance backward.