Near touch interaction
First Claim
1. A method for determining near touch interaction by a user object, comprising the steps of:
- displaying on a display one or more objects;
acquiring one or more images of the user object by one or more pairs of stereo cameras located adjacent to the display;
dewarping the one or more acquired images;
computing a disparity based upon the dewarped images; and
identifying one or more target regions of the display adjacent to one or more corresponding portions of the disparity that may benefit from refinement, and displaying one or more screen tessellations therein using the light sources that illuminate the display;
wherein the tessellations are interleaved with the actual data, allowing for the display of the structured light without the light being perceived by the user.
1 Assignment
0 Petitions
Accused Products
Abstract
A near-touch interface is provided that utilizes stereo cameras and a series of targeted structured light tessellations, emanating from the screen as a light source and incident on objects in the field-of-view. After radial distortion from a series of wide-angle lenses is mitigated, a surface-based spatio-temporal stereo algorithm is utilized to estimate initial depth values. Once these values are calculated, a subsequent refinement step may be applied in which light source tessellations are used to flash a structure onto targeted components of the scene, where initial near-interaction disparity values have been calculated. The combination of a spherical stereo algorithm, and smoothing with structured light source tessellations, provides for a very reliable and fast near-field depth engine, and resolves issues that are associated with depth estimates for embedded solutions of this approach.
232 Citations
10 Claims
-
1. A method for determining near touch interaction by a user object, comprising the steps of:
-
displaying on a display one or more objects; acquiring one or more images of the user object by one or more pairs of stereo cameras located adjacent to the display; dewarping the one or more acquired images; computing a disparity based upon the dewarped images; and identifying one or more target regions of the display adjacent to one or more corresponding portions of the disparity that may benefit from refinement, and displaying one or more screen tessellations therein using the light sources that illuminate the display; wherein the tessellations are interleaved with the actual data, allowing for the display of the structured light without the light being perceived by the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
Specification