PRE-TOUCH LOCALIZATION ON A REFLECTIVE SURFACE
First Claim
Patent Images
1. A method comprising:
- acquiring a first image of an object and a reflective surface at a first time with a camera positioned adjacent the reflective surface and having a field of view perpendicular to the reflective surface, wherein the image is reflected into the camera by a mirror positioned adjacent the camera, the mirror being positioned to reflect at least a portion of the reflective surface and a space adjacent the reflective surface;
acquiring a second image of the object and the reflective surface with the camera at a second time;
comparing the first image and the second image and determining a differential between the first image and the second image to identify movement;
identifying in the first image and the second image the object based at least in part on the differential between the first image and the second image;
identifying a convex polygon representing the object based at least in part on the differential between the first image and the second image;
identifying in the first image and the second image a reflection of the object on the reflective surface;
determining three-dimensional coordinates of at least a portion of the object based at least in part on the convex polygon and the reflection of the object in the first image and the second image; and
transforming the three-dimensional coordinates into surface coordinates comprising a graphical marker displayed on the reflective surface.
1 Assignment
0 Petitions
Accused Products
Abstract
Aspects include a method, system, and computer program product for determining the location of an object relative to a reflective surface. The method includes acquiring an image of an object and the reflective surface with a camera, the camera positioned adjacent the reflective surface. The object is identified in the image. A reflection of the object on the reflective surface is identified in the image. Three-dimensional coordinates of at least a portion of the object are determined based at least in part on the object and the reflection of the object in the image.
-
Citations
24 Claims
-
1. A method comprising:
-
acquiring a first image of an object and a reflective surface at a first time with a camera positioned adjacent the reflective surface and having a field of view perpendicular to the reflective surface, wherein the image is reflected into the camera by a mirror positioned adjacent the camera, the mirror being positioned to reflect at least a portion of the reflective surface and a space adjacent the reflective surface; acquiring a second image of the object and the reflective surface with the camera at a second time; comparing the first image and the second image and determining a differential between the first image and the second image to identify movement; identifying in the first image and the second image the object based at least in part on the differential between the first image and the second image; identifying a convex polygon representing the object based at least in part on the differential between the first image and the second image; identifying in the first image and the second image a reflection of the object on the reflective surface; determining three-dimensional coordinates of at least a portion of the object based at least in part on the convex polygon and the reflection of the object in the first image and the second image; and transforming the three-dimensional coordinates into surface coordinates comprising a graphical marker displayed on the reflective surface. - View Dependent Claims (3, 4, 5, 6, 8, 23, 24)
-
-
2. (canceled)
-
7. (canceled)
-
9. A system, the system comprising:
-
a reflective surface; a camera positioned adjacent the reflective surface and having a field of view perpendicular to the reflective surface; a mirror positioned adjacent the reflective surface and the camera, the mirror oriented to reflect at least a portion of the reflective surface and a space adjacent the reflective surface; a memory having computer readable instructions; and one or more processors for executing the computer readable instructions, the one or more processors being coupled to communicate with the camera, the computer readable instructions comprising; acquiring a first image of an object and the reflective surface with the camera at a first time via the mirror; acquiring a second image of the object and the reflective surface with the camera at a second time; comparing the first image and the second image and determining a differential between the first image and the second image to identify movement; identifying in the first image and the second image the object based at least in part on the differential between the first image and the second image; identifying in the first image and the second image a reflection of the object on the reflective surface; determining three-dimensional coordinates of at least a portion of the convex polygon based at least in part on the object and the reflection of the object in the first image and the second image; and transforming the three-dimensional coordinates into surface coordinates comprising a graphical marked displayed on the reflective surface. - View Dependent Claims (11, 12, 13, 14)
-
-
10. (canceled)
-
15. (canceled)
-
16. A computer program product for determining a pre-touch location of an object relative to a reflective surface, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform:
-
acquiring a first image of the object and the reflective surface at a first time with a camera, the camera arranged adjacent the reflective surface and having a field of view perpendicular to the reflective surface, wherein the image is reflected into the camera by a mirror positioned adjacent the camera, the mirror being positioned to reflect at least a portion of the reflective surface and a space adjacent the reflective surface; acquiring a second image of the object and the reflective surface with the camera at a second time; comparing the first image and the second image and determining a differential between the first image and the second image to identify movement; identifying in the first image and the second image the object based at least in part on a differential between the first image and the second image; identifying in the first image and the second image a reflection of the object on the reflective surface; determining three-dimensional coordinates of at least a portion of the object based at least in part on the convex polygon and the reflection of the object in the first image and second image; and transforming the three-dimensional coordinates into surface coordinates comprising a graphical marker displayed on the reflective surface. - View Dependent Claims (18, 19, 20)
-
-
17. (canceled)
-
21. (canceled)
-
22. (canceled)
Specification