Point of view determinations for finger tracking
First Claim
1. A computer-implemented method of determining input for a computing device, comprising:
- capturing a first image using a first camera of the computing device and a second image using a second camera of the computing device, the first and second cameras having overlapping fields of view;
analyzing, using at least one processor of the computing device, the first image to determine a first relative position of a fingertip of a user and a first relative position corresponding to eyes of the user;
analyzing, using the at least one processor of the computing device, the second image to determine a second relative position of the fingertip and a second relative position corresponding to the eyes;
based at least in part upon the first relative position of the fingertip, the second relative position of the fingertip, the first relative position corresponding to the eyes, and the second relative position corresponding to the eyes, determining a three-dimensional fingertip position and a position corresponding to the eyes in three-dimensional space;
calculating, using the at least one processor of the computing device, a vector passing through the three-dimensional fingertip position and the position corresponding to the eyes in three-dimensional space; and
determining, using the at least one processor of the computing device, an input location based at least in part upon the vector and a tilt of the computing device with respect to the user.
1 Assignment
0 Petitions
Accused Products
Abstract
A user can provide input to a computing device by moving a feature or object, such as a user'"'"'s finger, within a field of view of at least one imaging element of the computing device. In order to ensure an accuracy of the determined input, the computing device can also attempt to determine a point of view of the user, such as by determining a relative position of the user'"'"'s face or eyes. By determining a three-dimensional position of a feature and the user'"'"'s point of view, a three-dimensional vector or other directional information can be determined whereby the intersection of that vector with the computing device indicates an intended location of input corresponding to the feature from the user'"'"'s point of view.
160 Citations
30 Claims
-
1. A computer-implemented method of determining input for a computing device, comprising:
-
capturing a first image using a first camera of the computing device and a second image using a second camera of the computing device, the first and second cameras having overlapping fields of view; analyzing, using at least one processor of the computing device, the first image to determine a first relative position of a fingertip of a user and a first relative position corresponding to eyes of the user; analyzing, using the at least one processor of the computing device, the second image to determine a second relative position of the fingertip and a second relative position corresponding to the eyes; based at least in part upon the first relative position of the fingertip, the second relative position of the fingertip, the first relative position corresponding to the eyes, and the second relative position corresponding to the eyes, determining a three-dimensional fingertip position and a position corresponding to the eyes in three-dimensional space; calculating, using the at least one processor of the computing device, a vector passing through the three-dimensional fingertip position and the position corresponding to the eyes in three-dimensional space; and determining, using the at least one processor of the computing device, an input location based at least in part upon the vector and a tilt of the computing device with respect to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method of determining input to an electronic device, comprising:
under control of one or more computing devices including executable instructions, obtaining image information captured using at least two image capture elements of the electronic device; analyzing the image information to determine a first three-dimensional position of a determined feature of a user; analyzing the image information to determine a second three-dimensional position corresponding to at least one eye of the user; and calculating an input location on the electronic device where the user is attempting to provide input to the electronic device, the input location corresponding to a tilt of the electronic device with respect to the user and a vector passing through the first three-dimensional position and the second three-dimensional position. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
22. A computing device, comprising:
-
a device processor; at least two image capture elements; and a memory device including instructions operable to be executed by the processor to perform a set of actions, causing the computing device to; obtain image information captured using at least two image capture elements of the computing device; analyze the image information to determine a first three-dimensional position of a determined feature of a user; analyze the image information to determine a second three-dimensional position corresponding to at least one eye of the user; and calculate an input location on the computing device where the user is attempting to provide input to the computing device, the input location corresponding to a tilt of the computing device with respect to the user and a vector passing through the first three-dimensional position and the second three-dimensional position. - View Dependent Claims (23, 24, 25, 26)
-
-
27. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of a computing device, cause the computing device to:
-
obtain image information captured using at least two image capture elements of the computing device; analyze the image information to determine a first three-dimensional position of a determined feature of a user; analyze the image information to determine a second three-dimensional position corresponding to at least one of the user; and calculate an input location on the computing device where the user is attempting to provide input to the computing device, the input location corresponding to a tilt of the computing device with respect to the user and a vector passing through the first three-dimensional position and the second three-dimensional position. - View Dependent Claims (28, 29, 30)
-
Specification