IMAGE-BASED HEAD POSITION TRACKING METHOD AND SYSTEM
First Claim
1. A method for controlling a computing device, comprising:
- obtaining a digital image of a face of a user of the computing device with a digital camera;
processing the digital image to determine a position and orientation of an anatomical structure of the user that is beneath a surface of the user'"'"'s skin; and
translating the position determined and the orientation of the anatomical structure into an input command.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for tracking a head position of a user include obtaining digital images of the user'"'"'s head, processing the images to locate anatomical structures beneath the visible surface, and using those determined locations as inputs to a computing device. In an embodiment, images of a user'"'"'s face are processed to identify the irises of the eyes, identify pixels along a boundary between each iris and the surrounding sclera, determine an ellipse defined by the identified iris-sclera boundary pixels, determine a distance-to-pixel ratio based on a pixel length of a long axis of such an ellipse compared to a known or presumed diameter of the iris, locating the iris in a three-axis coordinate system, determining an optical axis vector of the eye in the three-axis coordinate system, and calculating a center of the eyeball based on the optical axis vector and a known or presumed eyeball radius.
77 Citations
44 Claims
-
1. A method for controlling a computing device, comprising:
-
obtaining a digital image of a face of a user of the computing device with a digital camera; processing the digital image to determine a position and orientation of an anatomical structure of the user that is beneath a surface of the user'"'"'s skin; and translating the position determined and the orientation of the anatomical structure into an input command. - View Dependent Claims (2, 3, 4)
-
-
5. A method for determining a radius of an eyeball, comprising:
-
prompting a user to look in a first direction; obtaining a digital image of the user'"'"'s face; calculating a first optical axis vector for an eye based on the obtained image; prompting the user to look in a second direction; obtaining a digital image of the user'"'"'s face; calculating a second optical axis vector for an eye based on the obtained image; determining an intersection point of the first and second optical axis vectors; and calculating the radius of the eyeball as a distance between the determined intersection point of the first and second optical axis vectors and a surface of the eyeball.
-
-
6. A method for implementing a user input on a graphical user interface, comprising:
-
determining a location of an eyeball center point for each of a user'"'"'s eyes; calculating an optical axis vector for each of the user'"'"'s eyes based on the determined location of an eyeball center point for each of the user'"'"'s eyes; calculating a first visual axis for one of the user'"'"'s eyes and a second visual axis for the other of the user'"'"'s eyes based on the eyeball center points and the optical axes vectors; determining the user'"'"'s point-of-gaze, wherein the point-of-gaze comprises a point of intersection of the first and second visual axes; and selecting a user input feature on the graphical user interface when the user'"'"'s point-of-gaze is stationary for a predetermined duration of time. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A method of verifying a user'"'"'s identity using a computing device, comprising:
-
determining three-dimensional locations of an eyeball center point for each of the user'"'"'s eyes based upon locations of iris disc center points of the user'"'"'s eyes obtained from a digital image; calculating an iris section line of the iris for the user'"'"'s eye based on the determined eyeball center points; creating an iris contour map from the iris section line; and comparing the iris contour map to biometric information stored in the computing device, wherein the stored biometric information comprises iris contour map data for at least one authorized user.
-
-
12. A computing device, comprising:
-
a digital camera; and a processor coupled to the camera and configured with processor-executable instructions to perform operations comprising; obtaining a digital image of a face of a user of the computing device with the digital camera; processing the digital image to determine a position and orientation of an anatomical structure of the user that is beneath a surface of the user'"'"'s skin; and translating the position determined and the orientation of the anatomical structure into an input command. - View Dependent Claims (13, 14, 15)
-
-
16. A computing device, comprising:
-
a digital camera; and a processor coupled to the camera and configured with processor-executable instructions to perform operations comprising; prompting a user to look in a first direction; obtaining a first digital image of the user'"'"'s face with the digital camera; calculating a first optical axis vector for an eye based on the first digital image; prompting the user to look in a second direction; obtaining a second digital image of the user'"'"'s face; calculating a second optical axis vector for an eye based on the second digital image based on the obtained image; determining an intersection point of the first and second optical axis vectors; and calculating the radius of the eyeball as a distance between the determined intersection point of the first and second optical axis vectors and a surface of the eyeball.
-
-
17. A computing device for implementing a user input on a graphical user interface, comprising:
-
a digital camera; a display screen; and a processor coupled to the digital camera and display, wherein the processor is configured with processor-executable instructions to perform operations comprising; displaying a user interface feature on the graphical user interface presented on the display screen; obtaining a digital image of a user'"'"'s eyes using the digital camera; determining a location of an eyeball center point for each of the user'"'"'s eyes based on the determined location of an eyeball center point for each of the user'"'"'s eyes; calculating an optical axis vector for each of the user'"'"'s eyes; calculating a first visual axis for one of the user'"'"'s eyes and a second visual axis for the other of the user'"'"'s eyes based on the eyeball center points and the optical axes vectors; determining the user'"'"'s point-of-gaze on the display screen, wherein the point-of-gaze comprises a point of intersection of the first and second visual axes; and selecting the user interface feature on the graphical user interface when the user'"'"'s point-of-gaze is stationary for a predetermined duration of time. - View Dependent Claims (18, 19, 20, 21)
-
-
22. A computing device configured to verify a user'"'"'s identity, comprising:
-
a digital camera; and a processor coupled to the display, wherein the processor is configured with processor-executable instructions to perform operations comprising; determining three-dimensional locations of an eyeball center point for each of the user'"'"'s eyes based upon locations of iris disc center points of the user'"'"'s eyes obtained from a digital image; calculating an iris section line of the iris for the user'"'"'s eye based on the determined eyeball center points; creating an iris contour map from the iris section line; and comparing the iris contour map to biometric information stored in the computing device, wherein the stored biometric information comprises iris contour map data for at least one authorized user.
-
-
23. A computing device, comprising:
-
means for obtaining a digital image of a face of a user of the computing device; means for processing the digital image to determine a position and orientation of an anatomical structure of the user that is beneath a surface of the user'"'"'s skin; and means for translating the position determined and the orientation of the anatomical structure into an input command. - View Dependent Claims (24, 25, 26)
-
-
27. A computing device, comprising:
-
means for prompting a user to look in a first direction; means for obtaining a first digital image of the user'"'"'s face; means for calculating a first optical axis vector for an eye based on the first digital image; means for prompting the user to look in a second direction; means for obtaining a second digital image of the user'"'"'s face; calculating a second optical axis vector for an eye based on the second digital image based on the obtained image; means for determining an intersection point of the first and second optical axis vectors; and means for calculating the radius of the eyeball as a distance between the determined intersection point of the first and second optical axis vectors and a surface of the eyeball.
-
-
28. A computing device for implementing a user input on a graphical user interface, comprising:
-
means for displaying a clickable feature on a display screen; means for obtaining a digital image of a user'"'"'s eyes; means for determining a location of an eyeball center point for each of the user'"'"'s eyes based on the determined location of an eyeball center point for each of the user'"'"'s eyes; means for calculating an optical axis vector for each of the user'"'"'s eyes; means for calculating a first visual axis for one of the user'"'"'s eyes and a second visual axis for the other of the user'"'"'s eyes based on the eyeball center points and the optical axes vectors; means for determining the user'"'"'s point-of-gaze on the display screen, wherein the point-of-gaze comprises a point of intersection of the first and second visual axes; and means for selecting the user interface feature on the graphical user interface when the user'"'"'s point-of-gaze is stationary for a predetermined duration of time. - View Dependent Claims (29, 30, 31, 32)
-
-
33. A computing device configured to verify a user'"'"'s identity, comprising:
-
means for determining three-dimensional locations of an iris disc center point for each of the user'"'"'s eyes based upon locations of iris disc center points of the user'"'"'s eyes obtained from a digital image; means for determining a three-dimensional location of an eyeball center point for each of the user'"'"'s eyes based on the determined eyeball center points; means for calculating an iris section line of the iris for the user'"'"'s eye; means for creating an iris contour map from the iris section line; and means for comparing the iris contour map to biometric information stored in the computing device, wherein the stored biometric information comprises iris contour map data for at least one authorized user.
-
-
34. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a computing device including a digital camera to perform operations comprising:
-
obtaining a digital image of a face of a user of the non-transitory processor-readable storage medium with the digital camera; processing the digital image to determine a position and orientation of an anatomical structure of the user that is beneath a surface of the user'"'"'s skin; and translating the position determined and the orientation of the anatomical structure into an input command. - View Dependent Claims (35, 36, 37)
-
-
38. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a computing device including a digital camera to perform operations comprising:
-
prompting a user to look in a first direction; obtaining a first digital image of the user'"'"'s face with the digital camera; calculating a first optical axis vector for an eye based on the first digital image; prompting the user to look in a second direction; obtaining a second digital image of the user'"'"'s face; calculating a second optical axis vector for an eye based on the second digital image based on the obtained image; determining an intersection point of the first and second optical axis vectors; and calculating the radius of the eyeball as a distance between the determined intersection point of the first and second optical axis vectors and a surface of the eyeball.
-
-
39. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a computing device including a digital camera and a display screen to perform operations comprising:
-
displaying a user interface feature on a graphical user interface presented on the display screen; obtaining a digital image of a user'"'"'s eyes using the digital camera; determining a location of an eyeball center point for each of the user'"'"'s eyes based on the determined location of an eyeball center point for each of the user'"'"'s eyes; calculating an optical axis vector for each of the user'"'"'s eyes; calculating a first visual axis for one of the user'"'"'s eyes and a second visual axis for the other of the user'"'"'s eyes based on the eyeball center points and the optical axes vectors; determining the user'"'"'s point-of-gaze on the display screen, wherein the point-of-gaze comprises a point of intersection of the first and second visual axes; and selecting the user interface feature on the graphical user interface when the user'"'"'s point-of-gaze is stationary for a predetermined duration of time. - View Dependent Claims (40, 41, 42, 43)
-
-
44. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a computing device including a digital camera to perform operations comprising:
-
determining a three-dimensional location of an eyeball center point for each of the user'"'"'s eyes based upon locations of iris disc center points of the user'"'"'s eyes obtained from a digital image; calculating an iris section line of the iris for the user'"'"'s eye based on the determined eyeball center points; creating an iris contour map from the iris section line; and comparing the iris contour map to biometric information stored in the non-transitory processor-readable storage medium, wherein the stored biometric information comprises iris contour map data for at least one authorized user.
-
Specification