Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
First Claim
1. A method for providing a graphical user interface to convey intent of a user based at least in part on movement of the user'"'"'s one or both eyes using a detector, the method comprising:
- identifying, with the detector, when the user'"'"'s one or both eyes are directed at a first key of a first keyboard;
identifying, with the detector, a first one or more saccades of the user'"'"'s one or both eyes from the first key towards, not within a pre-determined distance from, a second key of a second keyboard that has a set of keys;
confirming, with the detector, that one or more corrective saccades toward the location of the second key for the first one or more saccades are completed to within the pre-determined distance from the location of the second key; and
performing an action associated with one or both of the first key and the second key, without waiting for perception of the second key by the user.
3 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system may be included within unobtrusive headwear that performs eye tracking and controls screen display. The system may also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.
-
Citations
28 Claims
-
1. A method for providing a graphical user interface to convey intent of a user based at least in part on movement of the user'"'"'s one or both eyes using a detector, the method comprising:
-
identifying, with the detector, when the user'"'"'s one or both eyes are directed at a first key of a first keyboard; identifying, with the detector, a first one or more saccades of the user'"'"'s one or both eyes from the first key towards, not within a pre-determined distance from, a second key of a second keyboard that has a set of keys; confirming, with the detector, that one or more corrective saccades toward the location of the second key for the first one or more saccades are completed to within the pre-determined distance from the location of the second key; and performing an action associated with one or both of the first key and the second key, without waiting for perception of the second key by the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method for providing a graphical user interface to convey intent of a user based at least in part on movement of the user'"'"'s one or both eyes using a first keyboard, a second keyboard, and a detector, the method comprising:
-
identifying, with the detector, when the user'"'"'s one or both eyes are directed within a predetermined distance from a location of a first key on the first or second keyboard, wherein at least one key of the first or second keyboard is activatable using a single saccadic eye movement while other keys of the first and second keyboards are activatable using two saccadic eye movements, wherein the second keyboard is positioned vertically adjacent and in a same orientation as the first keyboard relative to the user'"'"'s eyes, the second keyboard having a same set of keys in a same layout as the first keyboard, and wherein most frequently used keys of one or more of the first and second keyboards occupy one or more central rows of a plurality of rows of keys of the keyboards; identifying, with the detector, a first one or more saccades of the user'"'"'s one or both eyes from the first key towards, not within a pre-determined distance from, a second key on the keyboard; confirming, with the detector, that one or more corrective saccades toward a location of the second key for the one or more saccades are completed to within the pre-determined distance from the location of the second key; and performing an action associated with one or both of the first key and the second key. - View Dependent Claims (19, 20, 21, 22, 23)
-
-
24. A graphical user interface to determine intent of a user based at least in part on movement of the user'"'"'s one or both eyes, the graphical user interface comprising:
-
a projector configured to display at least a first keyboard; a detector configured to; identify when the user'"'"'s one or both eyes are directed at a first key of the first keyboard, wherein at least one key of the first keyboard is activatable using a single saccadic eye movement while other keys of the first keyboard are activatable using two saccadic eye movements; identify a first one or more saccades of the user'"'"'s one or both eyes from the first key towards, not within a pre-determined distance from, a second key of a second keyboard; confirm that one or more corrective saccades toward a location of the second key for the first one or more saccades are completed to within a pre-determined distance from the location of the second key; and a processor configured to perform an action associated with one or both of the first key and the second key in response to confirmation that the one or more corrective saccades for the first one or more saccades are completed to within the pre-determined distance from the location of the second key, without waiting for perception of the second key by the user. - View Dependent Claims (25, 26, 27, 28)
-
Specification