Eye-wearable device user interface and augmented reality method
First Claim
1. A method of controlling a head-mountable device for transmitting and receiving information from a human user with at least one eye, said device comprising:
- a head-mountable eyeglasses or sunglasses frame configured to hold at least one lens in front of an eye of a user so that said user can see an outside environment;
at least one user eye-tracking sensor positioned to track movement of one or both eyes of the user;
at least one processor programmed to execute eye tracking executable code and control executable code;
a virtual display comprising at least one optical system configured to render a virtual image of a visual display viewable by a user of said device, said optical system spatially positioned within a boundary defined by said lens in front of the eye of the user;
at least one wireless transceiver positioned in close proximity to said frame, said wireless transceiver receives wireless information and transmits said wireless information to said optical system; and
wherein said at least one processor programmed to execute said eye tracking executable code and said control code causes said eye-tracking and display device to transmit wireless information by tracking the motion of said eye of said user with said eye tracking sensor, translating the motion of said eye of said user into at least one symbol or command, and transmitting said at least one symbol or command using said at least one wireless transceiver;
said method comprising;
using said at least one processor to display a plurality of visual targets on said virtual display, said plurality of visual targets each comprising a visual element area embedded within a visual element position zone with an area that is equal to or larger than said visual element;
using a user input device comprising said eye-tracking sensor to register that a virtual key corresponding to said at least one of said plurality of visual targets has been selected by said user, thereby creating a selected virtual key;
using at least one user input device to register that said selected virtual key has been accepted by said user, thereby creating virtual key activation;
using said virtual key activation to control either transmitting or receiving said information to at least one computerized device outside of said head-mountable device'"'"'s said frame.
2 Assignments
0 Petitions
Accused Products
Abstract
A software controlled user interface and method for a head-mountable device equipped with at least one display or connectivity to at least one touch pad. The method can scale between displaying a small to large number of different eye gaze target symbols at any given time, yet still transmit a large array of different symbols to outside devices. At least part of the method may be implemented by way of a virtual window onto the surface of a virtual cylinder, with touchpad or eye gaze sensitive symbols that can be rotated by touchpad touch or eye gaze thus bringing various groups of symbols into view, and then selected. Specific examples of use of this interface and method on a head-mountable device are disclosed, along with various operation examples including transmitting data including text, functionality in virtual or augmented reality, control of robotic devices and control of remote vehicles.
-
Citations
24 Claims
-
1. A method of controlling a head-mountable device for transmitting and receiving information from a human user with at least one eye, said device comprising:
-
a head-mountable eyeglasses or sunglasses frame configured to hold at least one lens in front of an eye of a user so that said user can see an outside environment; at least one user eye-tracking sensor positioned to track movement of one or both eyes of the user; at least one processor programmed to execute eye tracking executable code and control executable code; a virtual display comprising at least one optical system configured to render a virtual image of a visual display viewable by a user of said device, said optical system spatially positioned within a boundary defined by said lens in front of the eye of the user; at least one wireless transceiver positioned in close proximity to said frame, said wireless transceiver receives wireless information and transmits said wireless information to said optical system; and wherein said at least one processor programmed to execute said eye tracking executable code and said control code causes said eye-tracking and display device to transmit wireless information by tracking the motion of said eye of said user with said eye tracking sensor, translating the motion of said eye of said user into at least one symbol or command, and transmitting said at least one symbol or command using said at least one wireless transceiver; said method comprising; using said at least one processor to display a plurality of visual targets on said virtual display, said plurality of visual targets each comprising a visual element area embedded within a visual element position zone with an area that is equal to or larger than said visual element; using a user input device comprising said eye-tracking sensor to register that a virtual key corresponding to said at least one of said plurality of visual targets has been selected by said user, thereby creating a selected virtual key; using at least one user input device to register that said selected virtual key has been accepted by said user, thereby creating virtual key activation; using said virtual key activation to control either transmitting or receiving said information to at least one computerized device outside of said head-mountable device'"'"'s said frame. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of controlling a head-mountable device for transmitting and receiving information from a human user with at least one eye, said device comprising:
-
a head-mountable eyeglasses or sunglasses frame configured to hold at least one lens in front of an eye of a user so that said user can see an outside environment; at least one user eye-tracking sensor positioned to track movement of one or both eyes of the user; at least one processor programmed to execute eye tracking executable code and control executable code; a virtual display comprising at least one optical system configured to render a virtual image of a visual display viewable by a user of said device, said optical system spatially positioned within a boundary defined by said lens in front of the eye of the user; at least one wireless transceiver positioned in close proximity to said frame, said wireless transceiver receives wireless information and transmits said wireless information to said optical system; and wherein said at least one processor programmed to execute said eye tracking executable code and said control code causes said eye-tracking and display device to transmit wireless information by tracking the motion of said eye of said user with said eye tracking sensor, translating the motion of said eye of said user into at least one symbol or command, and said method comprising; using said at least one processor to display a plurality of visual targets on said virtual display, said plurality of visual targets each comprising a visual element area embedded within a visual element position zone with an area that is equal to or larger than said visual element; further using a user input device comprising said eye position tracking sensor to determine when said at least one eye is on average gazing or dwelling in a direction that is within said visual element position zone of at least one of said visual elements, thereby selecting at least one of said visual elements; further signaling said selection, prior to using said user input device to register that a virtual key corresponding to said at least one of said plurality of visual targets has been activated by said user; using said user input device to register that a virtual key corresponding to said at least one of said plurality of visual targets has been selected by said user, thereby creating a selected virtual key; using at least one user input device to register that said selected virtual key has been accepted by said user, thereby creating virtual key activation; wherein said selected virtual key and said virtual key activation may be created by any said at least one user input device; and using said virtual key activation to control either transmitting or receiving said information. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A head-mountable device for transmitting and receiving information from a human user with at least one eye, said device comprising:
-
a head-mountable eyeglasses or sunglasses frame configured to hold at least one lens in front of an eye of a user so that said user can see an outside environment; at least one user eye-tracking sensor positioned to track movement of one or both eyes of the user; at least one processor programmed to execute eye tracking executable code and control executable code; a virtual display comprising at least one optical system configured to render a virtual image of a visual display viewable by a user of said device, said optical system spatially positioned within a boundary defined by said lens in front of the eye of the user; at least one wireless transceiver positioned in close proximity to said frame, said wireless transceiver receives wireless information and transmits said wireless information to said optical system; and wherein said at least one processor programmed to execute said eye tracking executable code and said control code causes said eye-tracking and display device to transmit wireless information by tracking the motion of said eye of said user with said eye tracking sensor, translating the motion of said eye of said user into at least one symbol or command, and transmitting said at least one symbol or command using said at least one wireless transceiver; said at least one processor configured to display a plurality of visual targets on said virtual display, said plurality of visual targets each comprising a visual element area embedded within a visual element position zone with an area that is equal to or larger than said visual element; a user input device comprising said eye-tracking sensor, and said at least one processor further configured to accept input from said user input device to register that a virtual key corresponding to said at least one of said plurality of visual targets has been activated by said user; said at least one processor further configured to use activation of said virtual key to control either transmitting or receiving said information. - View Dependent Claims (20, 21, 22, 23, 24)
-
Specification