Biosensors, communicators, and controllers monitoring eye movement and methods for using them
First Claim
1. A system for controlling a computer device, comprising:
- a device configured to be worn on a user'"'"'s head;
a plurality of light sources mounted on the device at locations and configured to direct light towards a first eye of the user when the device is worn, the light sources projecting a reference frame onto the first eye of the user when the device is worn, the projected reference frame comprising a graphic having at least one horizontal component that intersects at least one vertical component in an x-y coordinate system;
a camera comprising an objective lens mounted to the device at a location to avoid interference with the user'"'"'s vision, the camera mounted on the device such that an imaging axis of the camera is oriented towards the first eye of the user wearing the device for monitoring movement of the first eye with respect to the projected reference frame, the camera configured for generating signals representing video images of the first eye acquired by the camera;
a display mounted to the device such that the display is in a field of view of the first eye of the user wearing the device but not in front of the first eye of the user wearing the device; and
a processor coupled to the display and to the camera and configured to;
assign the x-y coordinate system to the projected reference frame;
analyze the signals generated by the camera to identify edges of a pupil of the first eye by superimposing the graphic of the reference frame on the video images of the first eye;
process the signals to determine the pupil'"'"'s location relative to the projected reference frame; and
process the signals to monitor movement of the first eye relative to the projected reference frame to determine a gaze location of the user'"'"'s pupil relative to a display reference frame associated with the display to create a pointer presented on the display tracking a gaze of the user relative to the display, the processor causing the pointer to move on the display to follow movement of the user'"'"'s pupil based upon the movement of the user'"'"'s pupil relative to the projected reference frame, wherein the processor is configured to analyze the signals from the camera to determine a direction in which the first eye is moving relative to the projected reference frame and to direct the pointer on the display relative to the display reference frame in the same direction in which the first eye is moving.
7 Assignments
0 Petitions
Accused Products
Abstract
Biosensor, communicator, and/or controller apparatus, systems, and methods are provided for monitoring movement of a person'"'"'s eye. The apparatus includes a device configured to be worn on a user'"'"'s head, a light source for directing light towards one or both eyes of the user, one or more image guides on the device for viewing one or both eyes of the user, and one or more cameras carried on the device and coupled to the image guides for acquiring images of the eyes and/or the user'"'"'s surroundings. The apparatus may include a cable and/or a transmitter for transmitting image data from the camera to a remote location, e.g., to processor and/or display for analyzing and/or displaying the image data. A system including the apparatus may be used to monitor one or more oculometric parameters, e.g., pupillary response, and/or to control a computer using the user'"'"'s eyes instead of a mouse.
253 Citations
35 Claims
-
1. A system for controlling a computer device, comprising:
-
a device configured to be worn on a user'"'"'s head; a plurality of light sources mounted on the device at locations and configured to direct light towards a first eye of the user when the device is worn, the light sources projecting a reference frame onto the first eye of the user when the device is worn, the projected reference frame comprising a graphic having at least one horizontal component that intersects at least one vertical component in an x-y coordinate system; a camera comprising an objective lens mounted to the device at a location to avoid interference with the user'"'"'s vision, the camera mounted on the device such that an imaging axis of the camera is oriented towards the first eye of the user wearing the device for monitoring movement of the first eye with respect to the projected reference frame, the camera configured for generating signals representing video images of the first eye acquired by the camera; a display mounted to the device such that the display is in a field of view of the first eye of the user wearing the device but not in front of the first eye of the user wearing the device; and a processor coupled to the display and to the camera and configured to; assign the x-y coordinate system to the projected reference frame; analyze the signals generated by the camera to identify edges of a pupil of the first eye by superimposing the graphic of the reference frame on the video images of the first eye; process the signals to determine the pupil'"'"'s location relative to the projected reference frame; and process the signals to monitor movement of the first eye relative to the projected reference frame to determine a gaze location of the user'"'"'s pupil relative to a display reference frame associated with the display to create a pointer presented on the display tracking a gaze of the user relative to the display, the processor causing the pointer to move on the display to follow movement of the user'"'"'s pupil based upon the movement of the user'"'"'s pupil relative to the projected reference frame, wherein the processor is configured to analyze the signals from the camera to determine a direction in which the first eye is moving relative to the projected reference frame and to direct the pointer on the display relative to the display reference frame in the same direction in which the first eye is moving. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system for controlling a computer device, comprising:
-
a device configured to be worn on a user'"'"'s head; one or more light sources mounted on the device at locations and configured to direct light towards a first eye of the user when the device is worn, the light sources configured to project a reference frame onto the first eye of the user when the device is worn, the projected reference frame comprising a graphic having at least one horizontal component that intersects at least one vertical component in an x-y coordinate system; a camera mounted on the device at a location to avoid interference with the user'"'"'s vision, the camera mounted such that an imaging axis of the camera is oriented directly towards the first eye of the user for monitoring movement of the first eye with respect to the projected reference frame, the camera configured for generating signals representing video images of the first eye acquired by the camera; a display mounted to the device such that a pointer on the display is viewable by the user wearing the device; and a processor coupled to the display and to the camera, the processor configured to; assign the x-y coordinate system to the projected reference frame; analyze the signals generated by the camera to identify a pupil of the first eye by superposing the graphic of the reference frame on the video images of the first eye; process the signals to monitor movement of the pupil of the first eye relative to the projected reference frame to determine a gaze location of the first eye relative to a display reference frame associated with the display; and cause the pointer to move on the display to the gaze location on the display to cause the pointer to move on the display to follow movement of the first eye. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A system for controlling a computer device, comprising:
-
a frame comprising ear supports carrying ear pieces configured to be worn on a user'"'"'s head and a nose bridge extending between the ear supports; one or more light sources mounted on one or both of the ear supports and the nose bridge and oriented towards a first eye of the user wearing the frame and configured to direct light towards the first eye and project a reference frame onto the first eye of the user wearing the frame, the projected reference frame comprising a graphic having at least one horizontal component that intersects at least one vertical component in an x-y coordinate system; a camera comprising an objective lens mounted on one of the ear supports and the nose bridge, the camera and objective lens mounted by a lockable swivel mount allowing the objective lens to rotate about a pivot axis such that an imaging axis of the camera is oriented directly towards the first eye of the user wearing the frame for monitoring movement of the first eye with respect to the projected reference frame, the camera configured for generating signals representing video images of the first eye acquired by the camera; a display mounted to at least one of the ear supports and the nose bridge such that the display is viewable by the first eye of the user wearing the frame; and a processor coupled to the display and to the camera for processing the signals to monitor movement of the first eye relative to the projected reference frame to determine a gaze location of the first eye of the user relative to a display reference frame to create a pointer tracking a gaze of the user relative to the display, the processor causing the pointer to move and follow movement of the first eye based upon the movement of the first eye of the user and the gaze location relative to the display reference frame, and wherein the processor is configured to; assign the x-y coordinate system to the projected reference frame; analyze the camera signals generated by the camera to identify a pupil of the first eye by superimposing the graphic of the reference frame on the video images of the first eye; and process the signals to determine the gaze location of the pupil of the first eye relative to the projected reference frame and the gaze location relative to the display reference frame based on the superimposed graphic. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
-
Specification