Projection-based head-mounted display with eye-tracking capabilities
First Claim
Patent Images
1. A projection-based head-mounted display device with an optical system inside the head-mounted display for eye-tracking capability, the optical eye tracking system comprising:
- multiple light sources for providing an infrared light to illuminate an eye of a user for creating multiple glints for use in detecting a polygon formed by the multiple glints, the multiple light source consisting of a dual light source for obtaining a bright pupil image and a dark pupil image of the eye, wherein the bright pupil image and the dark pupil image are subtracted to obtain a pupil of the eye for eye tracking;
a camera for recording the multiple glints from the eye, the bright pupil image and the dark pupil image alternating with each frame taken by the camera;
an optics for providing an optical path for a head-mounted display path and an eye-tracker path;
a first and a second optical device for imaging the eye onto the camera, the optical device including a first and second hot mirror positioned in the eye-tracker path to reflect the infrared light and transmit a visible light;
an interface for coupling an external controller with the head-mounted projection display for executing a set of instructions for controlling the projection-based head-mounted display device; and
a display for displaying an image to the user, the display path shared with the eye eye-tracker path without obstructing the user'"'"'s view, wherein the projection-based head-mounted display with eye-tracking capabilities built into the head-mounted device is compact, light-weight, comfortable and easy-to-use.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods, systems, apparatus and devices for the lens design of an HMPD with eye-tracking capabilities. The integration uses a low-level optical configuration in order to achieve a compact, comfortable, easy-to-use system. The optical system is further designed and optimized for sharing of the optical path between the HMD and the Eye-Tracker with minimal performance loss for both tasks.
351 Citations
18 Claims
-
1. A projection-based head-mounted display device with an optical system inside the head-mounted display for eye-tracking capability, the optical eye tracking system comprising:
-
multiple light sources for providing an infrared light to illuminate an eye of a user for creating multiple glints for use in detecting a polygon formed by the multiple glints, the multiple light source consisting of a dual light source for obtaining a bright pupil image and a dark pupil image of the eye, wherein the bright pupil image and the dark pupil image are subtracted to obtain a pupil of the eye for eye tracking; a camera for recording the multiple glints from the eye, the bright pupil image and the dark pupil image alternating with each frame taken by the camera; an optics for providing an optical path for a head-mounted display path and an eye-tracker path; a first and a second optical device for imaging the eye onto the camera, the optical device including a first and second hot mirror positioned in the eye-tracker path to reflect the infrared light and transmit a visible light; an interface for coupling an external controller with the head-mounted projection display for executing a set of instructions for controlling the projection-based head-mounted display device; and a display for displaying an image to the user, the display path shared with the eye eye-tracker path without obstructing the user'"'"'s view, wherein the projection-based head-mounted display with eye-tracking capabilities built into the head-mounted device is compact, light-weight, comfortable and easy-to-use. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for providing eye-tracking inside a projection-based head-mounted display comprising the steps of:
-
providing plural infrared light beams from each of a first and a second different infrared light source for illuminating a pupil of a user'"'"'s eye; using an optical device to create a head-mounted display optical path and an eye-tracking optical path, wherein the optical display path and the eye-tracking optical paths are shared to reduce weight of the projection based head-mounted display; using a first and second hot mirror coupled with the first and second light source, respectively, to image the eye onto a camera; alternatingly recording multiple glints in a bright pupil image and a dark pupil image created by the at least two infrared light sources using the camera; and extracting an eye movement data from the bright pupil image and the dark pupil image using a pupil/glint method. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A system for providing eye-tracking capabilities within a projection-based head-mounted display comprising:
-
a dual light source for providing a first and second infrared light, respectively; an optical device to create a head-mounted display optical path and an eye-tracking optical path, wherein the head-mounted display and the eye-tracking optical paths are shared to reduce weight of the projection based head-mounted display, the optical device including a first and second hot mirror coupled with the first and second infrared light sources, respectively, for reflecting infrared light and transmitting visible to create plural eye glints for use detecting eye movement; and a camera for recording the eye movement, wherein one source of the dual light source is on-axis and a second source of the dual light source is off-axis with the point of view of the camera; and a processing device for executing a set of instructions to calculate a position of a pupil of the user'"'"'s eye based on the eye movement extracted from a bright pupil image and a dark pupil image recorded by the camera. - View Dependent Claims (18)
-
Specification