Multiple viewpoint image capture of a display user
First Claim
1. An apparatus comprising:
- a plurality of separate image sensors to capture a plurality of images of a user of a display of a computing device from an array of viewpoints included on the display of the computing device, each of the plurality of separate image sensors to capture images of the user from a different viewpoint of the array of viewpoints on the display;
a deflector comprising;
a first side to deflect light away from each of the array of viewpoints included on the display towards a respective image sensor of the plurality of image sensors, anda second transmissive side, opposite the first side, to allow light from the display to pass through to the user; and
logic to;
identify an eye of the user in each of the plurality of images captured from the viewpoint associated with each of the plurality of image sensors,determine a gaze direction of the user with respect to the display based, at least in part, on comparison of the identified eye of the user captured in each of the plurality of images, wherein determining the gaze direction of the user includes comparing iris eccentricity of the identified eye of the user captured in each of the plurality of the images of the user to analyze roundness of the iris in each of the plurality of images of the user to determine an image in the plurality of images with less distortion than any other images in the plurality of images as being a viewpoint closest to the gaze direction of the user;
determine a target area of the user'"'"'s gaze on the display based, at least in part, on the determined gaze direction of the user, andexecute an application operation in response to determining the target area of the user'"'"'s gaze.
2 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the invention describe apparatuses, systems and methods for capturing, selecting and analyzing image data of a user of a computing device display from multiple viewpoints. Embodiments of the invention capture or receive data comprising a plurality of images from an image capture system, wherein the plurality of images comprises images of a user of a computing system from multiple viewpoints. A gaze direction of the user with respect to the display is determined based, at least in part, on the plurality of images. Embodiments further determine a target area on the computing device display based, at least in part, on the determined gaze direction of the user, and execute an application operation in response to determining the target area of the user'"'"'s gaze.
-
Citations
20 Claims
-
1. An apparatus comprising:
-
a plurality of separate image sensors to capture a plurality of images of a user of a display of a computing device from an array of viewpoints included on the display of the computing device, each of the plurality of separate image sensors to capture images of the user from a different viewpoint of the array of viewpoints on the display; a deflector comprising; a first side to deflect light away from each of the array of viewpoints included on the display towards a respective image sensor of the plurality of image sensors, and a second transmissive side, opposite the first side, to allow light from the display to pass through to the user; and logic to; identify an eye of the user in each of the plurality of images captured from the viewpoint associated with each of the plurality of image sensors, determine a gaze direction of the user with respect to the display based, at least in part, on comparison of the identified eye of the user captured in each of the plurality of images, wherein determining the gaze direction of the user includes comparing iris eccentricity of the identified eye of the user captured in each of the plurality of the images of the user to analyze roundness of the iris in each of the plurality of images of the user to determine an image in the plurality of images with less distortion than any other images in the plurality of images as being a viewpoint closest to the gaze direction of the user; determine a target area of the user'"'"'s gaze on the display based, at least in part, on the determined gaze direction of the user, and execute an application operation in response to determining the target area of the user'"'"'s gaze. - View Dependent Claims (2, 3, 19)
-
-
4. A system comprising:
-
a display of a computing device; a plurality of separate image sensors disposed next to the display of the computing device to capture a plurality of images of a user of the display, each of the plurality of image sensors to capture images of the user from a different viewpoint of an array of viewpoints on the display; a deflector comprising; a first side to deflect light away from each of the array of viewpoints included on the display towards a respective image sensor of the plurality of image sensors, and a second transmissive side, opposite the first side, to allow light from the display to pass through to the user; and logic to; identify an eye of the user in each of the plurality of images captured from the viewpoint associated with each of the plurality of image sensors; determine a gaze direction of the user with respect to the display based, at least in part, on comparison of the identified eye of the user captured in each of the plurality of images, wherein determining the gaze direction of the user includes comparing iris eccentricity of the identified eye of the user captured in each of the plurality of the images of the user to analyze roundness of the iris in each of the plurality of images of the user to determine an image in the plurality of images with less distortion than any other images in the plurality of images as being a viewpoint closest to the gaze direction of the user, determine a target area of the user'"'"'s gaze on the display based, at least in part, on the determined gaze direction of the user, and execute an application operation in response to determining the target area of the user'"'"'s gaze. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 20)
-
-
15. An article of manufacture comprising a computer-readable non-transitory storage medium having instructions stored thereon to cause a processor to perform operations including:
-
receiving data comprising a plurality of images from an image capture system, wherein the plurality of images comprises images of a user of a computing system captured by a plurality of image sensors from an array of viewpoints on the display, each of the plurality of image sensors to capture images of the user from a different viewpoint of the array of viewpoints on the display, light being deflected away from each of the array of viewpoints towards a respective image sensor of the plurality of image sensors; identifying an eye of the user in each of the plurality of images captured from the viewpoint associated with each of the plurality of image sensors; determining a gaze direction of the user with respect to the display based, at least in part, on comparison of the identified eye of the user captured in each of the plurality of images captured, wherein determining the gaze direction of the user includes comparing iris eccentricity of the identified eye of the user captured in each of the plurality of the images of the user to analyze roundness of the iris in each of the plurality of images of the user to determine an image in the plurality of images with less distortion than any other images in the plurality of images as being a viewpoint closest to the gaze direction of the user; determining a target area on the display based, at least in part, on the determined gaze direction of the user; and executing an application operation in response to determining the target area of the user'"'"'s gaze. - View Dependent Claims (16, 17, 18)
-
Specification