EYE TRACKING AND USER REACTION DETECTION

• US 20170131766A1
• Filed: 01/23/2017
• Published: 05/11/2017
• Est. Priority Date: 11/27/2013
• Status: Active Grant

• Current Assignee: Shenzhen Goodix Technology Co., Ltd.
• Original Assignee: Shenzhen Huiding Technology Co., Ltd.
• Inventors: He, Yi, Pi, Bo
• Granted Patent: US 10,416,763 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction

Abstract

Methods, systems, and devices are disclosed for optical sensing and tracking of eye movement. In one aspect, a device for obtaining a user'"'"'s eye dynamics data includes a display screen to present at least one content. The device includes an eye sensing module to obtain the user'"'"'s eye dynamics data including the user'"'"'s eye movement while presenting to the user the at least one content on the display screen. The device includes a processor in communication with the eye sensing module. The processor can determine the user'"'"'s reaction to the at least one content presented on the display screen based at least partly on the obtained user'"'"'s eye dynamics data.

Claims

1. A device for obtaining a user'"'"'s eye dynamics data, comprising:

a display screen configured to present at least one content;

an eye sensing module to obtain the user'"'"'s eye dynamics data including the user'"'"'s eye movement while presenting to the user the at least one content on the display screen; and

a processor in communication with the eye sensing module and configured to determine the user'"'"'s reaction to the at least one content presented on the display screen based at least partly on the obtained user'"'"'s eye dynamics data.

2. The device of claim 1, wherein the user'"'"'s eye dynamics data includes a change in the user'"'"'s pupil size.

3. The device of claim 1, further comprising:

an ambient light sensing module in communication with the processor and configured to obtain an ambient light condition; and

wherein the processor is configured to determine the user'"'"'s reaction to the at least one content presented on the display screen based at least partly on the obtained user'"'"'s eye dynamics data and the ambient light condition.

4. The device of claim 1, wherein:

the processor is in communication with the display screen to obtain display screen characteristics including at least one of display brightness variation data or display backlighting data, and determine the user'"'"'s reaction to the at least one content displayed on display screen based at least partially on the obtained display screen characteristics and the user'"'"'s eye dynamics data.

5. The device of claim 1, further comprising:

at least one motion sensor in communication with the processor and configured to obtain a motion parameter of the device; and

wherein the processor is configured to determine the user'"'"'s reaction to the at least one content presented on the display screen based at least partly on the obtained user'"'"'s eye dynamics data and the motion parameter.

6. The device of claim 1, wherein the device includes a mobile device.

7. A method for determining a user'"'"'s reaction to at least one content presented on a display screen of a device, the method comprising:

presenting at least one content on the display screen of the device;

detecting, by an eye sensing module integrated with the device, the user'"'"'s eye dynamics to obtain data indicative of the user'"'"'s eye movement or changes in the user'"'"'s pupil size while presenting the at least one content on the display screen of the device; and

associating the obtained user'"'"'s eye dynamics data with the at least one content presented on the display screen to generate user reaction data.

8. The method of claim 7, comprising:

transmitting the generated user reaction data to a server.

9. The method of claim 8, wherein:

the server is associated with a content provider that provides the at least one content.

10. The method of claim 8, comprising:

receiving from the server a different content selected based at least partly on the user reaction data transmitted to the server.

11. The method of claim 7, wherein the associating includes associating an increase in the user'"'"'s pupil size with an indication of an increased interest of the user in the at least one content presented on the display screen.

12. The method of claim 7, wherein the associating includes associating a steadiness of the user'"'"'s eye movement with an indication of a focus of the user'"'"'s attention on the at least one content presented on the display screen.

13. A server for providing user reaction feedback information, the server comprising:

a processor configured to;

receive from multiple user devices, user reaction data associated with a common content presented to the multiple user devices;

analyze the user reaction data associated with the common content presented to multiple user devices;

generate an output based on the analysis of the user'"'"'s reaction to the commonly presented content; and

report the generated output to a content provider that provided the commonly presented content.

14. The server of claim 13, wherein the generated output includes statistical results.