Eye Gaze for Automatic Paging

• US 20160259405A1
• Filed: 03/03/2015
• Published: 09/08/2016
• Est. Priority Date: 03/03/2015
• Status: Active Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Wilson, Andrew D., Williams, Shane F.
• Application Number:
  US14/636,291
• Publication Number:
  US 20160259405A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 15/0291 for reading, e.g. e-books constructional details of portable computers G06F1/1613
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor

Abstract

Leveraging eye gaze and/or other user interactions for automatic paging on a display of a user device is described. In at least one example, the techniques describe receiving input from one or more tracking components. The input may indicate that a gaze of a user is detected on a display associated with a user device. The techniques may further describe determining that the gaze of the user has moved from a first region of at least two regions of the display to a second region of the at least two regions of the display. Based at least in part on determining that the gaze of the user has moved from the first region to the second region, the techniques herein describe updating a portion of the content in the first region of the display via one or more transitions.

Claims

1. A system comprising:

one or more tracking components;

a display including at least two regions for presenting content;

one or more processors; and

computer-readable media storing one or more modules that are executable by the one or more processors to perform operations comprising;

receiving input from the one or more tracking components, the input indicating that a gaze of a user is detected on a first region of the at least two regions of the display;

determining that the gaze of the user has moved from the first region to a second region of the at least two regions of the display; and

based at least in part on the determining that the gaze of the user moved from the first region to the second region, updating content in the first region of the display.

2. The system of claim 1, wherein the content comprises at least one of text or images arranged in at least one of a left to right or a top to bottom progression on the display.

3. The system of claim 1, wherein the updating the content comprises replacing the content with previously unseen content using one or more transitions.

5. The system of claim 1, wherein the updating the content comprises updating the content without causing the gaze of the user to at least one of shift back to the first region of the display, shift to a third region of the at least two regions of the display, or shift away from the display.

6. The system of claim 1, wherein the updating the content is based at least in part on detecting patterns in the input that indicate that the user is reading or viewing the content associated with the second region of the display.

7. The system of claim 1, wherein the first region is a left region of the display and the second region is a right region of the display that is adjacent to the left region and is to the right of the left region.

8. The system of claim 1, wherein the first region is a top region of the display and the second region is a bottom region of the display that is adjacent to the top region and is below the top region.

4. The system of claim 4, wherein the one or more transitions comprise at least one of:

cross-fading the content with the previously unseen content;

morphing the content into the previously unseen content;

or

sweeping away the content and replacing the content with the previously unseen content.

9. A computer-implemented method comprising:

receiving, from one or more tracking components, tracking data associated with user interaction on a display of a user device, the user interaction including at least one of a gaze of a user, a head position of the user, or a nose position of the user;

determining, based at least in part on the tracking data, that the user interaction is associated with a region of the display;

determining, based at least in part on the tracking data, that the user interaction has moved from the region of the display to a different region of the display; and

modifying content associated with the region of the display while the user interaction is associated with the different region of the display.

10. The computer-implemented method of claim 9, wherein the determining that the user interaction has moved from the region of the display to the different region of the display is based at least in part on at least one of reading classifiers for detecting patterns in the tracking data or determining that a user associated with the user device is reading the content in the different region of the display.

11. The computer-implemented method of claim 9, wherein the modifying the content associated with the region of the display comprises replacing the content with previously unseen content using one or more transitions.

12. The computer-implemented method of claim 11, wherein the one or more transitions comprise at least one of:

cross-fading the content with the previously unseen content;

morphing the content into the previously unseen content;

or

sweeping away the content and replacing the content with the previously unseen content.

13. The computer-implemented method of claim 9, wherein the modifying the content associated with the region of the display comprises replacing the content with previously unseen content without causing the user interaction to at least one of shift back to the region of the display, shift to another region of the display that is not the region or the different region, or shift away from the display.

15. The computer-implemented method of claim 13, wherein:

the content comprises a first group of images of a plurality of images; and

the previously unseen content comprises a second group of images of the plurality of images.

16. The computer-implemented method of claim 9, further comprising:

determining, based at least in part on the tracking data, that the user interaction is not detected on the display; and

replacing previously modified content associated with the region of the display with previously seen content.

14. The computer-implemented method of 13, wherein:

the content comprises at least a portion of a page of an electronic book; and

the previously unseen content comprises at least a portion of a subsequent page of the electronic book.

17. One or more computer-readable media encoded with instructions that, when executed by a processor, perform acts comprising:

determining, based at least in part on input from one or more tracking components, that a gaze of a user is associated with a region of a display;

determining, based at least in part on the input, that the gaze of the user is associated with a different region of the display; and

based at least in part on determining that the gaze of the user is associated with the different region and without causing the gaze of the user to at least one of shift back to the region of the display, shift to a new region of the display, or shift away from the display, replacing content associated with the region of the display with previously unseen content.

18. The one or more computer-readable media of claim 17, wherein the replacing the content associated with the region of the display comprises replacing the content with the previously unseen content using a cross-fade transition.

19. The one or more computer-readable media of claim 17, the acts further comprising:

determining that the gaze of the user has moved from the different region of the display to another region of the display; and

replacing content associated with the different region of the display with new previously unseen content without causing the gaze of the user to at least one of shift back to the different region of the display, shift to a new region of the display, or shift away from the display.

20. The one or more computer-readable media of claim 17, the acts further comprising:

repeatedly determining that the gaze of a user is associated with at least one of the region of the display, the different region of the display, or another region of the display; and

based at least in part on the repeatedly determining, replacing the content associated with one or more regions of the display that are not associated with the gaze of the user with previously unseen content.