Facial Tracking Electronic Reader

• US 20110205148A1
• Filed: 02/24/2010
• Published: 08/25/2011
• Est. Priority Date: 02/24/2010
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Corriveau, Philip J., Anderson, Glen J.
• Application Number:
  US12/711,329
• Publication Number:
  US 20110205148A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied

Abstract

Facial actuations, such as eye actuations, may be used to detect user inputs to control the display of text. For example, in connection with an electronic book reader, facial actuations and, particularly, eye actuations, can be interpreted to indicate when the turn a page, when to provide a pronunciation of a word, when to provide a definition of a word, and when to mark a spot in the text, as examples.

Claims

1. An apparatus comprising:

a display to display text to be read by a user;

a camera associated with the display; and

a control to detect user facial actuations and to interpret facial actuation to control the display of text.

2. The apparatus of claim 1 wherein said control to detect eye activity to control text display.

3. The apparatus of claim 1 wherein said control to associate eye activity and context to determine an intended user command.

4. The apparatus of claim 1, said control to recognize a facial actuation as a request to provide a meaning of a word in said text.

5. The apparatus of claim 1, said control to recognize a facial actuation as a control signal to request a display of a word pronunciation.

6. The apparatus of claim 1, said control to recognize a facial actuation to indicate difficulty reading the text.

7. The apparatus of claim 1, said control to recognize a facial actuation to indicate a request to mark a position on a page of text.

8. A method comprising:

displaying text to be read by a user;

recording an image of the user as the user reads the text;

detecting user facial actuations associated with said text; and

linking a facial actuation with a user input.

9. The method of claim 8 including associating eye activity and context to determine an intended user command.

10. The method of claim 8 including recognizing a facial actuation as a request to provide a meaning of a word in said text.

11. The method of claim 8 including recognizing a facial actuation as a control signal to request a display of a word pronunciation.

12. The method of claim 8 including recognizing a facial actuation as indicating difficulty reading the text.

13. The method of claim 8 including recognizing a facial actuation as indicating a request to mark a position on a page of text.

14. A computer readable medium storing instructions executed by a computer to:

display text to be read by a user;

record an image of the user as the user reads the text;

detect user facial actuations while reading said text; and

correlate a facial actuation with a particular portion of said text.

15. The medium of claim 14 further storing instructions to detect eye activity and to identify a gaze target in order to correlate the facial actuation to text.

16. The medium of claim 14 further storing instructions to associate eye activity and context to determine an intended user command.

17. The medium of claim 14 further storing instructions to recognize a facial actuation as a request to provide a meaning of a word in said text.

18. The medium of claim 14 further storing instructions to recognize a facial actuation as a control signal to request a word pronunciation.

19. The medium of claim 14 further storing instructions to recognize a facial actuation as indicating difficulty reading a portion of said text, identify said text portion, and record the location of said text portion.

20. The medium of claim 17 further storing instructions to recognize a facial actuation as indicating a request to mark a position on a page of text, record said position, and make said recorded position available for subsequent access.