Systems and methods for counteracting a perceptual fading of a movable indicator

• US 8,937,591 B2
• Filed: 04/06/2012
• Issued: 01/20/2015
• Est. Priority Date: 04/06/2012
• Status: Expired due to Fees

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Julian, David P.
• Primary Examiner(s): Lao, Lun-Yi
• Assistant Examiner(s): Lau, Johny
• Application Number:
  US13/441,654
• Publication Number:
  US 20130265227A1
• Time in Patent Office: 1,019 Days
• Field of Search: 345/156, 345/158, 345/326, 351/203, 351/224, 348/333.01, 715856-861
• US Class Current: 345/157
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects

Abstract

Systems and methods are provided for altering the position or visual appearance of a movable indicator in a GUI that is controlled by eye tracking to counteract a perceptual fading of the movable indicator with respect to the GUI. The position of the user'"'"'s point of gaze may be tracked, the movable indicator may be rendering at a position associated with the user'"'"'s point of gaze, and the position or visual appearance of the movable indicator may be altered when an event, such as a passage of time or a blinking of the user'"'"'s eyes, is detected.

Claims

1. A method comprising:

tracking a point of gaze on a display of a graphical user interface (GUI) using an eye tracking apparatus;

rendering a movable indicator at a gaze position associated with the point of gaze within the GUI;

detecting that the point of gaze has been fixed at a region of interest for a specified amount of time that corresponds to an amount of time during which perceptual fading of the moveable indicator is estimated to have occurred; and

in response to detecting that the point of gaze has been fixed at the region of interest for the specified amount of time, and while the point of gaze is still fixed at the region of interest, displaying continuous movement of the movable indicator from the gaze position to a new position within a predefined boundary that corresponds to a subregion of the user interface around the gaze position.

2. The method of claim 1, wherein a visual fixation on the movable indicator causes the movable indicator to be a stabilized retinal image with respect to a user, and wherein the perceptual fading of the movable indicator includes a perceived disappearance of the movable indicator.

3. The method of claim 1, wherein detecting that the point of gaze has been fixed at the region of interest for a specified amount of time further comprises:

receiving an indication of a period of time;

initializing a timer based on the indication; and

altering a position of the movable indicator for each instance of the timer elapsing the period of time.

4. The method of claim 3, wherein the indication is generated based on user input;

and wherein perceptual fading of the movable indicator causes the movable indicator perceptively to disappear.

5. The method of claim 1, wherein displaying continuous movement of the movable indicator further comprises:

defining one or more positions in the GUI different from a last detected position of the point of gaze within the GUI; and

rendering the movable indicator at one or more of the one or more defined positions.

6. The method of claim 5, wherein defining the one or more positions within the GUI comprises:

setting the boundary a predefined amount of pixels around the last detected position of the point of gaze within the GUI; and

defining the one or more positions as one or more pixels on the boundary.

7. The method of claim 6, wherein the one or more pixels on the boundary are selected randomly;

and wherein the displaying includes restoring the perception of the movable indicator.

8. The method of claim 6, wherein the one or more pixels on the boundary are selected based on a predetermined pattern.

9. The method of claim 5, further comprising:

defining a repeating pattern comprising multiple defined positions that are a specified distance around the last detected position of the point of gaze within the GUI; and

rendering the movable indicator at a different one of the multiple defined positions in the repeating pattern upon each instance of detecting the passage of the amount of time.

10. The method of claim 1, further comprising:

transmitting infrared signals from an infrared transmitter on the display of the GUI;

receiving reflections of the infrared signals at a camera associated with the eye tracking apparatus; and

analyzing the reflections of the infrared signals for a presence and subsequent absence of an exposed pupil.

11. The method of claim 1, further comprising:

capturing a sequence of images of a face using a camera associated with the eye tracking apparatus; and

analyzing the sequence of images for a presence and subsequent absence of at least one facial feature.

12. The method of claim 11, wherein the at least one facial feature comprises one of a pupil, a pigment in the eye, or an eyelid.

13. The method of claim 1, wherein displaying continuous movement of the movable indicator further comprises rendering the movable indicator at a different position as the point of gaze remains at the last detected position;

and wherein the continuous movement of the movable object is performed independently of the movement of the point of gaze responsive to input from the eye tracking apparatus.

14. The method of claim 1, wherein displaying continuous movement of the movable indicator further comprises transmitting data to an input device driver that prompts the GUI to render the movable indicator at a different position in the GUI.

15. A system comprising:

a display device arranged to render the display of a graphical user interface (GUI);

imaging components arranged to track a point of gaze on the display device; and

a processor arranged to;

render a movable indicator at a gaze position associated with the point of gaze;

detect that the point of gaze has been fixed at a region of interest for a specified amount of time that corresponds to an amount of time during which perceptual fading of the moveable indicator is estimated to have occurred; and

in response to detecting that the point of gaze has been fixed at the region of interest for the specified amount of time, and while the point of gaze is still fixed at the region of interest, display continuous movement of the movable indicator from the gaze position to a new position within a predefined boundary that corresponds to a subregion of the user interface around the gaze position.

16. The system of claim 15, wherein a visual fixation on the movable indicator causes the movable indicator to be a stabilized retinal image, and wherein the perceptual fading of the movable indicator includes a perceived disappearance of the movable indicator.

17. The system of claim 15, wherein the processor is arranged to:

receive an indication of a period of time;

initialize a timer based on the indication; and

alter a position of the movable indicator for each instance of the timer elapsing the period of time.

18. The system of claim 17, wherein the indication is generated based on user input.

19. The system of claim 15, wherein the processor is arranged to:

define one or more positions in the GUI different from a last detected position of the point of gaze within the GUI; and

render the movable indicator at one or more of the one or more defined positions.

20. The system of claim 19, wherein the processor is arranged to define the one or more positions within the GUI by:

setting the boundary a predefined amount of pixels around the last detected position of the point of gaze within the GUI; and

defining the one or more positions as one or more pixels on the boundary.

21. The system of claim 20, wherein the processor is arranged to select the one or more pixels on the boundary randomly.

22. The system of claim 20, wherein the processor is arranged to select the one or more pixels on the boundary based on a predetermined pattern.

23. The system of claim 19, wherein the processor is further arranged to:

define a repeating pattern comprising multiple defined positions that are a specified distance around the last detected position of the point of gaze within the GUI; and

render the movable indicator at a different one of the multiple defined positions in the repeating pattern upon each instance of detecting the passage of the amount of time.

24. The system of claim 15, comprising:

an infrared transmitter built into the display device that is arranged to transmit infrared signals outward from the display device;

an infrared receiver arranged to receive reflections of the infrared signals; and

wherein the processor is arranged to analyze the reflections of the infrared signals for a presence and subsequent absence of an exposed pupil.

25. The system of claim 15, comprising:

imaging components arranged to capture a sequence of images of a face; and

wherein the processor is arranged to analyze the sequence of images for a presence and subsequent absence of at least one facial feature.

26. The system of claim 25, wherein the at least one facial feature comprises one of a pupil, a pigment in the eye, or an eyelid.

27. The system of claim 25, wherein the processor is arranged to display continuous movement of the movable indicator by rendering the movable indicator at a different position as the point of gaze remains at the last detected position;

and wherein the continuous movement of the movable object is performed independently of the movement of the point of gaze responsive to input from the eye tracking apparatus.

28. The system of claim 25, wherein the processor is arranged to display continuous movement of the movable indicator by transmitting data to an input device driver that prompts the GUI to render the movable indicator at a different position in the GUI.