Graphical user interface for non-foveal vision

• US 9,898,079 B2
• Filed: 06/04/2015
• Issued: 02/20/2018
• Est. Priority Date: 06/11/2014
• Status: Active Grant

• Current Assignee: Drivemode, Inc. (Honda Motor Company)
• Original Assignee: Drivemode, Inc. (Honda Motor Company)
• Inventors: Koga, Yokichi, Standard, Jeffrey Allen, Miura, Masato
• Primary Examiner(s): Xiao, Di
• Application Number:
  US14/730,715
• Publication Number:
  US 20150362991A1
• Time in Patent Office: 992 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A device may be configured to provide a graphical user interface that is specifically designed for use in a person'"'"'s non-foveal vision. Via a graphical user interface for non-foveal vision, a user may interact with the device without focusing his or her foveal vision on a touchscreen of the device. Thus, the user may operate the device and its applications entirely and exclusively without using his or her foveal vision. For example, the user may operate the device exclusively using his or her peripheral vision or using no vision whatsoever.

Claims

1. A method comprising:

at a device outside of foveal vision of a user of the device, displaying a graphical user interface on a touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

detecting that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to the detecting that the device received the user input; and

at the device outside of the foveal vision of the user, presenting an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, the presenting of the acknowledgment being performed by a processor of the device and including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the changing of the predominant color from the first color to the second color including modifying at least two parameters selected from a group consisting of a hue of the first color, a saturation of the first color, and a brightness of the first color, to obtain the second color.

2. The method of claim 1, wherein:

the device outside of the foveal vision of the user is within peripheral vision of the user;

the displaying of the graphical user interface displays the graphical user interface within the peripheral vision of the user; and

the presenting of the acknowledgment includes displaying the acknowledgment within the peripheral vision of the user.

3. The method of claim 1, wherein:

the modifying of the at least two parameters modifies each of the at least two parameters by at least a predetermined percentage.

4. The method of claim 1, wherein:

the presenting of the acknowledgment includes causing the graphical user interface to flash prior to the changing of the predominant color from the first color to the second color.

5. The method of claim 1, wherein:

the presenting of the acknowledgment includes causing the graphical user interface to flash subsequent to the changing of the predominant color from the first color to the second color.

6. The method of claim 1, wherein:

the presenting of the acknowledgment includes causing the touchscreen of the device to flash in response to the detecting that the device received the user input.

7. The method of claim 1, wherein:

the graphical user interface includes a target icon that indicates a centroid of the control region that is operable to request execution of the command.

8. The method of claim 1, wherein:

the graphical user interface includes a target icon located at a non-centroid location of the control region that is operable to request execution of the command.

9. The method of claim 1, wherein:

the presenting of the acknowledgment includes causing the device to produce a non-visual effect that acknowledges the user input.

10. The method of claim 9, wherein:

the graphical user interface presents a text label outside of the foveal vision of the user; and

the non-visual effect includes a vocal confirmation that reads the text label aloud to acknowledge the user input.

11. The method of claim 9, wherein:

the non-visual effect includes at least one of a sound effect or a haptic effect that identifies the user input among multiple user inputs available to be received by the device.

12. The method of claim 1, wherein:

the control region spans at least 75% of the graphical user interface.

13. The method of claim 1, wherein:

the graphical user interface spans at least one third of the touchscreen.

14. The method of claim 1 further comprising:

requesting execution of the command in response to the user input.

15. The method of claim 1, wherein:

the user input includes a touch input within the control region on the touchscreen of the device.

16. The method of claim 15, wherein:

the touch input is received by the device as a drag input between different locations on the touchscreen; and

the detecting that the device received the touch input includes reclassifying the drag input as a tap input on a single location on the touchscreen.

17. The method of claim 1, wherein:

the user input includes a controller input received from a controller that is communicatively coupled to the device and configured to simulate a touch input within the control region on the touchscreen of the device.

18. A device comprising:

one or more processors;

an interface module that configures at least one processor among the one or more processors to, with a touchscreen of the device being outside of foveal vision of a user of the device, display a graphical user interface on the touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

a detection module that configures at least one processor among the one or more processors to detect that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to a detection that the device received the user input; and

a feedback module that configures at least one processor among the one or more processors to, with the touchscreen being outside of the foveal vision of the user, present an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, a presentation of the acknowledgement including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the changing of the predominant color from the first color to the second color including modifying at least two parameters selected from a group consisting of a hue of the first color, a saturation of the first color, and a brightness of the first color, to obtain the second color.

19. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

at a device outside of foveal vision of a user of the device, displaying a graphical user interface on a touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

detecting that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to the detecting that the device received the user input; and

at the device outside of the foveal vision of the user, presenting an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, the presenting of the acknowledgement including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the changing of the predominant color from the first color to the second color including modifying at least two parameters selected from a group consisting of a hue of the first color, a saturation of the first color, and a brightness of the first color, to obtain the second color.

20. The non-transitory machine-readable storage medium of claim 19, wherein:

the device outside of the foveal vision of the user is within peripheral vision of the user;

the displaying of the graphical user interface displays the graphical user interface within the peripheral vision of the user; and

the presenting of the acknowledgment includes displaying the acknowledgment within the peripheral vision of the user.

21. The non-transitory machine-readable storage medium of claim 19, wherein:

the presenting of the acknowledgment includes displaying an animation within peripheral vision of the user.

22. A method comprising:

at a device outside of foveal vision of a user of the device, displaying a graphical user interface on a touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

detecting that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to the detecting that the device received the user input; and

at the device outside of the foveal vision of the user, presenting an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, the presenting of the acknowledgment being performed by a processor of the device and including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the presenting of the acknowledgment further including causing the graphical user interface to flash prior to the changing of the predominant color from the first color to the second color.

23. A device comprising:

one or more processors;

an interface module that configures at least one processor among the one or more processors to, with a touchscreen of the device being outside of foveal vision of a user of the device, display a graphical user interface on the touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

a detection module that configures at least one processor among the one or more processors to detect that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to a detection that the device received the user input; and

a feedback module that configures at least one processor among the one or more processors to, with the touchscreen being outside of the foveal vision of the user, present an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, a presentation of the acknowledgement including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the presentation of the acknowledgment further including causing the graphical user interface to flash prior to the changing of the predominant color from the first color to the second color.

24. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

at a device outside of foveal vision of a user of the device, displaying a graphical user interface on a touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

detecting that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to the detecting that the device received the user input; and

at the device outside of the foveal vision of the user, presenting an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, the presenting of the acknowledgment being performed by a processor of the device and including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the presenting of the acknowledgment further including causing the graphical user interface to flash prior to the changing of the predominant color from the first color to the second color.

25. A method comprising:

at a device outside of foveal vision of a user of the device, displaying a graphical user interface on a touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

detecting that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to the detecting that the device received the user input; and

at the device outside of the foveal vision of the user, presenting an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, the presenting of the acknowledgment being performed by a processor of the device and including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the presenting of the acknowledgment further including causing the graphical user interface to flash subsequent to the changing of the predominant color from the first color to the second color.

26. A device comprising:

one or more processors;

an interface module that configures at least one processor among the one or more processors to, with a touchscreen of the device being outside of foveal vision of a user of the device, display a graphical user interface on the touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

a detection module that configures at least one processor among the one or more processors to detect that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to a detection that the device received the user input; and

a feedback module that configures at least one processor among the one or more processors to, with the touchscreen being outside of the foveal vision of the user, present an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, a presentation of the acknowledgement including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the presentation of the acknowledgment further including causing the graphical user interface to flash subsequent to the changing of the predominant color from the first color to the second color.

27. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

at a device outside of foveal vision of a user of the device, displaying a graphical user interface on a touchscreen of the device outside of the foveal vision of the user, the displayed graphical user interface including a control region that is operable to request execution of a command;

detecting that the device received a user input that indicates operation of the control region to request execution of the command, the graphical user interface having a predominant color that is a first color prior to the detecting that the device received the user input; and

at the device outside of the foveal vision of the user, presenting an acknowledgment of the user input on the touchscreen outside of the foveal vision of the user, the presenting of the acknowledgment being performed by a processor of the device and including changing the predominant color of the graphical user interface from the first color to a second color in response to the detecting that the device received the user input, the presenting of the acknowledgment further including causing the graphical user interface to flash subsequent to the changing of the predominant color from the first color to the second color.