Graphical user interface for non-foveal vision

• US 10,488,922 B2
• Filed: 10/24/2017
• Issued: 11/26/2019
• Est. Priority Date: 06/11/2014
• Status: Active Grant

• Current Assignee: Drivemode, Inc. (Honda Motor Company)
• Original Assignee: Drivemode, Inc. (Honda Motor Company)
• Inventors: Koga, Yokichi, Standard, Jeffrey Allen, Miura, Masato
• Primary Examiner(s): Xiao, Di
• Application Number:
  US15/792,003
• Publication Number:
  US 20180046247A1
• Time in Patent Office: 763 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A device may be configured to provide a graphical user interface that is specifically designed for use in a person'"'"'s non-foveal vision. Via a graphical user interface for non-foveal vision, a user may interact with the device without focusing his or her foveal vision on a touchscreen of the device. Thus, the user may operate the device and its applications entirely and exclusively without using his or her foveal vision. For example, the user may operate the device exclusively using his or her peripheral vision or using no vision whatsoever.

Claims

1. A method comprising:

presenting, by one or more processors of a device, a graphical user interface (GUI) on a touchscreen managed by the device, the GUI including a first area encompassed by a second area configured to receive a touch input from a user of the device, the first area of the GUI including a target icon that corresponds to a command;

detecting, by one or more processors of the device, that the touch input is received within the second area of the GUI but outside the first area that includes the target icon;

executing, by one or more processors of the device, the command that corresponds to the target icon included in the first area of the GUI, the executing of the command that corresponds to the target icon being in response to detection of the touch input being received within the second area of the GUI; and

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including flashing the GUI, the flashed GUI indicating detection of the touch input being received within the second area of the GUI, the presenting of the acknowledgement including causing the device to produce a haptic effect concurrently with the flashing of the GUI, the haptic effect indicating detection of the touch input being received within the second area of the GUI.

2. The method of claim 1, wherein:

the detected touch input is a first touch input;

the target icon in the first area of the GUI includes a first target icon that corresponds to a first command; and

the method further comprises;

detecting that a second touch input is received within the second area of the GUI but outside the first area of the GUI, the second touch input including a swipe input received within the second area but outside the first area of the GUI; and

in the first area of the GUI, replacing the first target icon that corresponds the first command with a second target icon that corresponds to a second command in response to detection of the swipe input being received within the second area of the GUI.

3. The method of claim 2, further comprising:

presenting an acknowledgment that the swipe input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including changing a predominant color of the GUI.

4. The method of claim 3, wherein:

the changed predominant color of the GUI corresponds to the second target icon that corresponds to the second command.

5. The method of claim 1, wherein:

the touchscreen managed by the device has a total viewable area; and

the second area of the GUI encompasses at least 75% of the total viewable area of the touchscreen.

6. The method of claim 1, further comprising:

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including changing a predominant color of the GUI, the changed predominant color of the GUI indicating detection of the touch input.

7. The method of claim 1, further comprising:

in the presenting of the acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, causing the device to produce a sound effect concurrently with the flashing of the GUI, the sound effect indicating detection of the touch input being received within the second area of the GUI.

8. A device comprising:

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, causes the device to perform operations comprising;

presenting a graphical user interface (GUI) on a touchscreen managed by the device, the GUI including a first area encompassed by a second area configured to receive a touch input from a user of the device, the first area of the GUI including a target icon that corresponds to a command;

detecting that the touch input is received within the second area of the GUI but first area that includes the target icon;

executing the command that corresponds to the target icon included in the first area of the GUI, the executing of the command that corresponds to the target icon being in response to detection of the touch input being received within the second area of the GUI; and

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including flashing the GUI, the flashed GUI indicating detection of the touch input being received within the second area of the GUI, the presenting of the acknowledgement including causing the device to produce a haptic effect concurrently with the flashing of the GUI the haptic effect indicating detection of the touch input being received within the second area of the GUI.

9. The device of claim 8, wherein:

the detected touch input is a first touch input;

the target icon in the first area of the GUI includes a first target icon that corresponds to a first command; and

the operations further comprise;

detecting that a second touch input is received within the second area of the GUI but outside the first area of the GUI, the second touch input including a swipe input received within the second area but outside the first area of the GUI; and

in the first area of the GUI, replacing the first target icon that corresponds the first command with a second target icon that corresponds to a second command in response to detection of the swipe input being received within the second area of the GUI.

10. The device of claim 9, wherein the operations further comprise:

presenting an acknowledgment that the swipe input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including changing a predominant color of the GUI.

11. The device of claim 10, wherein:

the changed predominant color of the GUI corresponds to the second target icon that corresponds to the second command.

12. The device of claim 8, wherein:

the touchscreen managed by the device has a total viewable area; and

the second area of the GUI encompasses at least 75% of the total viewable area of the touchscreen.

13. The device of claim 8, wherein the operations further comprise:

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including changing a predominant color of the GUI, the changed predominant color of the GUI indicating detection of the touch input.

14. The device of claim 8, wherein the operations further comprise:

in the presenting of the acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, causing the device to produce a sound effect concurrently with the flashing of the GUI, the sound effect indicating detection of the touch input being received within the second area of the GUI.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

presenting a graphical user interface (GUI) on a touchscreen managed by the device, the GUI including a first area encompassed by a second area configured to receive a touch input from a user of the device, the first area of the GUI including a target icon that corresponds to a command;

detecting that the touch input is received within the second area of the GUI but outside the first area that includes the target icon;

executing the command that corresponds to the target icon included in the first area of the GUI, the executing of the command that corresponds to the target icon being in response to detection of the touch input being received within the second area of the GUI; and

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including flashing the GUI, the flashed GUI indicating detection of the touch input being received within the second area of the GUI, the presenting of the acknowledgement including causing the device to produce a haptic effect concurrently with the flashing of the GUI the haptic effect indicating detection of the touch input being received within the second area of the GUI.

16. The non-transitory machine-readable storage medium of claim 15, wherein:

the detected touch input is a first touch input;

the target icon in the first area of the GUI includes a first target icon that corresponds to a first command; and

the operations further comprise;

detecting that a second touch input is received within the second area of the GUI but outside the first area of the GUI, the second touch input including a swipe input received within the second area but outside the first area of the GUI; and

in the first area of the GUI, replacing the first target icon that corresponds the first command with a second target icon that corresponds to a second command in response to detection of the swipe input being received within the second area of the GUI.

17. A method comprising:

presenting, by one or more processors of a device, a graphical user interface (GUI) on a touchscreen managed by the device, the GUI including a first area encompassed by a second area configured to receive a touch input from a user of the device, the first area of the GUI including a target icon that corresponds to a command;

detecting, by one or more processors of the device, that the touch input is received within the second area of the GUI but outside the first area that includes the target icon;

executing, by one or more processors of the device, the command that corresponds to the target icon included in the first area of the GUI, the executing of the command that corresponds to the target icon being in response to detection of the touch input being received within the second area of the GUI; and

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected;

the presenting of the acknowledgment including flashing the GUI, the flashed GUI indicating detection of the touch input being received within the second area of the GUI;

the presenting of the acknowledgement including causing the device to produce a sound effect concurrently with the flashing of the GUI, the sound effect indicating detection of the touch input being received within the second area of the GUI.

18. A device comprising:

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, causes the device to perform operations comprising;

presenting a graphical user interface (GUI) on a touchscreen managed by the device, the GUI including a first area encompassed by a second area configured to receive a touch input from a user of the device, the first area of the GUI including a target icon that corresponds to a command;

detecting that the touch input is received within the second area of the GUI but outside the first area that includes the target icon;

executing the command that corresponds to the target icon included in the first area of the GUI, the executing of the command that corresponds to the target icon being in response to detection of the touch input being received within the second area of the GUI; and

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including flashing the GUI, the flashed GUI indicating detection of the touch input being received within the second area of the GUI, the presenting of the acknowledgement including causing the device to produce a sound effect concurrently with the flashing of the GUI, the sound effect indicating detection of the touch input being received within the second area of the GUI.

19. A non-transitory machine-readable storage medium comprising instructions that, when then executed by one or more processors of a machine, cause the machine to perform operations comprising:

presenting a graphical user interface (GUI) on a touchscreen managed by the device, the GUI including a first area encompassed by a second area configured to receive a touch input from a user of the device, the first area of the GU including a target icon that corresponds to a command;

detecting that the touch input is received within the second area of the GUI but outside the first area that includes the target icon;

executing the command that corresponds to the target icon included in the first area of the GUI, the executing of the command that corresponds to the target icon being in response to detection of the touch input being received within the second area of the GUI; and

presenting an acknowledgment that the touch input received within the second area of the GUI but outside the first area of the GUI has been detected, the presenting of the acknowledgment including flashing the GUI, the flashed GUI indicating detection of the touch input being received within the second area of the GUI, the presenting of the acknowledgement including causing the device to produce a sound effect concurrently with the flashing of the GUI, the sound effect indicating detection of the touch input being received within the second area of the GUI.