Interface scanning for disabled users

• US 9,792,013 B2
• Filed: 03/01/2013
• Issued: 10/17/2017
• Est. Priority Date: 01/25/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fleizach, Christopher, Seymour, Eric T., Kasemset, Clare, White, Samuel, Minifie, Darren C., Fisch, Ian, Hughes, Gregory F., Kaufman, Justin, Hoa, Patti P.
• Primary Examiner(s): Chow, Doon
• Assistant Examiner(s): CHIUSANO, ANDREW TSUTOMU
• Application Number:
  US13/782,843
• Publication Number:
  US 20140215398A1
• Time in Patent Office: 1,691 Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: H04M 1/2474 Telephone terminals specially adapted for disabled people user interfaces for cordless or mobile telephones specially adapted for disabled users H04M1/72475; network based special services or facilities for hearing-impaired persons H04M3/42391; devices for conversing with the deaf-blind G09B21/04
• CPC Class Codes: H04M 1/72475 specially adapted for disabled users

Abstract

Systems and processes for scanning a user interface are disclosed. One process can include scanning multiple elements within a user interface by highlighting the elements. The process can further include receiving a selection while one of the elements is highlighted and performing an action on the element that was highlighted when the selection was received. The action can include scanning the contents of the selected element or performing an action associated with the selected element. The process can be used to navigate an array of application icons, a menu of options, a standard desktop or laptop operating system interface, or the like. The process can also be used to perform gestures on a touch-sensitive device or mouse and track pad gestures (e.g., flick, tap, or freehand gestures).

Claims

1. A method comprising:

at an electronic device with a display and one or more input devices;

scanning a plurality of elements displayed on the display, wherein scanning the plurality of elements comprises sequentially highlighting the plurality of elements, and wherein a first element of the plurality of elements comprises a plurality of sub-elements;

receiving, via the one or more input devices, a first selection input when the first element of the plurality of elements is highlighted;

in response to receiving the first selection input, scanning a region of the display that includes the plurality of sub-elements of the first element, wherein scanning the region of the display includes scanning the plurality of sub-elements;

receiving a second selection input, via the one or more input devices, while scanning the region of the display that includes the plurality of sub-elements; and

in response to receiving the second selection input;

in accordance with a determination that the second selection input includes selection of a respective sub-element of the plurality of sub-elements, performing an action associated with the respective sub-element of the plurality of sub-elements; and

in accordance with a determination that the second selection input includes selection of an escape element associated with an escape command, performing the escape command, wherein the escape element includes a graphical element that encompasses the plurality of sub-elements.

2. The method of claim 1, wherein performing the escape command includes returning to scanning elements in the plurality of elements.

3. The method of claim 1, wherein the escape command is performed without performing the action associated with the respective sub-element.

4. The method of claim 1, wherein the first selection input and the second selection input are received via a common input device of the one or more input devices.

5. The method of claim 1, wherein scanning the region of the display that includes the plurality of sub-elements of the first element comprises sequentially highlighting the plurality of sub-elements and then highlighting the first element of the plurality of elements.

6. The method of claim 5, wherein the determination that the second selection input includes selection of an escape element associated with an escape command comprises determining that the second selection input is received when the first element of the plurality of elements is highlighted.

7. The method of claim 1, wherein the escape element comprises highlighting of the first element of the plurality of elements.

8. The method of claim 1, wherein the escape element comprises an indication of a selection of the first element of the plurality of elements.

9. An electronic device comprising:

a display;

one or more input devices; and

one or more processors coupled to the display and the one or more input devices, the one or more processors capable of;

scanning a plurality of elements displayed on the display, wherein scanning the plurality of elements comprises sequentially highlighting the plurality of elements, and wherein a first element of the plurality of elements comprises a plurality of sub-elements;

receiving, via the one or more input devices, a first selection input when the first element of the plurality of elements is highlighted;

in response to receiving the first selection input, scanning a region of the display that includes the plurality of sub-elements of the first element, wherein scanning the region of the display includes scanning the plurality of sub-elements;

receiving a second selection input, via the one or more input devices, while scanning the region of the display that includes the plurality of sub-elements; and

in response to receiving the second selection input;

in accordance with a determination that the second selection input includes selection of a respective sub-element of the plurality of sub-elements, performing an action associated with the respective sub-element of the plurality of sub-elements; and

in accordance with a determination that the second selection input includes selection of an escape element associated with an escape command, performing the escape command, wherein the escape element includes a graphical element that encompasses the plurality of sub-elements.

10. The electronic device of claim 9, wherein performing the escape command includes returning to scanning elements in the plurality of elements.

11. The electronic device of claim 9, wherein the escape command is performed without performing the action associated with the respective sub-element.

12. The electronic device of claim 9, wherein the first selection input and the second selection input are received via a common input device of the one or more input devices.

13. The electronic device of claim 9, wherein scanning the region of the display that includes the plurality of sub-elements of the first element comprises sequentially highlighting the plurality of sub-elements and then highlighting the first element of the plurality of elements.

14. The electronic device of claim 13, wherein the determination that the second selection input includes selection of an escape element associated with an escape command comprises determining that the second selection input is received when the first element of the plurality of elements is highlighted.

15. The electronic device of claim 9, wherein the escape element comprises highlighting of the first element of the plurality of elements.

16. The electronic device of claim 9, wherein the escape element comprises an indication of a selection of the first element of the plurality of elements.

17. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with one or more processors, a display and one or more input devices, cause the device to:

scan a plurality of elements displayed on the display, wherein scanning the plurality of elements comprises sequentially highlighting the plurality of elements, and wherein a first element of the plurality of elements comprises a plurality of sub-elements;

receive, via the one or more input devices, a first selection input when the first element of the plurality of elements is highlighted;

in response to receiving the first selection input, scan a region of the display that includes the plurality of sub-elements of the first element, wherein scanning the region of the display includes scanning the plurality of sub-elements;

receive a second selection input, via the one or more input devices, while scanning the region of the display that includes the plurality of sub-elements; and

in response to receiving the second selection input;

in accordance with a determination that the second selection input includes selection of a respective sub-element of the plurality of sub-elements, perform an action associated with the respective sub-element of the plurality of sub-elements; and

in accordance with a determination that the second selection input includes selection of an escape element associated with an escape command, perform the escape command, wherein the escape element includes a graphical element that encompasses the plurality of sub-elements.

18. The non-transitory computer-readable storage medium of claim 17, wherein performing the escape command includes returning to scanning elements in the plurality of elements.

19. The non-transitory computer-readable storage medium of claim 17, wherein the escape command is performed without performing the action associated with the respective sub-element.

20. The non-transitory computer-readable storage medium of claim 17, wherein the first selection input and the second selection input are received via a common input device of the one or more input devices.

21. The non-transitory computer-readable storage medium of claim 17, wherein scanning the region of the display that includes the plurality of sub-elements of the first element comprises sequentially highlighting the plurality of sub-elements and then highlighting the first element of the plurality of elements.

22. The non-transitory computer-readable storage medium of claim 21, wherein the determination that the second selection input includes selection of an escape element associated with an escape command comprises determining that the second selection input is received when the first element of the plurality of elements is highlighted.

23. The non-transitory computer-readable storage medium of claim 17, wherein the escape element comprises highlighting of the first element of the plurality of elements.

24. The non-transitory computer-readable storage medium of claim 17, wherein the escape element comprises an indication of a selection of the first element of the plurality of elements.