INTERFACE SCANNING FOR DISABLED USERS

• US 20140215398A1
• Filed: 03/01/2013
• Published: 07/31/2014
• Est. Priority Date: 01/25/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Seymour, Eric T., Hughes, Gregory F., Hoa, Patti P., Fleizach, Christopher, Kasemest, Clare, White, Samuel, Minifie, Darren C., Fisch, Ian, Kaufman, Justin
• Granted Patent: US 9,792,013 B2
• Time in Patent Office: Days
• US Class Current: 715/823
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: H04M 1/2474 Telephone terminals specially adapted for disabled people user interfaces for cordless or mobile telephones specially adapted for disabled users H04M1/72475; network based special services or facilities for hearing-impaired persons H04M3/42391; devices for conversing with the deaf-blind G09B21/04
• CPC Class Codes: H04M 1/72475 specially adapted for disabled users

Abstract

Systems and processes for scanning a user interface are disclosed. One process can include scanning multiple elements within a user interface by highlighting the elements. The process can further include receiving a selection while one of the elements is highlighted and performing an action on the element that was highlighted when the selection was received. The action can include scanning the contents of the selected element or performing an action associated with the selected element. The process can be used to navigate an array of application icons, a menu of options, a standard desktop or laptop operating system interface, or the like. The process can also be used to perform gestures on a touch-sensitive device or mouse and track pad gestures (e.g., flick, tap, or freehand gestures).

Claims

1. A method comprising:

highlighting a plurality of elements within a user interface, wherein at least one of the plurality of elements comprises a plurality of sub-elements;

receiving a selection while the at least one of the plurality of elements is highlighted; and

performing an action on the at least one of the plurality of elements.

2. The method of claim 1, wherein highlighting the plurality of elements comprises changing a visual characteristic of the plurality of elements, generating an audible notification, or generating a vibration.

3. The method of claim 1, wherein highlighting the plurality of elements within the user interface comprises sequentially highlighting the plurality of elements within the user interface.

4. The method of claim 1, wherein the action performed on the at least one of the plurality of elements comprises:

highlighting a plurality of sub-elements of the at least one of the plurality of elements.

5. The method of claim 4, wherein the method further comprises:

receiving a selection while a sub-element of the plurality of sub-elements is highlighted; and

performing an action associated with the sub-element.

6. The method of claim 1, wherein highlighting the plurality of elements within the user interface comprises:

highlighting a first element of the plurality of elements; and

highlighting a second element of the plurality of elements if the selection is not received within a threshold length of time or in response to an input from a user.

7. The method of claim 1, wherein highlighting the plurality of elements within the user interface comprises:

ceasing highlighting of the plurality of elements in response to highlighting the plurality of elements a threshold number of times; and

resuming the highlighting of the plurality of elements after a threshold length of time or in response to a user input.

8. A method comprising:

defining a plurality of elements within a user interface;

grouping the plurality of elements into one or more sets of elements based on at least one characteristic associated with the plurality of elements within the user interface; and

scanning the plurality of elements in accordance with the grouping of the plurality of elements.

9. The method of claim 8, wherein defining the plurality of elements within the user interface comprises:

identifying a plurality of selectable elements within the user interface; and

defining the plurality of selectable elements as an element of the plurality of elements.

10. The method of claim 8, wherein defining the plurality of elements within the user interface comprises:

dividing the user interface into a plurality of sections; and

defining the plurality of sections as an element of the plurality of elements.

11. The method of claim 8, wherein the at least one characteristic associated with the plurality of elements comprises a location of the plurality of elements within the user interface.

12. A method comprising:

highlighting a first element within a user interface;

determining whether a selection has been received while highlighting the first element;

if the selection has been received while highlighting the first element, performing an action on the first element; and

if the selection has not been received while highlighting the first element, highlighting a second element within the user interface.

13. The method of claim 12, wherein the method further comprises:

determining whether the selection has been received while highlighting the second element;

if the selection has been received while highlighting the second element, performing an action on the second element; and

if the selection has not been received while highlighting the second element, highlighting a third element within the user interface.

14. The method of claim 12, wherein the user interface is a user interface of a touch sensitive device, and wherein the first element comprises a first application icon and the second element comprises a second application icon.

15. The method of claim 12, wherein the user interface comprises a virtual keyboard, and wherein the first element comprises a first virtual key and the second element comprises a second virtual key.

16. The method of claim 12, wherein the user interface comprises a menu, and wherein the first element comprises a first option and the second element comprises a second option.

17. A method comprising:

causing a display of an orientation indicator;

causing a display of a plurality of navigation options;

highlighting the plurality of navigation options; and

causing a display of a positional indicator moving in a direction of the orientation indicator in response to receiving a selection while a move option from the plurality of navigation options is highlighted.

18. The method of claim 17, wherein the plurality of navigation options comprises a plurality of directional options, and wherein the method further comprises:

changing the orientation of the orientation indicator in response to receiving the selection while a directional option of the plurality of directional options is highlighted.

19. The method of claim 18, wherein the plurality of directional options comprises a clockwise turn button and counter-clockwise turn button, and wherein the orientation of the orientation indicator is rotated in a direction associated with the clockwise turn button or the counter-clockwise button arrow in response to receiving the selection while the clockwise turn button or the counter-clockwise turn button is highlighted, respectively.

20. The method of claim 18, wherein the plurality of directional options comprises a clockwise turn button and counter-clockwise turn button, and wherein the orientation of the orientation indicator rotates by a predetermined amount in a direction associated with the clockwise turn button or the counter-clockwise turn button in response to receiving the selection while the clockwise turn button or the counter-clockwise turn button is highlighted, respectively.

21. A non-transitory computer-readable storage medium comprising instructions for:

highlighting a plurality of elements within a virtual keyboard, wherein the plurality of elements comprises a set of virtual keys of the virtual keyboard;

receiving a selection while an element of the plurality of elements is highlighted;

highlighting the virtual keys of the set of virtual keys of the selected element;

receiving a selection while a virtual key is highlighted; and

causing a display of a character associated with the virtual key.

22. The non-transitory computer-readable storage medium of claim 21, wherein the non-transitory computer-readable storage medium further comprises instructions for:

highlighting, prior to highlighting the virtual keys, a first subset of virtual keys of the set of virtual keys of the selected element and a second subset of virtual keys of the set of virtual keys of the selected element; and

receiving a selection while either the first subset of virtual keys of the set of virtual keys of the selected element or the second subset of virtual keys of the set of virtual keys of the selected element is highlighted, wherein highlighting the virtual keys of the set of virtual keys of the selected element comprises highlighting only the virtual keys of the subset that was highlighted when the selection was received.

23. The non-transitory computer-readable storage medium of claim 21, wherein at least one virtual key of the virtual keyboard comprises an alternate key option.

24. The non-transitory computer-readable storage medium of claim 21, wherein highlighting the plurality of elements within the virtual keyboard comprises sequentially highlighting each of the plurality of elements within the virtual keyboard for less than 1 second.

25. The non-transitory computer-readable storage medium of claim 21, wherein highlighting the virtual keys of the row of virtual keys of the selected element comprises sequentially highlighting each of the virtual keys of the set of virtual keys of the selected element for less than 1 second.