DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR ACCESSIBILITY USING A TOUCH-SENSITIVE SURFACE

• US 20120327009A1
• Filed: 09/06/2012
• Published: 12/27/2012
• Est. Priority Date: 06/07/2009
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fleizach, Christopher Brian
• Application Number:
  US13/605,810
• Publication Number:
  US 20120327009A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Disclosed herein are systems, methods, and non-transitory computer-readable storage media for operating a computing device having at least two user interface (UI) navigation modes capable of being concurrently activated in said device, and both UI navigation modes being responsive to a predefined set of touch gestures on a touch-sensitive display of the computing device.

Claims

1. A method for operating a computing device having at least two user interface (UI) navigation modes capable of being concurrently activated in said device, and both UI navigation modes being responsive to a predefined set of touch gestures on a touch-sensitive display of the computing device, the method comprising:

receiving a touch gesture input on said touch-sensitive display;

interpreting the input according to a first set of heuristics of the first UI navigation mode, and performing resulting UI navigation functions accordingly, unless the input matches a predetermined UI navigation mode heuristic exception; and

interpreting the input according to a second set of heuristics of the second UI navigation mode, and performing resulting UI navigation functions accordingly, when the input matches said predetermined UI navigation mode heuristic exception.

2. A method for operating a computing device having at least two user interface (UI) navigation modes capable of being concurrently activated in said device, and both UI navigation modes being responsive to a predefined set of touch gestures on a touch-sensitive display of the computing device, the method comprising:

detecting a touch gesture on the touch-sensitive surface of the display while both UI navigation modes are activated in said device;

measuring at least a first parameter of the touch gesture;

determining, according to a first set of predetermined rules of a first one of said UI navigation modes, that the touch gesture corresponds to an implied user intent to execute a specified operation on a UI interface on said display, based on said first measured parameter of said touch gesture;

executing the specified operation on said UI interface;

measuring at least a second parameter of the touch gesture during the execution of said specified operation;

determining, according to a measured value of the second parameter, whether the second parameter should be interpreted according to the first set of predetermined rules or according to a second set of predetermined rules of a second one of the UI navigation modes;

upon determining that the second parameter of the gesture should be interpreted according to the first set of predetermined rules, executing a UI interface operation in accordance with the first set of predetermined rules; and

upon determining that the second parameter of the gesture should be interpreted according to the second set of predetermined rules, executing a UI interface operation in accordance with the second set of predetermined rules.

3. The method of claim 2, wherein first parameter comprises a movement vector of a maintained contact on the touch-sensitive surface, and the specified operation comprises a panning operation.

4. The method of claim 3, further comprising calculating the movement vector, wherein calculation of the movement vector comprises:

determining an amount of time that the touch-sensitive surface is contacted by the touch gesture;

determining a number of pixels traversed by the touch gesture; and

applying movement vector calculation rules from the first set of predetermined rules relating to an amount of time that the surface of the touch-sensitive surface is contacted by the touch gesture, and a number of pixels traversed by the touch gesture.

5. The method of claim 4, wherein the movement vector calculation rules from the first set of predetermined rules dictate that, to determine a touch gesture is a movement vector, the amount of time is greater than 0.175 seconds and the number of pixels is greater than 20.

6. The method of claim 3, wherein upon the cessation of the movement vector of maintained contact on the touch-sensitive surface, determining whether to perform a UI throwing operation in accordance with UI throwing rules from the first set of predetermined rules.

7. The method of claim 2, wherein the second parameter comprises a velocity of the touch gesture determined immediately prior to cessation of the touch gesture contact.

8. The method of claim 7, wherein the touch gesture is interpreted to correspond to a user intent to scroll a UI screen if the velocity is within a first range of values.

9. The method of claim 8, further comprising:

determining an angle, measure in degree relative to the orientation of the UI, of the touch gesture immediately prior to cessation of the touch gesture contact;

wherein upon interpreting a user intent to scroll a UI screen, scrolling the UI screen in accordance with rules relating to the determined angle.

10. The method of claim 9, wherein the rules relating to the determine angle dictate that:

angles between 0° and

45° and

angles between 315° and

360°

indicate leftwards scrolling;

angles between 45° and

135°

indicate upwards scrolling;

angles between 135° and

225°

indicate leftwards scrolling; and

angles between 225° and

315°

indicate leftwards scrolling.

11. The method of claim 9, wherein the rules relating to the determine angle dictate that:

angles between 0° and

30° and

angles between 330° and

360°

indicate leftwards scrolling;

angles between 60° and

120°

indicate upwards scrolling;

angles between 150° and

210°

indicate leftwards scrolling;

angles between 240° and

300°

indicate leftwards scrolling; and

all other angles indicate non-deliberate touch gestures which negate the interpreted intent to scroll a UI screen if the velocity is within a first range of values.

12. The method of claim 8, further comprising:

determining an amount of time that the touch-sensitive surface is contacted by the touch gesture and whether the amount of time that the touch-sensitive surface is contact by the touch gesture exceeds a predetermined threshold; and

upon determining that the predetermined threshold is exceeded, beginning a panning operation in accordance with the first set of predetermined rules before scrolling a UI screen in accordance with the second set of predetermined rules.

13. The method of claim 9, wherein upon interpreting a user intent to scroll a UI screen, outputting audible indicia of the UI screen being scrolled to.

14. The method of claim 7, wherein the touch gesture is interpreted to correspond to a user intent to throw a UI screen if the velocity is within a second range of values.

15. An accessible electronic device, comprising:

a touch-sensitive surface;

a display;

one or more processors;

memory;

and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

detecting a touch gesture on the touch-sensitive surface of the display while both UI navigation modes are activated in said device;

measuring at least a first parameter of the touch gesture;

determining, according to a first set of predetermined rules of a first one of said UI navigation modes, that the touch gesture corresponds to an implied user intent to execute a specified operation on a UI interface on said display, based on said first measured parameter of said touch gesture;

executing the specified operation on said UI interface;

measuring at least a second parameter of the touch gesture during the execution of said specified operation;

determining, according to a measured value of the second parameter, whether the second parameter should be interpreted according to the first set of predetermined rules or according to a second set of predetermined rules of a second one of the UI navigation modes;

upon determining that the second parameter of the gesture should be interpreted according to the first set of predetermined rules, executing a UI interface operation in accordance with the first set of predetermined rules; and

upon determining that the second parameter of the gesture should be interpreted according to the second set of predetermined rules, executing a UI interface operation in accordance with the second set of predetermined rules.

16. The accessible electronic device of claim 15, wherein first parameter comprises a movement vector of a maintained contact on the touch-sensitive surface, and wherein the specified operation comprises a panning operation, and wherein the one or more programs further include instructions for calculating the movement vector, wherein calculation of the movement vector comprises:

determining an amount of time that the touch-sensitive surface is contacted by the touch gesture;

determining a number of pixels traversed by the touch gesture; and

applying movement vector calculation rules from the first set of predetermined rules relating to an amount of time that the surface of the touch-sensitive surface is contacted by the touch gesture, and a number of pixels traversed by the touch gesture.

17. The accessible electronic device of claim 15, wherein the one or more programs further include instructions for:

determining cessation of the movement vector; and

upon the cessation of the movement vector of maintained contact on the touch-sensitive surface, determining whether to perform a UI throwing operation in accordance with UI throwing rules from the first set of predetermined rules.

18. The accessible electronic device of claim 15, wherein the second parameter comprises a velocity of the touch gesture determined immediately prior to cessation of the touch gesture contact, wherein the touch gesture is interpreted to correspond to a user intent to scroll a UI screen if the velocity is within a first range of values, and wherein the one or more programs further include instructions for:

determining an angle, measure in degree relative to the orientation of the UI, of the touch gesture immediately prior to cessation of the touch gesture contact; and

wherein upon interpreting a user intent to scroll a UI screen, scrolling the UI screen in accordance with rules relating to the determined angle.

19. The accessible electronic device of claim 15, wherein the one or more programs further include instructions for, upon interpreting a user intent to scroll a UI screen, outputting audible indicia of the UI screen being scrolled to.

20. A computer readable storage medium having stored therein instructions, which when executed by an accessible electronic device having at least two user interface (UI) navigation modes capable of being concurrently activated in said device, and both UI navigation modes being responsive to a predefined set of touch gestures on a touch-sensitive display of the computing device, cause the device to:

receive a touch gesture input on said touch-sensitive display;

interpret the input according to a first set of heuristics of the first UI navigation mode, and performing resulting UI navigation functions accordingly, unless the input matches a predetermined UI navigation mode heuristic exception; and

interpret the input according to a second set of heuristics of the second UI navigation mode, and performing resulting UI navigation functions accordingly, when the input matches said predetermined UI navigation mode heuristic exception.

21. A computer readable storage medium having stored therein instructions, which when executed by a computing device having at least two user interface (UI) navigation modes capable of being concurrently activated in said device, and both UI navigation modes being responsive to a predefined set of touch gestures on a touch-sensitive display of the computing device, cause the device to:

detect a touch gesture on the touch-sensitive surface of the display while both UI navigation modes are activated in said device;

measure at least a first parameter of the touch gesture;

determine, according to a first set of predetermined rules of a first one of said UI navigation modes, that the touch gesture corresponds to an implied user intent to execute a specified operation on a UI interface on said display, based on said first measured parameter of said touch gesture;

execute the specified operation on said UI interface;

measure at least a second parameter of the touch gesture during the execution of said specified operation;

determine, according to a measured value of the second parameter, whether the second parameter should be interpreted according to the first set of predetermined rules or according to a second set of predetermined rules of a second one of the UI navigation modes;

upon determining that the second parameter of the gesture should be interpreted according to the first set of predetermined rules, execute a UI interface operation in accordance with the first set of predetermined rules; and

upon determining that the second parameter of the gesture should be interpreted according to the second set of predetermined rules, execute a UI interface operation in accordance with the second set of predetermined rules.