Devices, methods, and graphical user interfaces for accessibility using a touch-sensitive surface

• US 10,061,507 B2
• Filed: 11/16/2015
• Issued: 08/28/2018
• Est. Priority Date: 06/07/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fleizach, Christopher Brian, Seymour, Eric Taylor
• Primary Examiner(s): Simpson, Lixi C
• Application Number:
  US14/943,005
• Publication Number:
  US 20160070433A1
• Time in Patent Office: 1,016 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An electronic device with a touch screen display is provided. Content in a user interface is displayed at a first magnification, and in response to detecting a first multi-finger gesture on the touch screen display (e.g., a three-finger tap gesture), a first portion of the content is magnified to a second magnification, greater than the first magnification. Further, while displaying the first portion of the content in the user interface at the second magnification, the device may detect a second multi-finger gesture on the touch screen display (e.g., movement of a three-finger contact on the display). In response to this movement, the device performs panning the user interface, so that a second portion of the content, different from the first portion, is displayed on the touch screen at the second magnification.

Claims

1. An accessibility method, comprising:

at an electronic device with a touch screen display;

displaying content in a user interface at a first magnification on the touch screen display;

detecting a first multi-finger gesture at a location on the touch screen display, wherein detecting the first multi-finger gesture includes detecting concurrent multi-finger contacts on the touch screen display; and

in response to detecting the first multi-finger gesture on the touch screen display;

in accordance with a determination that the first multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display, magnifying a first portion of the content in the user interface to a second magnification, greater than the first magnification, on the touch screen display, wherein the second magnification is a predefined magnification, and wherein the first portion of the content to be magnified in response to detecting the first multi-finger gesture on the touch screen display is determined based on the location of the first multi-finger gesture on the touch screen display; and

in accordance with a determination that the first multi-finger gesture includes more than the threshold amount of movement on the touch screen display, magnifying the first portion of the content in the user interface to a third magnification, greater than the first magnification, on the touch screen display, wherein the third magnification is selected based on a magnitude of the movement of the first multi-finger gesture, and wherein the first portion of the content to be magnified in response to detecting the first multi-finger gesture on the touch screen display is determined based on the location of the first multi-finger gesture on the touch screen display.

2. The method of claim 1, further comprising:

while displaying the first portion of the content in the user interface at the second magnification or the third magnification, detecting a second multi-finger gesture on the touch screen display; and

in response to detecting the second multi-finger gesture on the touch screen display, panning the user interface in accordance with the second multi-finger gesture, so that a second portion of the content, different from the first portion, is displayed on the touch screen at the second magnification or the third magnification, wherein the second portion of the content is selected based on a magnitude of movement of the second multi-finger gesture on the touch screen display.

3. The method of claim 2, wherein the second multi-finger gesture is a three-finger drag gesture on the touch screen display.

4. The method of claim 2, including:

while displaying a second portion of the content in the user interface at the second magnification or the third magnification on the touch screen display;

detecting a third multi-finger gesture on the touch screen display, wherein detecting the third multi-finger gesture includes detecting concurrent multi-finger contacts on the touch screen display; and

in response to detecting the third multi-finger gesture on the touch screen display;

in accordance with a determination that the third multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display, demagnifying the second portion of the content in the user interface to a fourth magnification on the touch screen display; and

in accordance with a determination that the third multi-finger gesture includes more than the threshold amount of movement on the touch screen display, demagnifying the second portion of the content in the user interface to a fifth magnification on the touch screen display, wherein the fifth magnification is selected based on a magnitude of the movement of the third multi-finger gesture.

5. The method of claim 4, wherein the third multi-finger gesture includes a three-finger tap gesture.

6. The method of claim 4, wherein the determination that the third multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display includes a determination that the third multi-finger gesture is a three-finger, double-tap gesture.

7. The method of claim 4, wherein the third multi-finger gesture is the same as the first multi-finger gesture.

8. The method of claim 4, wherein demagnifying the content in the user interface includes displaying a zooming-out animation.

9. The method of claim 4, wherein the fourth magnification corresponds to a default unmagnified view.

10. The method of claim 4, wherein the fourth magnification corresponds to the first magnification.

11. The method of claim 4, wherein detecting the third multi-finger gesture includes:

detecting a first touchdown of a respective number of contacts on the touch screen display, wherein the respective number of contacts is greater than one;

detecting a first liftoff of the respective number of contacts from the touch screen display; and

detecting a second touchdown of the respective number of contacts on the touch screen display.

12. The method of claim 11, wherein:

the third multi-finger gesture includes detecting a second liftoff of the respective number of contacts;

the determination that the third multi-finger gesture ends with the liftoff of the concurrent multi-finger contacts occurring without more than the threshold amount of movement on the touch screen display includes a determination that the second liftoff of the respective number of contacts from the touch screen display was detected without more than the threshold amount of movement being detected; and

the determination that the third multi-finger gesture includes more than the threshold amount of movement on the touch screen display includes a determination that the threshold amount of movement was detected after detecting the second touchdown of the respective number of contacts on the touch screen display and before the second liftoff of the respective number of contacts from the touch screen display was detected.

13. The method of claim 4, wherein the third multi-finger gesture includes movement in a direction towards a bottom of the touch screen display until the fifth magnification is reached.

14. The method of claim 1, wherein the first magnification corresponds to a default unmagnified view.

15. The method of claim 1, wherein the first multi-finger gesture includes a three-finger tap gesture.

16. The method of claim 1, wherein the determination that the first multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display includes a determination that the first multi-finger gesture is a three-finger, double-tap gesture.

17. The method of claim 1, wherein detecting the first multi-finger gesture includes:

detecting a first touchdown of a respective number of contacts on the touch screen display, wherein the respective number of contacts is greater than one;

detecting a first liftoff of the respective number of contacts from the touch screen display; and

detecting a second touchdown of the respective number of contacts on the touch screen display.

18. The method of claim 17, wherein:

the first multi-finger gesture includes detecting a second liftoff of the respective number of contacts;

the determination that the first multi-finger gesture ends with the liftoff of the concurrent multi-finger contacts occurring without more than the threshold amount of movement on the touch screen display includes a determination that the second liftoff of the respective number of contacts from the touch screen display was detected without more than the threshold amount of movement being detected; and

the determination that the first multi-finger gesture includes more than the threshold amount of movement on the touch screen display includes a determination that the threshold amount of movement was detected after detecting the second touchdown of the respective number of contacts on the touch screen display and before the second liftoff of the respective number of contacts from the touch screen display was detected.

19. The method of claim 1, wherein the first multi-finger gesture includes movement towards a top of the touch screen display until the third magnification is reached.

20. The method of claim 1, further comprising:

while displaying the first portion of the content in the user interface at the second magnification, detecting a fourth multi-finger gesture on the touch screen display; and

in response to detecting the fourth multi-finger gesture on the touch screen display, wherein the fourth multi-finger gesture includes more than the threshold amount of movement on the touch screen display, further magnifying the first portion of the content in the user interface to a sixth magnification, greater than the second magnification, on the touch screen display, wherein the sixth magnification is selected based on a magnitude of movement of the fourth multi-finger gesture.

21. An electronic device, comprising:

a touch screen display;

one or more processors; and

memory storing one or more programs, which when executed by the one or more processors, cause the device to;

display content in a user interface at a first magnification on the touch screen display; and

detect a first multi-finger gesture at a location on the touch screen display, wherein detecting the first multi-finger gesture includes detecting concurrent multi-finger contacts on the touch screen display;

in response to detecting the first multi-finger gesture on the touch screen display;

in accordance with a determination that the first multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display, magnify a first portion of the content in the user interface to a second magnification, greater than the first magnification, on the touch screen display, wherein the second magnification is a predefined magnification, and wherein the first portion of the content to be magnified in response to detecting the first multi-finger gesture on the touch screen display is determined based on the location of the first multi-finger gesture on the touch screen display; and

in accordance with a determination that the first multi-finger gesture includes more than the threshold amount of movement on the touch screen display, magnify the first portion of the content in the user interface to a third magnification, greater than the first magnification, on the touch screen display, wherein the third magnification is selected based on a magnitude of the movement of the first multi-finger gesture, and wherein the first portion of the content to be magnified in response to detecting the first multi-finger gesture on the touch screen display is determined based on the location of the first multi-finger gesture on the touch screen display.

22. The device of claim 21, wherein the memory further stores programs, which when executed by the one or more processors, cause the device to:

while displaying the first portion of the content in the user interface at the second magnification or the third magnification, detect a second multi-finger gesture on the touch screen display; and

in response to detecting the second multi-finger gesture on the touch screen display, pan the user interface in accordance with the second multi-finger gesture, so that a second portion of the content, different from the first portion, is displayed on the touch screen at the second magnification or the third magnification, wherein the second portion of the content is selected based on a magnitude of movement of the second multi-finger gesture on the touch screen display.

23. The device of claim 22, wherein the second multi-finger gesture is a three-finger drag gesture on the touch screen display.

24. The device of claim 22, wherein the memory further stores programs, which when executed by the one or more processors, cause the device to:

while displaying a second portion of the content in the user interface at the second magnification or the third magnification on the touch screen display;

detect a third multi-finger gesture on the touch screen display, wherein detecting the third multi-finger gesture includes detecting concurrent multi-finger contacts on the touch screen display; and

in response to detecting the third multi-finger gesture on the touch screen display;

in accordance with a determination that the third multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display, demagnify the second portion of the content in the user interface to a fourth magnification on the touch screen display; and

in accordance with a determination that the third multi-finger gesture includes more than the threshold amount of movement on the touch screen display, demagnify the second portion of the content in the user interface to a fifth magnification on the touch screen display, wherein the fifth magnification is selected based on a magnitude of the movement of the third multi-finger gesture.

25. The device of claim 24, wherein the third multi-finger gesture includes a three-finger tap gesture.

26. The device of claim 24, wherein the determination that the third multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display includes a determination that the third multi-finger gesture is a three-finger, double-tap gesture.

27. The device of claim 24, wherein the third multi-finger gesture is the same as the first multi-finger gesture.

28. The device of claim 24, wherein demagnifying the content in the user interface includes displaying a zooming-out animation.

29. The device of claim 24, wherein the fourth magnification corresponds to a default unmagnified view.

30. The device of claim 24, wherein the fourth magnification corresponds to the first magnification.

31. The device of claim 24, wherein detecting the third multi-finger gesture includes:

detecting a first touchdown of a respective number of contacts on the touch screen display, wherein the respective number of contacts is greater than one;

detecting a first liftoff of the respective number of contacts from the touch screen display; and

detecting a second touchdown of the respective number of contacts on the touch screen display.

32. The device of claim 31, wherein:

the third multi-finger gesture includes detecting a second liftoff of the respective number of contacts;

the determination that the third multi-finger gesture ends with the liftoff of the concurrent multi-finger contacts occurring without more than the threshold amount of movement on the touch screen display includes a determination that the second liftoff of the respective number of contacts from the touch screen display was detected without more than the threshold amount of movement being detected; and

the determination that the third multi-finger gesture includes more than the threshold amount of movement on the touch screen display includes a determination that the threshold amount of movement was detected after detecting the second touchdown of the respective number of contacts on the touch screen display and before the second liftoff of the respective number of contacts from the touch screen display was detected.

33. The device of claim 24, wherein the third multi-finger gesture includes movement in a direction towards a bottom of the touch screen display until the fifth magnification is reached.

34. The device of claim 21, wherein the first magnification corresponds to a default unmagnified view.

35. The device of claim 21, wherein the first multi-finger gesture includes a three-finger tap gesture.

36. The device of claim 21, wherein the determination that the first multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display includes a determination that the first multi-finger gesture is a three-finger, double-tap gesture.

37. The device of claim 21, wherein detecting the first multi-finger gesture includes:

detecting a first touchdown of a respective number of contacts on the touch screen display, wherein the respective number of contacts is greater than one;

detecting a first liftoff of the respective number of contacts from the touch screen display; and

detecting a second touchdown of the respective number of contacts on the touch screen display.

38. The device of claim 37, wherein:

the first multi-finger gesture includes detecting a second liftoff of the respective number of contacts;

the determination that the first multi-finger gesture ends with the liftoff of the concurrent multi-finger contacts occurring without more than the threshold amount of movement on the touch screen display includes a determination that the second liftoff of the respective number of contacts from the touch screen display was detected without more than the threshold amount of movement being detected; and

the determination that the first multi-finger gesture includes more than the threshold amount of movement on the touch screen display includes a determination that the threshold amount of movement was detected after detecting the second touchdown of the respective number of contacts on the touch screen display and before the second liftoff of the respective number of contacts from the touch screen display was detected.

39. The device of claim 21, wherein the first multi-finger gesture includes movement towards a top of the touch screen display until the third magnification is reached.

40. The device of claim 21, wherein the memory further stores programs, which when executed by the one or more processors, cause the device to:

while displaying the first portion of the content in the user interface at the second magnification, detect a fourth multi-finger gesture on the touch screen display; and

in response to detecting the fourth multi-finger gesture on the touch screen display, wherein the fourth multi-finger gesture includes more than the threshold amount of movement on the touch screen display, further magnify the first portion of the content in the user interface to a sixth magnification, greater than the second magnification, on the touch screen display, wherein the sixth magnification is selected based on a magnitude of movement of the fourth multi-finger gesture.

41. A non-transitory computer readable storage medium having stored therein instructions, which, when executed by an accessible electronic device with a touch screen display, cause the device to:

display content in a user interface at a first magnification on the touch screen display;

detect a first multi-finger gesture at a location on the touch screen display, wherein detecting the first multi-finger gesture includes detecting concurrent multi-finger contacts on the touch screen display; and

in response to detecting the first multi-finger gesture on the touch screen display;

in accordance with a determination that the first multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display, magnify a first portion of the content in the user interface to a second magnification, greater than the first magnification, on the touch screen display, wherein the second magnification is a predefined magnification, and wherein the first portion of the content to be magnified in response to detecting the first multi-finger gesture on the touch screen display is determined based on the location of the first multi-finger gesture on the touch screen display; and

in accordance with a determination that the first multi-finger gesture includes more than the threshold amount of movement on the touch screen display, magnify the first portion of the content in the user interface to a third magnification, greater than the first magnification, on the touch screen display, wherein the third magnification is selected based on a magnitude of the movement of the first multi-finger gesture, and wherein the first portion of the content to be magnified in response to detecting the first multi-finger gesture on the touch screen display is determined based on the location of the first multi-finger gesture on the touch screen display.

42. The medium of claim 41, wherein the medium further stores instructions, which when executed by the accessible electronic device, cause the device to:

while displaying the first portion of the content in the user interface at the second magnification or the third magnification, detect a second multi-finger gesture on the touch screen display; and

in response to detecting the second multi-finger gesture on the touch screen display, pan the user interface in accordance with the second multi-finger gesture, so that a second portion of the content, different from the first portion, is displayed on the touch screen at the second magnification or the third magnification, wherein the second portion of the content is selected based on a magnitude of movement of the second multi-finger gesture on the touch screen display.

43. The medium of claim 42, wherein the second multi-finger gesture is a three-finger drag gesture on the touch screen display.

44. The medium of claim 42, wherein the medium further stores instructions, which when executed by the accessible electronic device, cause the device to:

while displaying a second portion of the content in the user interface at the second magnification or the third magnification on the touch screen display;

detect a third multi-finger gesture on the touch screen display, wherein detecting the third multi-finger gesture includes detecting concurrent multi-finger contacts on the touch screen display; and

in response to detecting the third multi-finger gesture on the touch screen display;

in accordance with a determination that the third multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display, demagnify the second portion of the content in the user interface to a fourth magnification on the touch screen display; and

in accordance with a determination that the third multi-finger gesture includes more than the threshold amount of movement on the touch screen display, demagnify the second portion of the content in the user interface to a fifth magnification on the touch screen display, wherein the fifth magnification is selected based on a magnitude of the movement of the third multi-finger gesture.

45. The medium of claim 44, wherein the third multi-finger gesture includes a three-finger tap gesture.

46. The medium of claim 44, wherein the determination that the third multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display includes a determination that the third multi-finger gesture is a three-finger, double-tap gesture.

47. The medium of claim 44, wherein the third multi-finger gesture is the same as the first multi-finger gesture.

48. The medium of claim 44, wherein demagnifying the content in the user interface includes displaying a zooming-out animation.

49. The medium of claim 44, wherein the fourth magnification corresponds to a default unmagnified view.

50. The medium of claim 44, wherein the fourth magnification corresponds to the first magnification.

51. The medium of claim 44, wherein detecting the third multi-finger gesture includes:

detecting a first touchdown of a respective number of contacts on the touch screen display, wherein the respective number of contacts is greater than one;

detecting a first liftoff of the respective number of contacts from the touch screen display; and

detecting a second touchdown of the respective number of contacts on the touch screen display.

52. The medium of claim 51, wherein:

the third multi-finger gesture includes detecting a second liftoff of the respective number of contacts;

the determination that the third multi-finger gesture ends with the liftoff of the concurrent multi-finger contacts occurring without more than the threshold amount of movement on the touch screen display includes a determination that the second liftoff of the respective number of contacts from the touch screen display was detected without more than the threshold amount of movement being detected; and

the determination that the third multi-finger gesture includes more than the threshold amount of movement on the touch screen display includes a determination that the threshold amount of movement was detected after detecting the second touchdown of the respective number of contacts on the touch screen display and before the second liftoff of the respective number of contacts from the touch screen display was detected.

53. The medium of claim 44, wherein the third multi-finger gesture includes movement in a direction towards a bottom of the touch screen display until the fifth magnification is reached.

54. The medium of claim 41, wherein the first magnification corresponds to a default unmagnified view.

55. The medium of claim 41, wherein the first multi-finger gesture includes a three-finger tap gesture.

56. The medium of claim 41, wherein the determination that the first multi-finger gesture ends with a liftoff of the concurrent multi-finger contacts occurring without more than a threshold amount of movement on the touch screen display includes a determination that the first multi-finger gesture is a three-finger, double-tap gesture.

57. The medium of claim 41, wherein detecting the first multi-finger gesture includes:

detecting a first touchdown of a respective number of contacts on the touch screen display, wherein the respective number of contacts is greater than one;

detecting a first liftoff of the respective number of contacts from the touch screen display; and

detecting a second touchdown of the respective number of contacts on the touch screen display.

58. The medium of claim 57, wherein:

the first multi-finger gesture includes detecting a second liftoff of the respective number of contacts;

the determination that the first multi-finger gesture ends with the liftoff of the concurrent multi-finger contacts occurring without more than the threshold amount of movement on the touch screen display includes a determination that the second liftoff of the respective number of contacts from the touch screen display was detected without more than the threshold amount of movement being detected; and

the determination that the first multi-finger gesture includes more than the threshold amount of movement on the touch screen display includes a determination that the threshold amount of movement was detected after detecting the second touchdown of the respective number of contacts on the touch screen display and before the second liftoff of the respective number of contacts from the touch screen display was detected.

59. The medium of claim 41, wherein the first multi-finger gesture includes movement towards a top of the touch screen display until the third magnification is reached.

60. The medium of claim 41, wherein the medium further stores instructions, which when executed by the accessible electronic device, cause the device to:

while displaying the first portion of the content in the user interface at the second magnification, detect a fourth multi-finger gesture on the touch screen display; and

in response to detecting the fourth multi-finger gesture on the touch screen display, wherein the fourth multi-finger gesture includes more than the threshold amount of movement on the touch screen display, further magnify the first portion of the content in the user interface to a sixth magnification, greater than the second magnification, on the touch screen display, wherein the sixth magnification is selected based on a magnitude of movement of the fourth multi-finger gesture.