Screenreader user interface

• US 10,466,883 B2
• Filed: 08/28/2015
• Issued: 11/05/2019
• Est. Priority Date: 03/02/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fleizach, Christopher, Seymour, Eric T., Everitt, Aaron
• Primary Examiner(s): Shih, Haoshian
• Application Number:
  US14/839,894
• Publication Number:
  US 20160259535A1
• Time in Patent Office: 1,530 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

The present disclosure relates to screenreader techniques and volume control techniques for electronic devices. In some embodiments, a device displays a plurality of user interface objects in an ordered progression. A rotation of a rotary input mechanism is detected. In response to the rotation of the rotary input mechanism, if a rotary screenreader navigation mode is activated, a visual highlight is displayed and an auditory output is produced. In some embodiments, a device has a volume setting. A gesture is detected, and a volume adjustment mode is activated. The gesture ends with a contact being maintained, and the volume setting is adjusted in accordance with detected movement of the contact.

Claims

1. A non-transitory computer-readable storage medium storing one or more programs comprising instructions, which when executed by an electronic device with a display, an audio output part, and a rotatable input mechanism, cause the electronic device to:

display, on the display, a plurality of user interface objects in an ordered progression;

display a visual highlight associated with a first user interface object of the plurality of user interface objects and produce auditory output associated with the first user interface object;

while displaying the visual highlight, detect rotation of the rotatable input mechanism in a first rotational direction; and

in response to detecting rotation of the rotatable input mechanism in the first rotational direction;

in accordance with a determination that a rotary navigation mode is activated, display a visual highlight associated with a second user interface object of the plurality of user interface objects and produce auditory output associated with the second user interface object, wherein the second user interface object follows the first user interface object in the ordered progression, and wherein a rate of navigation or a quantity of traversed objects in the ordered progression to select the second user interface object has a non-linear relationship to the rate of rotation or angular displacement of the detected rotation of the rotatable input mechanism, and

in accordance with a determination that the rotary navigation mode is not activated, maintain display of the visual highlight associated with the first user interface object without displaying a visual highlight associated with the second user interface object and without producing auditory output associated with the second user interface object.

2. The non-transitory computer-readable storage medium of claim 1, wherein the instructions further cause the electronic device to:

while displaying the visual highlight associated with the second user interface object, detect rotation of the rotatable input mechanism in a second rotational direction substantially opposite the first rotational direction;

in response to detecting rotation of the rotatable input mechanism in the second rotational direction;

in accordance with the determination that the rotary navigation mode is activated, display a visual highlight associated with one of the first user interface object and a third user interface object of the plurality of user interface objects and produce auditory output associated with one of the first user interface object and the third user interface object, wherein the third user interface object precedes the second user interface object in the ordered progression; and

in accordance with the determination that the rotary navigation mode is not activated, forgo displaying a visual highlight associated with either of the first or the third user interface objects and forgo producing auditory output associated with either of the first or the third user interface objects.

3. The non-transitory computer-readable storage medium of claim 2, wherein the second user interface object immediately follows the first user interface object in the ordered progression.

4. The non-transitory computer-readable storage medium of claim 3, wherein the third user interface object immediately precedes the second user interface object in the ordered progression.

5. The non-transitory computer-readable storage medium of claim 1,

wherein the instructions further cause the electronic device to:

detect a first touch input; and

in response to detecting the first touch input, activate the rotary navigation mode.

6. The non-transitory computer-readable storage medium of claim 1, wherein rotary navigation mode is a sub-mode of a screenreader mode.

7. The non-transitory computer-readable storage medium of claim 6, wherein the instructions further cause the electronic device to:

detect a depression input of the rotatable input mechanism;

in response to detecting the depression input of the rotatable input mechanism, activate the screenreader mode.

8. The non-transitory computer-readable storage medium of claim 3, wherein the instructions further cause the electronic device to:

while displaying a visual highlight associated with the first user interface object, detect a swipe input;

in response to detecting the swipe input;

if the swipe input is in a first predefined direction and comprises a first predefined number of contacts, display a visual highlight associated with the second user interface object and produce auditory output associated with the second user interface object; and

if the swipe input is in a second predefined direction that is substantially opposite the first predefined direction and comprises the first predefined number of contacts, display a visual highlight associated with one of the third user interface object and a fifth user interface object of the plurality of user interface objects and produce auditory output associated with one of the third user interface object and fifth user interface object, wherein one of the third user interface object and the fifth user interface object immediately precedes the first user interface object.

9. The non-transitory computer-readable storage medium of claim 8, wherein the first and second predefined directions are substantially horizontal with respect to the display of the electronic device.

10. The non-transitory computer-readable storage medium of claim 8, wherein the instructions further cause the electronic device to:

in response to detecting the swipe input;

if the swipe input is in a third predefined direction that is substantially orthogonal to the first predefined direction and comprises a second predefined number of contacts, produce auditory output associated with a first contextual action; and

if the swipe input is in a fourth predefined direction that is substantially opposite to the third predefined direction and comprises the second predefined number of contacts, produce auditory output associated with a second contextual action that precedes or follows the first contextual action in a second ordered progression.

11. The non-transitory computer-readable storage medium of claim 10, wherein the third and fourth predefined directions are substantially vertical with respect to the display of the electronic device.

12. The non-transitory computer-readable storage medium of claim 10, wherein the first and second contextual actions correspond to the first user interface object.

13. The non-transitory computer-readable storage medium of claim 10, wherein the first and second contextual actions correspond to a user interface that is displayed when the swipe input is detected.

14. The non-transitory computer-readable storage medium of claim 8, wherein the instructions further cause the electronic device to:

in response to detecting the swipe input, if the swipe input comprises a third predefined number of contacts, cease to display a first user interface and displaying a second user interface.

15. The non-transitory computer-readable storage medium of claim 1, wherein the instructions further cause the electronic device to:

detect a third touch input; and

in response to detecting the third touch input, activate a first function corresponding to a most recent auditory output.

16. The non-transitory computer-readable storage medium of claim 15, wherein the third touch input is detected at a location that does not correspond to a pre-selected user interface object or an activated function.

17. The non-transitory computer-readable storage medium of claim 1, wherein the rotatable input mechanism comprises a knob on a wrist-wearable device, the knob being rotatable about a single axis.

18. The non-transitory computer-readable storage medium of claim 1, wherein the rotatable input mechanism comprises a watch crown.

19. The non-transitory computer-readable storage medium of claim 1, wherein the rotatable input mechanism comprises a depressible button, depressible along an axis of rotation.

20. The non-transitory computer-readable storage medium of claim 1, wherein the display is smaller than 3 inches by 3 inches.

21. A method, comprising:

at an electronic device having a display, an audio output part, and a rotatable input mechanism;

displaying, on the display, a plurality of user interface objects in an ordered progression;

displaying a visual highlight associated with a first user interface object of the plurality of interface objects and producing auditory output associated with the first user interface object;

detecting rotation of the rotatable input mechanism in a first rotational direction; and

in response to detecting rotation of the rotatable input mechanism in the first rotational direction;

in accordance with a determination that a rotary navigation mode is activated, displaying a visual highlight associated with a second user interface object of the plurality of user interface objects and producing auditory output associated with the second user interface object, wherein the second user interface object follows the first user interface object in the ordered progression, and wherein a rate of navigation or a quantity of traversed objects in the ordered progression to select the second user interface object has a non-linear relationship to the rate of rotation or angular displacement of the detected rotation of the rotatable input mechanism, and

in accordance with a determination that the rotary navigation mode is not activated, maintaining display of the visual highlight associated with the first user interface object without displaying a visual highlight associated with the second user interface object and producing auditory output associated with the second user interface object.

23. The method of claim 21, further comprising:

while displaying the visual highlight associated with the second user interface object, detecting rotation of the rotatable input mechanism in a second rotational direction substantially opposite the first rotational direction;

in response to detecting rotation of the rotatable input mechanism in the second rotational direction;

in accordance with a determination that the rotary navigation mode is activated, displaying a visual highlight associated with one of the first user interface object and a third user interface object of the plurality of user interface objects and producing auditory output associated with one of the first user interface object and the third user interface object, wherein the third user interface object precedes the second user interface object in the ordered progression; and

in accordance with a determination that the rotary navigation mode is not activated, forgo displaying a visual highlight associated with either of the first or the third user interface objects and forgo producing auditory output associated with either of the first or the third user interface objects.

24. The method of claim 23, wherein the second user interface object immediately follows the first user interface object in the ordered progression.

25. The method of claim 24, wherein the third user interface object immediately precedes the second user interface object in the ordered progression.

26. The method of claim 21, further comprising:

detecting a first touch input; and

in response to detecting the first touch input, activating the rotary navigation mode.

27. The method of claim 21, wherein rotary navigation mode is a sub-mode of a screenreader mode.

28. The method of claim 27, further comprising:

detecting a depression input of the rotatable input mechanism;

in response to detecting the depression input of the rotatable input mechanism, activating the screenreader mode.

29. The method of claim 24, further comprising:

while displaying a visual highlight associated with the first user interface object, detect a swipe input;

in response to detecting the swipe input;

if the swipe input is in a first predefined direction and comprises a first predefined number of contacts, displaying a visual highlight associated with the second user interface object and producing auditory output associated with the second user interface object; and

if the swipe input is in a second predefined direction that is substantially opposite the first predefined direction and comprises the first predefined number of contacts, displaying a visual highlight associated with one of the third user interface object and a fifth user interface object of the plurality of user interface objects and producing auditory output associated with one of the third user interface object and fifth user interface object, wherein one of the third user interface object and the fifth user interface object immediately precedes the first user interface object.

30. The method of claim 29, wherein the first and second predefined directions are substantially horizontal with respect to the display of the electronic device.

31. The method of claim 29, further comprising:

in response to detecting the swipe input;

if the swipe input is in a third predefined direction that is substantially orthogonal to the first predefined direction and comprises a second predefined number of contacts, producing auditory output associated with a first contextual action; and

if the swipe input is in a fourth predefined direction that is substantially opposite to the third predefined direction and comprises the second predefined number of contacts, producing auditory output associated with a second contextual action that precedes or follows the first contextual action in a second ordered progression.

32. The method of claim 31, wherein the third and fourth predefined directions are substantially vertical with respect to the display of the electronic device.

33. The method of claim 31, wherein the first and second contextual actions correspond to the first user interface object.

34. The method of claim 31, wherein the first and second contextual actions correspond to a user interface that is displayed when the swipe input is detected.

35. The method of claim 29, further comprising:

in response to detecting the swipe input, if the swipe input comprises a third predefined number of contacts, ceasing to display a first user interface and displaying a second user interface.

36. The method of claim 21, further comprising:

detecting a third touch input; and

in response to detecting the third touch input, activating a first function corresponding to a most recent auditory output.

37. The method of claim 36, wherein the third touch input is detected at a location that does not correspond to a pre-selected user interface object or an activated function.

38. The method of claim 21, wherein the rotatable input mechanism comprises a knob on a wrist-wearable device, the knob being rotatable about a single axis.

39. The method of claim 21, wherein the rotatable input mechanism comprises a watch crown.

40. The method of claim 21, wherein the rotatable input mechanism comprises a depressible button, depressible along an axis of rotation.

41. The method of claim 21, wherein the display is smaller than 3 inches by 3 inches.

22. An electronic device comprising:

a display;

an audio output part;

a rotatable input mechanism;

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the electronic device to;

display, on the display, a plurality of user interface objects in an ordered progression;

display a visual highlight associated with a first user interface object of the plurality of interface objects and producing auditory output associated with the first user interface object;

detect rotation of the rotatable input mechanism in a first rotational direction; and

in response to detecting rotation of the rotatable input mechanism in the first rotational direction;

in accordance with a determination that a rotary navigation mode is activated, display a visual highlight associated with a second user interface object of the plurality of user interface objects and produce auditory output associated with the second user interface object, wherein the second user interface object follows the first user interface object in the ordered progression, and wherein a rate of navigation or a quantity of traversed objects in the ordered progression to select the second user interface object has a non-linear relationship to the rate of rotation or angular displacement of the detected rotation of the rotatable input mechanism,

in accordance with a determination that the rotary navigation mode is not activated, maintain display of the visual highlight associated with the first user interface object without displaying a visual highlight associated with the second user interface object and producing auditory output associated with the second user interface object.

42. The electronic device of claim 22, wherein the instructions further cause the electronic device to:

while displaying the visual highlight associated with the second user interface object, detect rotation of the rotatable input mechanism in a second rotational direction substantially opposite the first rotational direction;

in response to detecting rotation of the rotatable input mechanism in the second rotational direction;

in accordance with a determination that the rotary navigation mode is activated, display a visual highlight associated with one of the first user interface object and a third user interface object of the plurality of user interface objects and produce auditory output associated with one of the first user interface object and the third user interface object, wherein the third user interface object precedes the second user interface object in the ordered progression; and

in accordance with a determination that the rotary navigation mode is not activated, forgo displaying a visual highlight associated with either of the first or the third user interface objects and forgo producing auditory output associated with either of the first or the third user interface objects.

43. The electronic device of claim 22, wherein the second user interface object immediately follows the first user interface object in the ordered progression.

44. The electronic device of claim 43, wherein the third user interface object immediately precedes the second user interface object in the ordered progression.

45. The electronic device of claim 22, wherein the instructions further cause the electronic device to:

detect a first touch input; and

in response to detecting the first touch input, activate the rotary navigation mode.

46. The electronic device of claim 22, wherein rotary navigation mode is a sub-mode of a screenreader mode.

47. The electronic device of claim 46, wherein the instructions further cause the electronic device to:

detect a depression input of the rotatable input mechanism;

in response to detecting the depression input of the rotatable input mechanism, activate screenreader mode.

48. The electronic device of claim 43, wherein the instructions further cause the electronic device to:

while displaying a visual highlight associated with the first user interface object, detect a swipe input;

in response to detecting the swipe input;

if the swipe input is in a first predefined direction and comprises a first predefined number of contacts, display a visual highlight associated with the second user interface object and produce auditory output associated with the second user interface object; and

if the swipe input is in a second predefined direction that is substantially opposite the first predefined direction and comprises the first predefined number of contacts, display a visual highlight associated with one of the third user interface object and a fifth user interface object of the plurality of user interface objects and produce auditory output associated with one of the third user interface object and fifth user interface object, wherein one of the third user interface object and the fifth user interface object immediately precedes the first user interface object.

49. The electronic device of claim 48, wherein the first and second predefined directions are substantially horizontal with respect to the display of the electronic device.

50. The electronic device of claim 48, wherein the instructions further cause the electronic device to:

in response to detecting the swipe input;

if the swipe input is in a third predefined direction that is substantially orthogonal to the first predefined direction and comprises a second predefined number of contacts, produce auditory output associated with a first contextual action; and

if the swipe input is in a fourth predefined direction that is substantially opposite to the third predefined direction and comprises the second predefined number of contacts, produce auditory output associated with a second contextual action that precedes or follows the first contextual action in a second ordered progression.

51. The electronic device of claim 50, wherein the third and fourth predefined directions are substantially vertical with respect to the display of the electronic device.

52. The electronic device of claim 50, wherein the first and second contextual actions correspond to the first user interface object.

53. The electronic device of claim 50, wherein the first and second contextual actions correspond to a user interface that is displayed when the swipe input is detected.

54. The electronic device of claim 48, wherein the instructions further cause the electronic device to:

in response to detecting the swipe input, if the swipe input comprises a third predefined number of contacts, cease to display a first user interface and displaying a second user interface.

55. The electronic device of claim 22, wherein the instructions further cause the electronic device to:

detect a third touch input; and

in response to detecting the third touch input, activate a first function corresponding to a most recent auditory output.

56. The electronic device of claim 55, wherein the third touch input is detected at a location that does not correspond to a pre-selected user interface object or an activated function.

57. The electronic device of claim 22, wherein the rotatable input mechanism comprises a knob on a wrist-wearable device, the knob being rotatable about a single axis.

58. The electronic device of claim 22, wherein the rotatable input mechanism comprises a watch crown.

59. The electronic device of claim 22, wherein the rotatable input mechanism comprises a depressible button, depressible along an axis of rotation.

60. The electronic device of claim 22, wherein the display is smaller than 3 inches by 3 inches.