Accelerated task performance

• US 10,496,705 B1
• Filed: 09/28/2018
• Issued: 12/03/2019
• Est. Priority Date: 06/03/2018
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Irani, Cyrus D., Alabi, Oluwatomiwa, Albert, Kellie, Kawashima, Ieyuki, Lemay, Stephen O.
• Primary Examiner(s): Casanova, Jorge A
• Application Number:
  US16/146,963
• Publication Number:
  US 20190370292A1
• Time in Patent Office: 431 Days
• CPC Class Codes: G06F 16/90328 using search space presentation or visualization, e.g. category or range presentation and selection
• CPC Class Codes: G06F 16/90332 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/18 Commands or executable codes
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72454 : according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/22 : including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device including a display and one or more input devices, displaying, on the display, a user interface including a suggestion affordance associated with a task, detecting, via the one or more input devices, a first user input corresponding to a selection of the suggestion affordance, in response to detecting the first user input: in accordance with a determination that the task is a task of a first type, performing the task, and in accordance with a determination that the task is a task of a second type different than the first type, displaying a confirmation interface including a confirmation affordance.

Claims

1. An electronic device, comprising:

one or more processors;

a memory;

one or more input devices; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the display, a user interface including a suggestion affordance associated with a task, wherein the task associated with the suggestion affordance is based on at least one of a plurality of contextual characteristics associated with the electronic device;

detecting, via the one or more input devices, a first user input corresponding to a selection of the suggestion affordance; and

in response to detecting the first user input corresponding to the selection of the suggestion affordance associated with the task;

determining whether the task is of a first type or of a second type different than the first type;

in accordance with the determination that the task is the task of the first type, performing the task; and

in accordance with the determination that the task is the task of a second type, displaying a confirmation interface including a confirmation affordance.

2. The electronic device of claim 1, wherein displaying, on the display, a user interface including a suggestion affordance associated with a task includes:

in accordance with the task being a task of the first type, displaying the suggestion affordance with a glyph; and

in accordance with the task being a task of the second type, displaying the suggestion affordance without a glyph.

3. The electronic device of claim 1, wherein displaying, on the display, a user interface including a suggestion affordance associated with a task includes:

in accordance with a determination that the task corresponds to a first set of tasks, displaying the suggestion affordance with a glyph of a first type; and

in accordance with a determination that the task corresponds to a second set of tasks different than the first set of tasks, displaying the suggestion affordance with a glyph of a second type different than the first type; and

in accordance with a determination that the task does not correspond to the first set of tasks and does not correspond to the second set of tasks, displaying the suggestion affordance without a glyph.

4. The electronic device of claim 1, the one or more programs further including instructions for:

while displaying the confirmation interface;

detecting a second user input corresponding to a selection of the confirmation affordance; and

in response to detecting the second user input, performing the task.

5. The electronic device of claim 1, wherein the confirmation interface includes an application affordance, the one or more programs further including instructions for:

detecting a third user input corresponding to a selection of the application affordance; and

in response to detecting the third user input, executing an application associated with the task.

6. The electronic device of claim 5, wherein:

the suggestion affordance includes a visual indication of a parameter affecting performance of the task; and

executing the application associated with the task includes preloading the application with the parameter.

7. The electronic device of claim 1, wherein the confirmation interface includes a cancel affordance, the one or more programs further including instructions for:

detecting a fourth user input corresponding to a selection of the cancel affordance; and

in response to detecting the fourth user input, forgoing performing the task.

8. The electronic device of claim 1, wherein:

the user interface further includes a notification; and

the suggestion affordance is displayed in a first manner and the notification is displayed in a second manner different than the first manner.

9. The electronic device of claim 1, wherein the first user input is an input of a first type, the one or more programs further including instructions for:

while displaying the user interface, detecting a user input of a second type corresponding to a selection of the suggestion affordance, wherein the second type is different than the first type; and

in response to detecting the user input of the second type, displaying the confirmation interface.

10. The electronic device of claim 1, the one or more programs further including instructions for:

determining whether the task is a task of a first type.

11. The electronic device of claim 10, wherein determining whether the task is a task of a first type includes determining whether one or more parameters associated with the task are valid.

12. The electronic device of claim 1, wherein performing the task includes causing the task to be performed by another electronic device.

13. The electronic device of claim 1, wherein the user interface is a lock screen user interface, a search user interface, or a digital assistant user interface.

14. The electronic device of claim 1, the one or more programs further including instructions for:

determining a first set of candidate tasks; and

identifying the task from the first set of candidate tasks,

wherein the task is identified based on a determination that a context of the device satisfies task suggestion criteria.

15. The electronic device of claim 1, the one or more programs further including instructions for:

prior to displaying, on the display, the user interface;

determining, based on a first context of the electronic device, whether context criteria has been satisfied;

in accordance with a determination that the context criteria have been satisfied, determining a first set of candidate tasks;

determining, based on a second context of the electronic device, whether heuristic criteria have been satisfied;

in accordance with a determination that the heuristic criteria have been satisfied;

determining a second set of candidate tasks different from the first set of candidate tasks; and

identifying the task from the second set of candidate tasks;

in accordance with a determination that the heuristic criteria have not been satisfied and the context criteria have been satisfied;

identifying the task from the first set of candidate tasks; and

in accordance with a determination that the heuristic criteria have not been satisfied and the context criteria have not been satisfied;

forgoing determining the first set of candidate tasks and

forgoing determining the second set of candidate tasks.

16. The electronic device of claim 1, wherein displaying a user interface includes:

in accordance with a determination that the electronic device is in a locked state, displaying the suggestion affordance in a first visual state; and

in accordance with a determination that the electronic device is not in a locked state, displaying the suggestion affordance in a second visual state different than the first visual state.

17. A method, comprising:

at an electronic device with a display and one or more input devices;

displaying, on the display, a user interface including a suggestion affordance associated with a task, wherein the task associated with the suggestion affordance is based on at least one of a plurality of contextual characteristics associated with the electronic device;

detecting, via the one or more input devices, a first user input corresponding to a selection of the suggestion affordance;

in response to detecting the first user input corresponding to the selection of the suggestion affordance associated with the task;

determining whether the task is of a first type or of a second type different than the first type;

in accordance with the determination that the task is the task of the first type, performing the task; and

in accordance with the determination that the task is the task of a second type, displaying a confirmation interface including a confirmation affordance.

18. The method of claim 17, wherein displaying, on the display, a user interface including a suggestion affordance associated with a task includes:

in accordance with the task being a task of the first type, displaying the suggestion affordance with a glyph; and

in accordance with the task being a task of the second type, displaying the suggestion affordance without a glyph.

19. The method of claim 17, wherein displaying, on the display, a user interface including a suggestion affordance associated with a task includes:

in accordance with a determination that the task corresponds to a first set of tasks, displaying the suggestion affordance with a glyph of a first type; and

in accordance with a determination that the task corresponds to a second set of tasks different than the first set of tasks, displaying the suggestion affordance with a glyph of a second type different than the first type; and

in accordance with a determination that the task does not correspond to the first set of tasks and does not correspond to the second set of tasks, displaying the suggestion affordance without a glyph.

20. The method of claim 17, further comprising:

while displaying the confirmation interface;

detecting a second user input corresponding to a selection of the confirmation affordance; and

in response to detecting the second user input, performing the task.

21. The method of claim 17, wherein the confirmation interface includes an application affordance, further comprising:

detecting a third user input corresponding to a selection of the application affordance; and

in response to detecting the third user input, executing an application associated with the task.

22. The method of claim 21, wherein:

the suggestion affordance includes a visual indication of a parameter affecting performance of the task; and

executing the application associated with the task includes preloading the application with the parameter.

23. The method of claim 17, wherein the confirmation interface includes a cancel affordance, further comprising:

detecting a fourth user input corresponding to a selection of the cancel affordance; and

in response to detecting the fourth user input, forgoing performing the task.

24. The method of claim 17, wherein:

the user interface further includes a notification; and

the suggestion affordance is displayed in a first manner and the notification is displayed in a second manner different than the first manner.

25. The method of claim 17, wherein the first user input is an input of a first type, further comprising:

while displaying the user interface, detecting a user input of a second type corresponding to a selection of the suggestion affordance, wherein the second type is different than the first type; and

in response to detecting the user input of the second type, displaying the confirmation interface.

26. The method of claim 17, further comprising:

determining whether the task is a task of a first type.

27. The method of claim 26, wherein determining whether the task is a task of a first type includes determining whether one or more parameters associated with the task are valid.

28. The method of claim 17, wherein performing the task includes causing the task to be performed by another electronic device.

29. The method of claim 17, wherein the user interface is a lock screen user interface, a search user interface, or a digital assistant user interface.

30. The method of claim 17, further comprising:

determining a first set of candidate tasks; and

identifying the task from the first set of candidate tasks,

wherein the task is identified based on a determination that a context of the device satisfies task suggestion criteria.

31. The method of claim 17, further comprising:

prior to displaying, on the display. the user interface;

determining, based on a first context of the electronic device, whether context criteria has been satisfied;

in accordance with a determination that the context criteria have been satisfied, determining a first set of candidate tasks;

determining, based on a second context of the electronic device, whether heuristic criteria have been satisfied;

in accordance with a determination that the heuristic criteria have been satisfied;

determining a second set of candidate tasks different from the first set of candidate tasks; and

identifying the task from the second set of candidate tasks;

in accordance with a determination that the heuristic criteria have not been satisfied and the context criteria have been satisfied;

identifying the task from the first set of candidate tasks; and

in accordance with a determination that the heuristic criteria have not been satisfied and the context criteria have not been satisfied;

forgoing determining the first set of candidate tasks and

forgoing determining the second set of candidate tasks.

32. The method of claim 17, wherein displaying a user interface includes:

in accordance with a determination that the electronic device is in a locked state, displaying the suggestion affordance in a first visual state; and

in accordance with a determination that the electronic device is not in a locked state, displaying the suggestion affordance in a second visual state different than the first visual state.

33. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display and one or more input devices, the one or more programs including instructions for:

displaying, on the display, a user interface including a suggestion affordance associated with a task, wherein the task associated with the suggestion affordance is based on at least one of a plurality of contextual characteristics associated with the electronic device;

detecting, via the one or more input devices, a first user input corresponding to a selection of the suggestion affordance; and

in response to detecting the first user input corresponding to the selection of the suggestion affordance associated with the task;

determining whether the task is of a first type or of a second type different than the first type;

in accordance with the determination that the task is the task of a first type, performing the task; and

in accordance with the determination that the task is the task of a second type, displaying a confirmation interface including a confirmation affordance.

34. The non-transitory computer-readable storage medium of claim 33, wherein displaying, on the display, a user interface including a suggestion affordance associated with a task includes:

in accordance with the task being a task of the first type, displaying the suggestion affordance with a glyph; and

in accordance with the task being a task of the second type, displaying the suggestion affordance without a glyph.

35. The non-transitory computer-readable storage medium of claim 33, wherein displaying, on the display, a user interface including a suggestion affordance associated with a task includes:

in accordance with a determination that the task corresponds to a first set of tasks, displaying the suggestion affordance with a glyph of a first type; and

in accordance with a determination that the task corresponds to a second set of tasks different than the first set of tasks, displaying the suggestion affordance with a glyph of a second type different than the first type; and

in accordance with a determination that the task does not correspond to the first set of tasks and does not correspond to the second set of tasks, displaying the suggestion affordance without a glyph.

36. The non-transitory computer-readable storage medium of claim 33, the one or more programs further including instructions for:

while displaying the confirmation interface;

detecting a second user input corresponding to a selection of the confirmation affordance; and

in response to detecting the second user input, performing the task.

37. The non-transitory computer-readable storage medium of claim 33, wherein the confirmation interface includes an application affordance, the one or more programs further including instructions for:

detecting a third user input corresponding to a selection of the application affordance; and

in response to detecting the third user input, executing an application associated with the task.

38. The non-transitory computer-readable storage medium of claim 37, wherein:

the suggestion affordance includes a visual indication of a parameter affecting performance of the task; and

executing the application associated with the task includes preloading the application with the parameter.

39. The non-transitory computer-readable storage medium of claim 33, wherein the confirmation interface includes a cancel affordance, the one or more programs further including instructions for:

detecting a fourth user input corresponding to a selection of the cancel affordance; and

in response to detecting the fourth user input, forgoing performing the task.

40. The non-transitory computer-readable storage medium of claim 33, wherein:

the user interface further includes a notification; and

the suggestion affordance is displayed in a first manner and the notification is displayed in a second manner different than the first manner.

41. The non-transitory computer-readable storage medium of claim 33, wherein the first user input is an input of a first type, the one or more programs further including instructions for:

while displaying the user interface, detecting a user input of a second type corresponding to a selection of the suggestion affordance, wherein the second type is different than the first type; and

in response to detecting the user input of the second type, displaying the confirmation interface.

42. The non-transitory computer-readable storage medium of claim 33, the one or more programs further including instructions for:

determining whether the task is a task of a first type.

43. The non-transitory computer-readable storage medium of claim 42, wherein determining whether the task is a task of a first type includes determining whether one or more parameters associated with the task are valid.

44. The non-transitory computer-readable storage medium of claim 33, wherein performing the task includes causing the task to he performed by another electronic device.

45. The non-transitory computer-readable medium of claim 33, wherein the user interface is a lock screen user interface, a search user interface, or a digital assistant user interface.

46. The non-transitory computer-readable storage medium of claim 33, the one or more programs further including instructions for:

determining a first set of candidate tasks; and

identifying the task from the first set of candidate tasks,

wherein the task is identified based on a determination that a context of the device satisfies task suggestion criteria.

47. The non-transitory computer-readable storage medium of claim 33, the one or more programs further including instructions for:

prior to displaying, on the display, the user interface;

determining, based on a first context of the electronic device, whether context criteria has been satisfied;

in accordance with a determination that the context criteria have been satisfied, determining a first set of candidate tasks;

determining, based on a second context of the electronic device, whether heuristic criteria have been satisfied;

in accordance with a determination that the heuristic criteria have been satisfied;

determining a second set of candidate tasks different from the first set of candidate tasks; and

identifying the task from the second set of candidate tasks;

in accordance with a determination that the heuristic criteria have not been satisfied and the context criteria have been satisfied;

identifying the task from the first set of candidate tasks; and

in accordance with a determination that the heuristic criteria have not been satisfied and the context criteria have not been satisfied;

forgoing determining the first set of candidate tasks and

forgoing determining the second set of candidate tasks.

48. The non-transitory computer-readable storage medium of claim 33, wherein displaying a user interface includes:

in accordance with a determination that the electronic device is in a locked state, displaying the suggestion affordance in a first visual state; and

in accordance with a determination that the electronic device is not in a locked state, displaying the suggestion affordance in a second visual state different than the first visual state.