Semantic framework for variable haptic output

• US 10,089,840 B2
• Filed: 09/29/2015
• Issued: 10/02/2018
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Moussette, Camille, Butcher, Gary I., Verweij, Hugo D., Ive, Jonathan
• Primary Examiner(s): Wang, Jack K
• Application Number:
  US14/869,835
• Publication Number:
  US 20160062466A1
• Time in Patent Office: 1,099 Days
• Field of Search: 3404071, 3404072, 705 39, 345173
• CPC Class Codes: G06F 11/0745 in an input/output transactions management context input/output processing in general G06F13/00
• CPC Class Codes: G06F 11/0763 by bit configuration check, e.g. of formats or tags
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: G08B 7/06 using electric transmission , e.g. involving audible and visible signalling through the use of sound and light sources
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 19/04 the ringing-current being generated at the substations

Abstract

Methods and apparatus organize a plurality of haptic output variations into a cohesive semantic framework that uses various information about the alert condition and trigger, application context, and other conditions to provide a system of haptic outputs that share characteristics between related events. In some embodiments, an event class or application class provides the basis for a corresponding haptic output. In some embodiments, whether an alert-salience setting is on provides the basis for adding an increased salience haptic output to the standard haptic output for the alert. In some embodiments, consistent haptics provide for branding of the associated application class, application, and/or context.

Claims

1. A processor-implemented method performed on a computing device, the method comprising:

detecting occurrence of a first alert condition;

responsive to detecting the occurrence of the first alert condition, determining that the first alert condition is in a first class of alert condition in a plurality of predefined classes of alert condition, wherein the first class of alert condition includes a plurality of alert conditions, and providing a first output that includes a first haptic component and a first audio component, wherein providing the first output includes selecting the first haptic component based on the determination that the first alert condition is in the first class of alert condition;

after providing the first output, detecting occurrence of a second alert condition; and

responsive to detecting the occurrence of the second alert condition;

determining a class of the second alert condition from among the plurality of predefined classes of alert condition; and

providing a second output that includes a second haptic component and a second audio component,

wherein;

providing the second output includes selecting the second haptic component based on the determined class of the second alert condition;

when the first alert condition and the second alert condition are different alert conditions that are in the same first class of alert condition, the first haptic component is the same as the second haptic component and the first audio component is different from the second audio component; and

when the first alert condition and the second alert condition are different alert conditions and the second alert condition is in a second class of alert condition that includes a plurality of alert conditions, wherein the second class of alert condition is different from the first class of alert condition, the first haptic component is different from the second haptic component and the first audio component is different from the second audio component.

2. The method of claim 1, wherein the first alert condition and the second alert condition are in the same first class of alert condition, wherein the first class is associated with alert conditions for an application.

3. The method of claim 1, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class associated with a category of applications.

4. The method of claim 1, wherein the first alert condition and the second alert condition are associated with two different applications, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class corresponding to functions in a predefined class of functions within the two different applications.

5. The method of claim 1, wherein the first alert condition and the second alert condition are associated with a same application, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class corresponding to functions in a predefined class of functions.

6. The method of claim 1, wherein the plurality of predefined classes of alert conditions include distinct classes of alert conditions for two or more of:

messages, activity alerts, media playback alerts, virtual assistant alerts, system alerts, scheduling reminders, and internet browser updates.

7. The method of claim 1, wherein when the first alert condition and the second alert condition correspond to separate instances of the same alert condition, the first output is identical to the second output.

8. The method of claim 1, wherein:

the first alert condition and the second alert condition correspond to a same alert condition; and

the first output is accompanied by a first additional component that is different from a second additional component that accompanies the second output.

9. The method of claim 8, wherein:

the first additional component accompanying the first output provides information describing a first event that triggered the first alert condition; and

the second additional component accompanying the second output provides information describing a second event that triggered the second alert condition.

10. The method of claim 1, further comprising:

after providing the second output, detecting occurrence of a third alert condition; and

responsive to detecting the occurrence of the third alert condition;

determining a class of the third alert condition from among the plurality of predefined classes of alert condition; and

providing a third output that includes a third haptic component and a third audio component,

wherein;

providing the third output includes selecting the third haptic component based on the determined class of the third alert condition;

when the first alert condition, the second alert condition, and the third alert condition are different alert conditions that are in the same first class of alert condition, the first haptic component, the second haptic component, and the third haptic component are the same and the first audio component, the second audio component, and the third audio component are different; and

when the third alert condition is in a different class of alert condition from the first alert condition and the second alert condition, the third haptic component is different from both the first haptic component and the second haptic component and the third audio component is different from both the first audio component and the second audio component.

11. The method of claim 1, wherein:

the computing device includes a touch-sensitive surface; and

the first haptic component of the first output and the second haptic component of the second output are provided via the touch-sensitive surface of the computing device.

12. A non-transitory computer readable storage medium storing executable code, the code when executed causes a processor at a computing device with a tactile output generator to perform the following steps:

detecting occurrence of a first alert condition;

responsive to detecting the occurrence of the first alert condition, determining that the first alert condition is in a first class of alert condition in a plurality of predefined classes of alert condition, wherein the first class of alert condition includes a plurality of alert conditions, and providing a first output that includes a first haptic component and a first audio component, wherein providing the first output includes selecting the first haptic component based on the determination that the first alert condition is in the first class of alert condition;

after providing the first output, detecting occurrence of a second alert condition; and

responsive to detecting the occurrence of the second alert condition;

determining a class of the second alert condition from among the plurality of predefined classes of alert condition; and

providing a second output that includes a second haptic component and a second audio component,

wherein;

providing the second output includes selecting the second haptic component based on the determined class of the second alert condition;

when the first alert condition and the second alert condition are different alert conditions that are in the same first class of alert condition, the first haptic component is the same as the second haptic component and the first audio component is different from the second audio component; and

when the first alert condition and the second alert condition are different alert conditions and the second alert condition is in a second class of alert condition that includes a plurality of alert conditions, wherein the second class of alert condition is different from the first class of alert condition, the first haptic component is different from the second haptic component and the first audio component is different from the second audio component.

13. The non-transitory computer readable storage medium of claim 12, wherein the first alert condition and the second alert condition are in the same first class of alert condition, wherein the first class is associated with alert conditions for an application.

14. The non-transitory computer readable storage medium of claim 12, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class associated with a category of applications.

15. The non-transitory computer readable storage medium of claim 12, wherein the first alert condition and the second alert condition are associated with two different applications, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class corresponding to functions in a predefined class of functions within the two different applications.

16. The non-transitory computer readable storage medium of claim 12, wherein the first alert condition and the second alert condition are associated with a same application, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class corresponding to functions in a predefined class of functions.

17. The non-transitory computer readable storage medium of claim 12, wherein the plurality of predefined classes of alert conditions include distinct classes of alert conditions for two or more of:

messages, activity alerts, media playback alerts, virtual assistant alerts, system alerts, scheduling reminders, and internet browser updates.

18. The non-transitory computer readable storage medium of claim 12, wherein when the first alert condition and the second alert condition correspond to separate instances of the same alert condition, the first output is identical to the second output.

19. The non-transitory computer readable storage medium of claim 12, wherein:

the first alert condition and the second alert condition correspond to a same alert condition; and

the first output is accompanied by a first additional component that is different from a second additional component that accompanies the second output.

20. The non-transitory computer readable storage medium of claim 19, wherein:

the first additional component accompanying the first output provides information describing a first event that triggered the first alert condition; and

the second additional component accompanying the second output provides information describing a second event that triggered the second alert condition.

21. The non-transitory computer readable storage medium of claim 12, wherein the code when executed causes the processor to further perform the following steps:

after providing the second output, detecting occurrence of a third alert condition; and

responsive to detecting the occurrence of the third alert condition;

determining a class of the third alert condition from among the plurality of predefined classes of alert condition; and

providing a third output that includes a third haptic component and a third audio component,

wherein;

providing the third output includes selecting the third haptic component based on the determined class of the third alert condition;

when the first alert condition, the second alert condition, and the third alert condition are different alert conditions that are in the same first class of alert condition, the first haptic component, the second haptic component, and the third haptic component are the same and the first audio component, the second audio component, and the third audio component are different; and

when the third alert condition is in a different class of alert condition from the first alert condition and the second alert condition, the third haptic component is different from both the first haptic component and the second haptic component and the third audio component is different from both the first audio component and the second audio component.

22. The non-transitory computer readable storage medium of claim 12, wherein:

the computing device includes a touch-sensitive surface; and

the first haptic component of the first output and the second haptic component of the second output are provided via the touch-sensitive surface of the computing device.

23. A device comprising:

a tactile output generator;

a touch-sensitive surface; and

memory storing one or more programs that include instructions for;

detecting occurrence of a first alert condition;

responsive to detecting the occurrence of the first alert condition, determining that the first alert condition is in a first class of alert condition in a plurality of predefined classes of alert condition, wherein the first class of alert condition includes a plurality of alert conditions, and providing a first output that includes a first haptic component and a first audio component, wherein providing the first output includes selecting the first haptic component based on the determination that the first alert condition is in the first class of alert condition;

after providing the first output, detecting occurrence of a second alert condition; and

responsive to detecting the occurrence of the second alert condition;

determining a class of the second alert condition from among the plurality of predefined classes of alert condition; and

providing a second output that includes a second haptic component and a second audio component,

wherein;

providing the second output includes selecting the second haptic component based on the determined class of the second alert condition;

when the first alert condition and the second alert condition are different alert conditions that are in the same first class of alert condition, the first haptic component is the same as the second haptic component and the first audio component is different from the second audio component; and

when the first alert condition and the second alert condition are different alert conditions and the second alert condition is in a second class of alert condition that includes a plurality of alert conditions, wherein the second class of alert condition is different from the first class of alert condition, the first haptic component is different from the second haptic component and the first audio component is different from the second audio component.

24. The device of claim 23, wherein the first alert condition and the second alert condition are associated with two different applications, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class corresponding to functions in a predefined class of functions within the two different applications.

25. The device of claim 23, wherein the first alert condition and the second alert condition are associated with a same application, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class corresponding to functions in a predefined class of functions.

26. The device of claim 23, wherein the first alert condition and the second alert condition are in the same first class of alert condition, wherein the first class is associated with alert conditions for an application.

27. The device of claim 23, wherein the first alert condition and the second alert condition are in the same first class of alert condition, the first class associated with a category of applications.

28. The device of claim 23, wherein the plurality of predefined classes of alert conditions include distinct classes of alert conditions for two or more of:

messages, activity alerts, media playback alerts, virtual assistant alerts, system alerts, scheduling reminders, and internet browser updates.

29. The device of claim 23, wherein when the first alert condition and the second alert condition correspond to separate instances of the same alert condition, the first output is identical to the second output.

30. The device of claim 23, wherein:

the first alert condition and the second alert condition correspond to a same alert condition; and

the first output is accompanied by a first additional component that is different from a second additional component that accompanies the second output.

31. The device of claim 30, wherein:

the first additional component accompanying the first output provides information describing a first event that triggered the first alert condition; and

the second additional component accompanying the second output provides information describing a second event that triggered the second alert condition.

32. The device of claim 23, wherein the one or more programs include instructions for:

after providing the second output, detecting occurrence of a third alert condition; and

responsive to detecting the occurrence of the third alert condition;

determining a class of the third alert condition from among the plurality of predefined classes of alert condition; and

providing a third output that includes a third haptic component and a third audio component,

wherein;

providing the third output includes selecting the third haptic component based on the determined class of the third alert condition;

when the first alert condition, the second alert condition, and the third alert condition are different alert conditions that are in the same first class of alert condition, the first haptic component, the second haptic component, and the third haptic component are the same and the first audio component, the second audio component, and the third audio component are different; and

when the third alert condition is in a different class of alert condition from the first alert condition and the second alert condition, the third haptic component is different from both the first haptic component and the second haptic component and the third audio component is different from both the first audio component and the second audio component.

33. The device of claim 23, wherein:

the first haptic component of the first output and the second haptic component of the second output are provided via the touch-sensitive surface of the device.