Semantic framework for variable haptic output

• US 9,830,784 B2
• Filed: 09/29/2015
• Issued: 11/28/2017
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Moussette, Camille, Butcher, Gary I., Verweij, Hugo D., Ive, Jonathan
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Foxx, Chico A
• Application Number:
  US14/869,837
• Publication Number:
  US 20160063828A1
• Time in Patent Office: 791 Days
• Field of Search: None
• CPC Class Codes: G06F 11/0745 in an input/output transactions management context input/output processing in general G06F13/00
• CPC Class Codes: G06F 11/0763 by bit configuration check, e.g. of formats or tags
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: G08B 7/06 using electric transmission , e.g. involving audible and visible signalling through the use of sound and light sources
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 19/04 the ringing-current being generated at the substations

Abstract

Methods and apparatus organize a plurality of haptic output variations into a cohesive semantic framework that uses various information about the alert condition and trigger, application context, and other conditions to provide a system of haptic outputs that share characteristics between related events. In some embodiments, an event class or application class provides the basis for a corresponding haptic output. In some embodiments, whether an alert-salience setting is on provides the basis for adding an increased salience haptic output to the standard haptic output for the alert. In some embodiments, consistent haptics provide for branding of the associated application class, application, and/or context.

Claims

1. A method, comprising:

at an electronic device with one or more haptic output devices and one or more audio output devices;

detecting occurrence of a plurality of conditions in a plurality of software applications, wherein the electronic device is configured to;

for conditions of a same type, generate respective alerts that include same haptic components that indicate that the conditions are of the same type, and for conditions of different types, generate respective alerts that include different respective haptic components that indicate that the conditions are of different types, regardless of respective software applications in the plurality of software applications in which the conditions in the plurality of conditions were detected;

for conditions detected in a same software application in the plurality of software applications, generate respective alerts that include same audio components that indicate that the conditions occurred in the same software application, and for conditions detected in different software applications in the plurality of software applications, generate respective alerts that include different audio components that indicate that the conditions occurred in different software applications, regardless of respective types of the conditions;

wherein detecting the occurrence of the plurality of conditions in the plurality of software applications includes;

detecting occurrence of a first condition of a first type in a first software application at the electronic device, wherein the first condition of the first type indicates failure of an operation requested by a user to occur;

in response to detecting the occurrence of the first condition in the first software application, generating a first alert corresponding to the first condition that includes;

a first haptic component that indicates that the first condition of the first type has occurred; and

a first audio component that corresponds to the first software application;

detecting occurrence at the electronic device of the first condition of the first type in a second software application that is different from the first software application;

in response to detecting the occurrence of the first condition in the second software application, generating a second alert corresponding to the first condition that includes;

the first haptic component that indicates that the first condition of the first type has occurred; and

a second audio component, different from the first audio component, the second audio component corresponding to the second software application;

detecting occurrence at the electronic device of a second condition of a second type in the first software application, the second type different than the first type; and

in response to detecting the occurrence of the second condition in the first software application, generating a third alert corresponding to the second condition that includes;

a second haptic component that indicates that the second condition of the second type has occurred, the second haptic component different than the first haptic component; and

the first audio component corresponding to the first software application.

2. The method of claim 1, wherein detecting the occurrence of the plurality of conditions in the plurality of software applications further comprises:

detecting the occurrence of the first condition at the electronic device in a third software application different from the first and second software applications, wherein the first condition indicates failure of an operation in the third software application requested by the user to occur;

in response to detecting the occurrence of the first condition at the electronic device in the third software application, generating a fourth alert corresponding to the first condition in the third software application that includes;

the first haptic component that indicates that the first condition of the first type has occurred; and

a third audio component, different from the first audio component and the second audio component, the third audio component corresponding to the third software application.

3. The method of claim 1, wherein:

the second haptic component in the third alert indicates that an operation in the first software application requested by a user has successfully occurred.

4. The method of claim 1, wherein:

the first audio component is generated based on an audio waveform that is designated for use by the first software application; and

the second audio component is generated based on an audio waveform that is designated for use by the second software application.

5. The method of claim 1, wherein:

the first audio component is generated based on an audio waveform that is designated for use by software applications in a first class of software applications; and

the second audio component is generated based on an audio waveform that is designated for use by software applications in a second class of software applications that is different from the first class of software applications.

6. The method of claim 1, wherein:

the second condition indicates success of a requested operation, and the second haptic component includes a series of haptic outputs that are aligned with features in the first audio component; and

the first haptic component is unaligned with features in the first audio component.

7. The method of claim 1, including:

detecting occurrence at the electronic device of the second condition of the second type in the second software application; and

in response to detecting the occurrence of the second condition in the second software application, generating a fifth alert corresponding to the second condition that includes;

the second haptic component that indicates that the second condition of the second type has occurred; and

the second audio component that corresponds to the second software application;

wherein;

the second condition indicates success of a requested operation, and the second haptic component includes a series of haptic outputs that are aligned with features in the second audio component; and

the first haptic component is unaligned with features in the second audio component.

8. The method of claim 1, wherein:

the electronic device has a touch-sensitive display; and

the first haptic component and the second haptic component are provided via the touch-sensitive display on the electronic device.

9. A non-transitory computer readable storage medium storing executable code, the code when executed causes a processor at a computing device with one or more haptic output devices and one or more audio output devices to perform the following steps:

detecting occurrence of a plurality of conditions in a plurality of software applications, wherein the computing device is configured to;

for conditions of a same type, generate respective alerts that include same haptic components that indicate that the conditions are of the same type, and for conditions of different types, generate respective alerts that include different respective haptic components that indicate that the conditions are of different types, regardless of respective software applications in the plurality of software applications in which the conditions in the plurality of conditions were detected;

for conditions detected in a same software application in the plurality of software applications, generate respective alerts that include same audio components that indicate that the conditions occurred in the same software application, and for conditions detected in different software applications in the plurality of software applications, generate respective alerts that include different audio components that indicate that the conditions occurred in different software applications, regardless of respective types of the conditions;

wherein the code for detecting the occurrence of the plurality of conditions in the plurality of software applications includes instructions for;

detecting occurrence of a first condition of a first type in a first software application at the computing device, wherein the first condition of the first type indicates failure of an operation requested by a user to occur;

in response to detecting the occurrence of the first condition in the first software application, generating a first alert corresponding to the first condition that includes;

a first haptic component that indicates that the first condition of the first type has occurred; and

a first audio component that corresponds to the first software application;

detecting occurrence at the computing device of the first condition of the first type in a second software application that is different from the first software application;

in response to detecting the occurrence of the first condition in the second software application, generating a second alert corresponding to the first condition that includes;

the first haptic component that indicates that the first condition of the first type has occurred; and

a second audio component, different from the first audio component, the second audio component corresponding to the second software application;

detecting occurrence at the computing device of a second condition of a second type in the first software application, the second type different than the first type; and

in response to detecting the occurrence of the second condition in the first software application, generating a third alert corresponding to the second condition that includes;

a second haptic component that indicates that the second condition of the second type has occurred, the second haptic component different than the first haptic component; and

the first audio component corresponding to the first software application.

10. The non-transitory computer readable storage medium of claim 9, wherein the code for detecting the occurrence of the plurality of conditions in the plurality of software applications further includes instructions for:

detecting the occurrence of the first condition at the computing device in a third software application different from the first and second software applications, wherein the first condition indicates failure of an operation in the third software application requested by the user to occur;

in response to detecting the occurrence of the first condition at the computing device in the third software application, generating a fourth alert corresponding to the first condition in the third software application that includes;

the first haptic component that indicates that the first condition of the first type has occurred; and

a third audio component, different from the first audio component and the second audio component, the third audio component corresponding to the third software application.

11. The non-transitory computer readable storage medium of claim 9, wherein:

the second haptic component in the third alert indicates that an operation in the first software application requested by a user has successfully occurred.

12. The non-transitory computer readable storage medium of claim 9, wherein:

the first audio component is generated based on an audio waveform that is designated for use by the first software application; and

the second audio component is generated based on an audio waveform that is designated for use by the second software application.

13. The non-transitory computer readable storage medium of claim 9, wherein:

the first audio component is generated based on an audio waveform that is designated for use by software applications in a first class of software applications; and

the second audio component is generated based on an audio waveform that is designated for use by software applications in a second class of software applications that is different from the first class of software applications.

14. The non-transitory computer readable storage medium of claim 9, wherein:

the second condition indicates success of a requested operation, and the second haptic component includes a series of haptic outputs that are aligned with features in the first audio component; and

the first haptic component is unaligned with features in the first audio component.

15. The non-transitory computer readable storage medium of claim 9, wherein the code for detecting the occurrence of the plurality of conditions in the plurality of software applications further includes instructions for:

detecting occurrence at the computing device of the second condition of the second type in the second software application; and

in response to detecting the occurrence of the second condition in the second software application, generating a fifth alert corresponding to the second condition that includes;

the second haptic component that indicates that the second condition of the second type has occurred; and

the second audio component that corresponds to the second software application;

wherein;

the second condition indicates success of a requested operation and the second haptic component includes a series of haptic outputs that are aligned with features in the second audio component; and

the first haptic component is unaligned with features in the second audio component.

16. The non-transitory computer readable storage medium of claim 9, wherein:

the computing device has a touch-sensitive display; and

the first haptic component and the second haptic component are provided via the touch-sensitive display on the computing device.

17. A device comprising:

one or more haptic output devices;

one or more audio output devices;

a touch-sensitive surface; and

memory storing one or more programs that include instructions for;

detecting occurrence of a plurality of conditions in a plurality of software applications, wherein the device is configured to;

for conditions of a same type, generate respective alerts that include same haptic components that indicate that the conditions are of the same type, and for conditions of different types, generate respective alerts that include different respective haptic components that indicate that the conditions are of different types, regardless of respective software applications in the plurality of software applications in which the conditions in the plurality of conditions were detected; and

for conditions detected in a same software application in the plurality of software applications, generate respective alerts that include same audio components that indicate that the conditions occurred in the same software application, and for conditions detected in different software applications in the plurality of software applications, generate respective alerts that include different audio components that indicate that the conditions occurred in different software applications, regardless of respective types of the conditions; and

wherein the instructions for detecting the occurrence of the plurality of conditions in the plurality of software applications include instructions for;

detecting occurrence of a first condition of a first type in a first software application at the device, wherein the first condition of the first type indicates failure of an operation requested by a user to occur;

in response to detecting the occurrence of the first condition in the first software application, generating a first alert corresponding to the first condition that includes;

a first haptic component that indicates that the first condition of the first type has occurred; and

a first audio component that corresponds to the first software application;

detecting occurrence at the device of the first condition of the first type in a second software application that is different from the first software application;

in response to detecting the occurrence of the first condition in the second software application, generating a second alert corresponding to the first condition that includes;

the first haptic component that indicates that the first condition of the first type has occurred; and

a second audio component, different from the first audio component, the second audio component corresponding to the second software application;

detecting occurrence at the device of a second condition of a second type in the first software application, the second type different than the first type; and

in response to detecting the occurrence of the second condition in the first software application, generating a third alert corresponding to the second condition that includes;

a second haptic component that indicates that the second condition of the second type has occurred, the second haptic component different than the first haptic component; and

the first audio component corresponding to the first software application.

18. The device of claim 17, wherein the instructions for detecting the occurrence of the plurality of conditions in the plurality of software applications further include instructions for:

detecting the occurrence of the first condition at the device in a third software application different from the first and second software applications, wherein the first condition indicates failure of an operation in the third software application requested by the user to occur;

in response to detecting the occurrence of the first condition at the device in the third software application, generating a fourth alert corresponding to the first condition in the third software application that includes;

the first haptic component that indicates that the first condition of the first type has occurred; and

a third audio component, different from the first audio component and the second audio component, the third audio component corresponding to the third software application.

19. The device of claim 17, wherein:

the second haptic component in the third alert indicates that an operation in the first software application requested by a user has successfully occurred.

20. The device of claim 17, wherein:

the first audio component is generated based on an audio waveform that is designated for use by the first software application; and

the second audio component is generated based on an audio waveform that is designated for use by the second software application.

21. The device of claim 17, wherein:

the first audio component is generated based on an audio waveform that is designated for use by software applications in a first class of software applications; and

the second audio component is generated based on an audio waveform that is designated for use by software applications in a second class of software applications that is different from the first class of software applications.

22. The device of claim 17, wherein:

the second condition indicates success of a requested operation, and the second haptic component includes a series of haptic outputs that are aligned with features in the first audio component; and

the first haptic component is unaligned with features in the first audio component.

23. The device of claim 17, wherein the instructions for detecting the occurrence of the plurality of conditions in the plurality of software applications further include instructions for:

detecting occurrence at the computing device of the second condition of the second type in the second software application; and

in response to detecting the occurrence of the second condition in the second software application, generating a fifth alert corresponding to the second condition that includes;

the second haptic component that indicates that the second condition of the second type has occurred; and

the second audio component that corresponds to the second software application;

wherein;

the second condition indicates success of a requested operation and the second haptic component includes a series of haptic outputs that are aligned with features in the second audio component; and

the first haptic component is unaligned with features in the second audio component.

24. The device of claim 17, wherein:

the first haptic component and the second haptic component are generated by the one or more haptic output devices and provided via the touch-sensitive surface on the device.