Semantic framework for variable haptic output

• US 9,928,699 B2
• Filed: 09/29/2015
• Issued: 03/27/2018
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Moussette, Camille, Butcher, Gary I., Verweij, Hugo D., Ive, Jonathan
• Primary Examiner(s): Wang, Jack K
• Application Number:
  US14/869,834
• Publication Number:
  US 20160062465A1
• Time in Patent Office: 910 Days
• Field of Search: 345156, 3404071, 3404072, 455 414, 4554141
• CPC Class Codes: G06F 11/0745 in an input/output transactions management context input/output processing in general G06F13/00
• CPC Class Codes: G06F 11/0763 by bit configuration check, e.g. of formats or tags
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: G08B 7/06 using electric transmission , e.g. involving audible and visible signalling through the use of sound and light sources
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 19/04 the ringing-current being generated at the substations

Abstract

Methods and apparatus organize a plurality of haptic output variations into a cohesive semantic framework that uses various information about the alert condition and trigger, application context, and other conditions to provide a system of haptic outputs that share characteristics between related events. In some embodiments, an event class or application class provides the basis for a corresponding haptic output. In some embodiments, whether an alert-salience setting is on provides the basis for adding an increased salience haptic output to the standard haptic output for the alert. In some embodiments, consistent haptics provide for branding of the associated application class, application, and/or context.

Claims

1. A processor-implemented method performed on a computing device with a tactile output generator, comprising:

detecting a first input at the computing device from a user of the computing device that corresponds to a request to perform a first operation without a supplemental operation;

responsive to detecting the first input;

providing a first output that includes a first haptic component that is indicative of performance of the first operation in response to detecting the first input; and

performing the first operation without performing the supplemental operation;

after performing the first operation, detecting a second input at the computing device from the user that corresponds to a request to perform a second operation that includes the first operation and the supplemental operation; and

responsive to detecting the second input and without requiring additional input from the user subsequent to the second input;

providing a second output that includes both;

the first haptic component that is indicative of performance of the first operation in response to detecting the second input; and

a supplemental output that includes a second haptic component that is indicative of performance of the supplemental operation in response to detecting the second input; and

performing the second operation that includes the first operation and the supplemental operation;

wherein

the computing device is a wearable computing device remotely controlling a remote computing device; and

the first operation is performed at the remote computing device.

2. The method of claim 1, further comprising:

responsive to detecting the second input;

performing the first operation and concurrently providing the first output; and

performing the supplemental operation and concurrently providing the supplemental output.

3. The method of claim 1, further comprising:

responsive to detecting the second input;

performing the first operation prior to performing the supplemental operation; and

providing the first output prior to providing the supplemental output.

4. The method of claim 1, further comprising:

responsive to detecting the second input;

performing the first operation after performing the supplemental operation; and

providing the first output after providing the supplemental output.

5. The method of claim 1, further comprising:

responsive to detecting the second input;

performing at least a portion of the first operation concurrently with a portion of the supplemental operation; and

providing at least a portion of the first output concurrently with a portion of the supplemental output.

6. The method of claim 1, wherein:

the remote computing device includes a camera;

the first operation corresponds to capture of an image with the camera;

and

the second operation corresponds to capturing an image after a specified interval of time.

7. The method of claim 1, wherein:

the first operation corresponds to a transaction-enable operation for enabling the device to authorize a secure transaction; and

the second operation corresponds to enabling the device to authorize a secure transaction and authorizing the secure transaction.

8. The method of claim 1, wherein:

the first operation corresponds to a save operation for saving content within an existing file; and

the second operation corresponds to a save-as operation to save content within an existing file to a new file.

9. The method of claim 1, wherein:

the first operation corresponds to a send operation for sending a reply to a message that is in a message inbox; and

the second operation corresponds to a send and archive operation for sending a reply to a message that is in the message inbox and removing it from the message inbox.

10. The method of claim 1, wherein:

the supplemental operation has a variable attribute; and

the supplemental output is based on a value of the variable attribute.

11. The method of claim 1, wherein the second haptic component is distinct from the first haptic component.

12. The method of claim 1, wherein the supplemental output further comprises a non-haptic component.

13. The method of claim 1, wherein the second output further comprises a textual component that identifies the supplemental operation as different from the first operation.

14. The method of claim 1, wherein:

the supplemental output further comprises an audio component; and

the first output does not include an audio component.

15. The method of claim 1, wherein:

the computing device comprises a touch-sensitive display;

the first and second inputs are received through the touch-sensitive display; and

the first haptic component of the first output and the second haptic component of the second output are provided via the touch-sensitive display.

30. The method of claim 1, wherein the second input corresponds to a single finger contact or a multiple finger contact on a touch sensitive surface.

16. A non-transitory computer readable storage medium storing executable code, the code when executed causes a processor at a computing device with a tactile output generator to perform the following steps:

detecting a first input at the computing device from a user of the computing device that corresponds to a request to perform a first operation without a supplemental operation;

responsive to detecting the first input;

providing a first output that includes a first haptic component that is indicative of performance of the first operation in response to detecting the first input; and

performing the first operation without performing the supplemental operation;

after performing the first operation, detecting a second input at the computing device from the user that corresponds to a request to perform a second operation that includes the first operation and the supplemental operation; and

responsive to detecting the second input and without requiring additional input from the user subsequent to the second input;

providing a second output that includes both;

the first haptic component that is indicative of performance of the first operation in response to detecting the second input; and

a supplemental output that includes a second haptic component that is indicative of performance of the supplemental operation in response to detecting the second input; and

performing the second operation that includes the first operation and the supplemental operation;

wherein

the computing device is a wearable computing device remotely controlling a remote computing device; and

the first operation is performed at the remote computing device.

17. The non-transitory computer readable storage medium of claim 16, further comprising instructions for:

responsive to detecting the second input;

performing the first operation and concurrently providing the first output; and

performing the supplemental operation and concurrently providing the supplemental output.

18. The non-transitory computer readable storage medium of claim 16, further comprising instructions for:

responsive to detecting the second input;

performing the first operation prior to performing the supplemental operation; and

providing the first output prior to providing the supplemental output.

19. The non-transitory computer readable storage medium of claim 16, further comprising instructions for:

responsive to detecting the second input;

performing the first operation after performing the supplemental operation; and

providing the first output after providing the supplemental output.

20. The non-transitory computer readable storage medium of claim 16, further comprising instructions for:

responsive to detecting the second input;

performing at least a portion of the first operation concurrently with a portion of the supplemental operation; and

providing at least a portion of the first output concurrently with a portion of the supplemental output.

21. The non-transitory computer readable storage medium of claim 16, wherein:

the remote computing device includes a camera;

the first operation corresponds to capture of an image with the camera; and

the second operation corresponds to capturing an image after a specified interval of time.

22. The non-transitory computer readable storage medium of claim 16, wherein:

the first operation corresponds to a transaction-enable operation for enabling the device to authorize a secure transaction; and

the second operation corresponds to enabling the device to authorize a secure transaction and authorizing the secure transaction.

31. The non-transitory computer readable storage medium of claim 16, wherein:

the first operation corresponds to a save operation for saving content within an existing file; and

the second operation corresponds to a save-as operation to save content within an existing file to a new file.

32. The non-transitory computer readable storage medium of claim 16, wherein:

the first operation corresponds to a send operation for sending a reply to a message that is in a message inbox; and

the second operation corresponds to a send and archive operation for sending a reply to a message that is in the message inbox and removing it from the message inbox.

33. The non-transitory computer readable storage medium of claim 16, wherein:

the supplemental operation has a variable attribute; and

the supplemental output is based on a value of the variable attribute.

34. The non-transitory computer readable storage medium of claim 16, wherein the second haptic component is distinct from the first haptic component.

35. The non-transitory computer readable storage medium of claim 16, wherein the supplemental output further comprises a non-haptic component.

36. The non-transitory computer readable storage medium of claim 16, wherein the second output further comprises a textual component that identifies the supplemental operation as different from the first operation.

37. The non-transitory computer readable storage medium of claim 16, wherein:

the supplemental output further comprises an audio component; and

the first output does not include an audio component.

38. The non-transitory computer readable storage medium of claim 16, wherein:

the computing device comprises a touch-sensitive display;

the first and second inputs are received through the touch-sensitive display; and

the first haptic component of the first output and the second haptic component of the second output are provided via the touch-sensitive display.

39. The non-transitory computer readable storage medium of claim 16, wherein the second input corresponds to a single finger contact or a multiple finger contact on a touch sensitive surface.

23. A device comprising:

a tactile output generator;

a touch-sensitive surface; and

memory storing one or more programs that include instructions for;

detecting a first input at the device from a user of the device that corresponds to a request to perform a first operation without a supplemental operation;

responsive to detecting the first input;

providing a first output that includes a first haptic component that is indicative of performance of the first operation in response to detecting the first input; and

performing the first operation without performing the supplemental operation;

after performing the first operation, detecting a second input at the device from the user that corresponds to a request to perform a second operation that includes the first operation and the supplemental operation; and

responsive to detecting the second input and without requiring additional input from the user subsequent to the second input;

providing a second output that includes both;

the first haptic component that is indicative of performance of the first operation in response to detecting the second input and

a supplemental output that includes a second haptic component that is indicative of performance of the supplemental operation in response to detecting the second input; and

performing the second operation that includes the first operation and the supplemental operation;

wherein

the computing device is a wearable computing device remotely controlling a remote computing device; and

the first operation is performed at the remote computing device.

24. The device of claim 23, further comprising instructions for:

responsive to detecting the second input;

performing the first operation and concurrently providing the first output; and

performing the supplemental operation and concurrently providing the supplemental output.

25. The device of claim 23, further comprising instructions for:

responsive to detecting the second input;

performing the first operation prior to performing the supplemental operation; and

providing the first output prior to providing the supplemental output.

26. The device of claim 23, further comprising instructions for:

responsive to detecting the second input;

performing the first operation after performing the supplemental operation; and

providing the first output after providing the supplemental output.

27. The device of claim 23, further comprising instructions for:

responsive to detecting the second input;

performing at least a portion of the first operation concurrently with a portion of the supplemental operation; and

providing at least a portion of the first output concurrently with a portion of the supplemental output.

28. The device of claim 23, wherein:

the remote computing device includes a camera;

the first operation corresponds to capture of an image with the camera; and

the second operation corresponds to capturing an image after a specified interval of time.

29. The device of claim 23, wherein:

the first operation corresponds to a transaction-enable operation for enabling the device to authorize a secure transaction; and

the second operation corresponds to enabling the device to authorize a secure transaction and authorizing the secure transaction.

40. The device of claim 23, wherein:

the first operation corresponds to a save operation for saving content within an existing file; and

the second operation corresponds to a save-as operation to save content within an existing file to a new file.

41. The device of claim 23, wherein:

the first operation corresponds to a send operation for sending a reply to a message that is in a message inbox; and

the second operation corresponds to a send and archive operation for sending a reply to a message that is in the message inbox and removing it from the message inbox.

42. The device of claim 23, wherein:

the supplemental operation has a variable attribute; and

the supplemental output is based on a value of the variable attribute.

43. The device of claim 23, wherein the second haptic component is distinct from the first haptic component.

44. The device of claim 23, wherein the supplemental output further comprises a non-haptic component.

45. The device of claim 23, wherein the second output further comprises a textual component that identifies the supplemental operation as different from the first operation.

46. The device of claim 23, wherein:

the supplemental output further comprises an audio component; and

the first output does not include an audio component.

47. The device of claim 23, wherein:

the computing device comprises a touch-sensitive display;

the first and second inputs are received through the touch-sensitive display; and

the first haptic component of the first output and the second haptic component of the second output are provided via the touch-sensitive display.

48. The device of claim 23, wherein the second input corresponds to a single finger contact or a multiple finger contact on a touch sensitive surface.