Wrist-based tactile time feedback for non-sighted users

• US 10,156,904 B2
• Filed: 02/01/2017
• Issued: 12/18/2018
• Est. Priority Date: 06/12/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fleizach, Christopher B., Everitt, Aaron
• Primary Examiner(s): Kohlman, Christopher J
• Application Number:
  US15/421,711
• Publication Number:
  US 20170357321A1
• Time in Patent Office: 685 Days
• Field of Search: None
• CPC Class Codes: G04B 25/02 by feeling; Clocks or watches for blind persons
• CPC Class Codes: G04G 13/00 Producing acoustic time signals
• CPC Class Codes: G04G 21/08 Touch switches specially adapted for time-pieces
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays
• CPC Class Codes: G09B 21/005 Details of specially-adapted software to access information, e.g. to browse through hyperlinked information

Abstract

The present disclosure generally relates to tactile time feedback. Systems and methods for tactile time feedback include detecting a sequence of touch inputs at an electronic device, and in response to a determination that the sequence of touch inputs meets tactile time output criteria, output a tactile output pattern that indicates a time of day.

Claims

1. An electronic device, comprising:

a tactile output generator;

a touch-sensitive display screen;

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

detecting a sequence of touch inputs that includes at least a first touch input and a second touch input on the touch-sensitive display screen;

in response to detecting the sequence of touch inputs on the touch-sensitive display screen;

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen meets a tactile time output criteria and a current time of day is a first time, wherein the tactile time output criteria includes a criterion that is met when the first touch input and the second touch input are detected on the touch-sensitive display screen within a predetermined time threshold while the state of the touch-sensitive display screen is in an off state, outputting, by the tactile output generator, a first tactile output pattern that is indicative of the first time;

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen meets the tactile time output criteria and the current time of day is a second time, outputting, by the tactile output generator, a second tactile output pattern that is indicative of the second time, wherein the first tactile output pattern and the second tactile output pattern are different; and

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen is detected while the state of the touch-sensitive display screen is in an on state;

forgoing output of a tactile output pattern that is indicative of the current time of day; and

performing a function at the electronic device other than outputting a tactile output pattern that is indicative of the current time of day.

2. The electronic device of claim 1, wherein the tactile time output criteria includes a criterion that is met when an accessibility mode at the electronic device is enabled.

3. The electronic device of claim 1, wherein the electronic device further includes a display screen and the sequence of touch inputs includes a first tap and a second tap, the one or more programs further including instructions for:

in response to detecting the first tap, turning on the display screen.

4. The electronic device of claim 1, the one or more programs further including instructions for:

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen does not meet the tactile time output criteria, performing a function at the electronic device other than outputting a tactile output pattern that is indicative of the current time of day.

5. The electronic device of claim 1, wherein the sequence of touch inputs includes a tap, the one or more programs further including instructions for:

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen does not meet the tactile time output criteria, activating a function that corresponds to a location of the tap.

6. The electronic device of claim 5, wherein activating the function includes launching an application associated with an affordance located on the touch-sensitive display screen at the location of the tap.

7. The electronic device of claim 1, wherein the first tactile output pattern that is indicative of the first time provides an indication of the first time in a Morse code format.

8. The electronic device of claim 1, wherein the first tactile output pattern includes a first portion and a second portion distinct from the first portion in at least one of an output duration or an output intensity.

9. The electronic device of claim 1, wherein the first tactile output pattern includes an hour-portion determined based on an hour value of the first time and a minute-portion determined based on a minute value of the first time.

10. The electronic device of claim 9, wherein the hour-portion and the minute-portion are separated by a predetermined period of time during which no tactile output is generated by the device.

11. The electronic device of claim 9, wherein:

the hour-portion includes a tens place subportion and a ones place subportion;

each of the tens place subportion and the ones place subportion is determined based on a respective value of the hour value of the first time;

the outputting of the hour-portion includes outputting;

the tens place subportion comprising a number of pulses corresponding to a value in a tens place of the hour value, and

the ones place subportion comprising a number of pulses corresponding to a value in a ones place of the hour value; and

the tens place subportion is output before the ones place subportion is output.

12. The electronic device of claim 11, the one or more programs further including instructions for:

outputting the tens place subportion with a primary vibration profile defining at least one of a long output duration or a strong output intensity per pulse; and

outputting the ones place subportion with a secondary vibration profile defining at least one of a short output duration or a low output intensity per pulse.

13. The electronic device of claim 11, wherein:

the hour-portion includes a major subportion and a minor subportion;

the major subportion is determined based on a number of major hour increments in the hour value and the minor subportion is determined based on a number of minor hour increments in the hour value remaining after the major hour increments are determined;

each major hour increment is greater than one hour and greater than each minor hour increment;

the outputting of the hour-portion includes outputting;

the major subportion comprising a number of pulses corresponding to a number of major hour increments of the hour value, and

the minor subportion comprising a number of pulses corresponding to a number of minor hour increments of the hour value after the major hour increments are determined; and

the major subportion is output before the minor subportion is output.

14. The electronic device of claim 13, the one or more programs further comprising instructions for:

outputting the major subportion with a primary tactile output profile defining at least one of a first output duration or a first output intensity; and

outputting the minor subportion with a secondary tactile output profile defining at least one of a second output duration that is different the first output duration or a second output intensity that is different from the first output intensity.

15. The electronic device of claim 9, wherein:

the minute-portion includes a tens place subportion and a ones place subportion;

the tens place subportion and the ones place subportion are both determined based on a same respective value of the minute value of the first time;

the outputting of the minute-portion includes outputting;

the tens place subportion comprising a number of pulses corresponding to a value in a tens place of the minute value, and

the ones place subportion comprising a number of pulses corresponding to a value in a ones place of the minute value; and

the tens place subportion is output before the ones place subportion is output.

16. The electronic device of claim 15, the one or more programs further comprising instructions for:

outputting the tens place subportion with a primary tactile output profile defining at least one of a first output duration or a first output intensity; and

outputting the ones place subportion with a secondary tactile output profile defining at least one of a second output duration that is different from the first output duration or a second output intensity that is different from the first output intensity.

17. The electronic device of claim 15, the one or more programs further comprising instructions for:

determining a number of fractional increments based on the minute value of the first time, wherein each fractional increment of an hour is greater than one minute; and

outputting the minute-portion with a number of pulses corresponding to the determined number of fractional increments.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a touch-sensitive display screen and a tactile output generator, cause the device to:

detect a sequence of touch inputs that includes at least a first touch input and a second touch input on the touch-sensitive display screen;

in response to detecting the sequence of touch inputs on the touch-sensitive display screen;

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen meets a tactile time output criteria and a current time of day is a first time, wherein the tactile time output criteria includes a criterion that is met when the first touch input and the second touch input are detected on the touch-sensitive display screen within a predetermined time threshold while the state of the touch-sensitive display screen is in an off state, output, by the tactile output generator, a first tactile output pattern that is indicative of the first time;

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen meets the tactile time output criteria and the current time of day is a second time, output, by the tactile output generator, a second tactile output pattern that is indicative of the second time, wherein the first tactile output pattern and the second tactile output pattern are different; and

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen is detected while the state of the touch-sensitive display screen is in an on state;

forgo output of a tactile output pattern that is indicative of the current time of day; and

perform a function at the electronic device other than outputting a tactile output pattern that is indicative of the current time of day.

19. The non-transitory computer readable storage medium of claim 18, wherein the tactile time output criteria includes a criterion that is met when an accessibility mode at the electronic device is enabled.

20. The non-transitory computer readable storage medium of claim 18, wherein the electronic device further includes a display screen and the sequence of touch inputs includes a first tap and a second tap, the one or more programs further including instructions that cause the device to:

in response to detecting the first tap, turn on the display screen.

21. The non-transitory computer readable storage medium of claim 18, the one or more programs further including instructions that cause the device to:

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen does not meet the tactile time output criteria, perform a function at the electronic device other than outputting a tactile output pattern that is indicative of the current time of day.

22. The non-transitory computer readable storage medium of claim 18, wherein the sequence of touch inputs includes a tap, the one or more programs comprising further instructions that cause the device to:

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen does not meet the tactile time output criteria, activate a function that corresponds to a location of the tap.

23. The non-transitory computer readable storage medium of claim 22, wherein activating the function includes launching an application associated with an affordance located on the touch-sensitive display screen at the location of the tap.

24. The non-transitory computer readable storage medium of claim 18, wherein the first tactile output pattern that is indicative of the first time provides an indication of the first time in a Morse code format.

25. The non-transitory computer readable storage medium of claim 18, wherein the first tactile output pattern includes a first portion and a second portion distinct from the first portion in at least one of an output duration or an output intensity.

26. The non-transitory computer readable storage medium of claim 18, wherein the first tactile output pattern includes an hour-portion determined based on an hour value of the first time and a minute-portion determined based on a minute value of the first time.

27. The non-transitory computer readable storage medium of claim 26, wherein the hour-portion and the minute-portion are separated by a predetermined period of time during which no tactile output is generated by the device.

28. The non-transitory computer readable storage medium of claim 26, wherein:

the hour-portion includes a tens place subportion and a ones place subportion;

each of the tens place subportion and the ones place subportion is determined based on a respective value of the hour value of the first time;

the outputting of the hour-portion includes outputting;

the tens place subportion comprising a number of pulses corresponding to a value in a tens place of the hour value, and

the ones place subportion comprising a number of pulses corresponding to a value in a ones place of the hour value; and

the tens place subportion is output before the ones place subportion is output.

29. The non-transitory computer readable storage medium of claim 28, the one or more programs including further instructions that cause the device to:

output the tens place subportion with a primary vibration profile defining at least one of a long output duration or a strong output intensity per pulse; and

output the ones place subportion with a secondary vibration profile defining at least one of a short output duration or a low output intensity per pulse.

30. The non-transitory computer readable storage medium of claim 28, wherein:

the hour-portion includes a major subportion and a minor subportion;

the major subportion is determined based on a number of major hour increments in the hour value and the minor subportion is determined based on a number of minor hour increments in the hour value remaining after the major hour increments are determined;

each major hour increment is greater than one hour and greater than each minor hour increment;

the outputting of the hour-portion includes outputting;

the major subportion comprising a number of pulses corresponding to a number of major hour increments of the hour value, and

the minor subportion comprising a number of pulses corresponding to a number of minor hour increments of the hour value after the major hour increments are determined; and

the major subportion is output before the minor subportion is output.

31. The non-transitory computer readable storage medium of claim 30, the one or more programs further including instructions that cause the device to:

output the major subportion with a primary tactile output profile defining at least one of a first output duration or a first output intensity; and

output the minor subportion with a secondary tactile output profile defining at least one of a second output duration that is different the first output duration or a second output intensity that is different from the first output intensity.

32. The non-transitory computer readable storage medium of claim 28, wherein:

the minute-portion includes a tens place subportion and a ones place subportion;

the tens place subportion and the ones place subportion are both determined based on a same respective value of the minute value of the first time;

the outputting of the minute-portion includes outputting;

the tens place subportion comprising a number of pulses corresponding to a value in a tens place of the minute value, and

the ones place subportion comprising a number of pulses corresponding to a value in a ones place of the minute value; and

the tens place subportion is output before the ones place subportion is output.

33. The non-transitory computer readable storage medium of claim 32, the one or more programs further including instructions that cause the device to:

output the tens place subportion with a primary tactile output profile defining at least one of a first output duration or a first output intensity; and

output the ones place subportion with a secondary tactile output profile defining at least one of a second output duration that is different from the first output duration or a second output intensity that is different from the first output intensity.

34. The non-transitory computer readable storage medium of claim 32, the one or more programs further including instructions that cause the device to:

determine a number of fractional increments based on the minute value of the first time, wherein each fractional increment of an hour is greater than one minute; and

output the minute-portion with a number of pulses corresponding to the determined number of fractional increments.

35. A method, comprising:

at an electronic device having a touch-sensitive display screen and a tactile output generator;

detecting a sequence of touch inputs that includes at least a first touch input and a second touch input on the touch-sensitive display screen;

in response to detecting the sequence of touch inputs on the touch-sensitive display screen;

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen meets a tactile time output criteria and a current time of day is a first time, wherein the tactile time output criteria includes a criterion that is met when the first touch input and the second touch input are detected on the touch-sensitive display screen within a predetermined time threshold while the state of the touch-sensitive display screen is in an off state, outputting, by the tactile output generator, a first tactile output pattern that is indicative of the first time;

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen meets the tactile time output criteria and the current time of day is a second time, outputting, by the tactile output generator, a second tactile output pattern that is indicative of the second time, wherein the first tactile output pattern and the second tactile output pattern are different; and

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen is detected while the state of the touch-sensitive display screen is in an on state;

forgoing output of a tactile output pattern that is indicative of the current time of day; and

performing a function at the electronic device other than outputting a tactile output pattern that is indicative of the current time of day.

36. The method of claim 35, wherein the tactile time output criteria includes a criterion that is met when an accessibility mode at the electronic device is enabled.

37. The method of claim 35, wherein the electronic device further includes a display screen and the sequence of touch inputs includes a first tap and a second tap, the method further comprising:

in response to detecting the first tap, turning on the display screen.

38. The method of claim 35, further comprising:

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen does not meet the tactile time output criteria, performing a function at the electronic device other than outputting a tactile output pattern that is indicative of the current time of day.

39. The method of claim 35, wherein the sequence of touch inputs includes a tap, the method further comprising:

in accordance with a determination that the sequence of touch inputs detected on the touch-sensitive display screen does not meet the tactile time output criteria, activating a function that corresponds to a location of the tap.

40. The method of claim 39, wherein activating the function includes launching an application associated with an affordance located on the touch-sensitive display screen at the location of the tap.

41. The method of claim 35, wherein the first tactile output pattern that is indicative of the first time provides an indication of the first time in a Morse code format.

42. The method of claim 35, wherein the first tactile output pattern includes a first portion and a second portion distinct from the first portion in at least one of an output duration or an output intensity.

43. The method of claim 35, wherein the first tactile output pattern includes an hour-portion determined based on an hour value of the first time and a minute-portion determined based on a minute value of the first time.

44. The method of claim 43, wherein the hour-portion and the minute-portion are separated by a predetermined period of time during which no tactile output is generated by the device.

45. The method of claim 43, wherein:

the hour-portion includes a tens place subportion and a ones place subportion;

each of the tens place subportion and the ones place subportion is determined based on a respective value of the hour value of the first time;

the outputting of the hour-portion includes outputting;

the tens place subportion comprising a number of pulses corresponding to a value in a tens place of the hour value, and

the ones place subportion comprising a number of pulses corresponding to a value in a ones place of the hour value; and

the tens place subportion is output before the ones place subportion is output.

46. The method of claim 45, further comprising:

outputting the tens place subportion with a primary vibration profile defining at least one of a long output duration or a strong output intensity per pulse; and

outputting the ones place subportion with a secondary vibration profile defining at least one of a short output duration or a low output intensity per pulse.

47. The method of claim 45, wherein:

the hour-portion includes a major subportion and a minor subportion;

the major subportion is determined based on a number of major hour increments in the hour value and the minor subportion is determined based on a number of minor hour increments in the hour value remaining after the major hour increments are determined;

each major hour increment is greater than one hour and greater than each minor hour increment;

the outputting of the hour-portion includes outputting;

the major subportion comprising a number of pulses corresponding to a number of major hour increments of the hour value, and

the minor subportion comprising a number of pulses corresponding to a number of minor hour increments of the hour value after the major hour increments are determined; and

the major subportion is output before the minor subportion is output.

48. The method of claim 47, further comprising:

outputting the major subportion with a primary tactile output profile defining at least one of a first output duration or a first output intensity; and

outputting the minor subportion with a secondary tactile output profile defining at least one of a second output duration that is different the first output duration or a second output intensity that is different from the first output intensity.

49. The method of claim 43, wherein:

the minute-portion includes a tens place subportion and a ones place subportion;

the tens place subportion and the ones place subportion are both determined based on a same respective value of the minute value of the first time;

the outputting of the minute-portion includes outputting;

the tens place subportion comprising a number of pulses corresponding to a value in a tens place of the minute value, and

the ones place subportion comprising a number of pulses corresponding to a value in a ones place of the minute value; and

the tens place subportion is output before the ones place subportion is output.

50. The method of claim 49, further comprising:

outputting the tens place subportion with a primary tactile output profile defining at least one of a first output duration or a first output intensity; and

outputting the ones place subportion with a secondary tactile output profile defining at least one of a second output duration that is different from the first output duration or a second output intensity that is different from the first output intensity.

51. The method of claim 49, further comprising:

determining a number of fractional increments based on the minute value of the first time, wherein each fractional increment of an hour is greater than one minute; and

outputting the minute-portion with a number of pulses corresponding to the determined number of fractional increments.