User interface methods and systems for providing force-sensitive input

• US 8,432,368 B2
• Filed: 01/06/2010
• Issued: 04/30/2013
• Est. Priority Date: 01/06/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Momeyer, Brian, Forutanpour, Babak, Horodezky, Samuel J., Gooding, Ted R.
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): PATEL, PREMAL R
• Application Number:
  US12/652,922
• Publication Number:
  US 20110167391A1
• Time in Patent Office: 1,210 Days
• Field of Search: 345156-173, 715/863
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/30 Means for acting in the event of power-supply failure or interruption, e.g. power-supply fluctuations for resetting only G06F1/24
• CPC Class Codes: G06F 2203/0339 Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector

Abstract

Methods and systems implement touch sensors or force sensitive materials disposed on the case of a computing device in order to enable user input gestures to be performed on portions of the device case. The force sensitive elements may generate an electrical signal in response to a gesture, such as a tap, squeeze, swipe or twist. The properties of the generated electrical signal may be compared to various reference templates to recognize particular input gestures. The force sensitive elements may operate in conjunction with more traditional input methods, such as touch-screen display and electromechanical buttons. By enabling user input gestures on the case of computing devices, the various aspects permit one hand operation of the devices including intuitive gestures that do not require the users focused attention to accomplish. Thus the various aspects may enable users to utilize their computing devices in situations not suitable to conventional user input technologies.

Claims

1. A method for capturing user input on a computing device, comprising:

receiving an electrical signal from a force sensitive sensor positioned on a case of the computing device;

comparing the received electrical signal to each of a plurality of reference signal templates;

calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates;

determining a best match reference signal template for the received electrical signal based on the cross-correlation values;

identifying a functionality associated with the best match reference signal template; and

implementing the identified functionality on the computing device.

2. The method of claim 1, wherein implementing the identified functionality on the computing device comprises:

generating a user input event notification; and

forwarding the user input event notification to an application executing on the computing device.

3. The method of claim 1, wherein the force sensitive sensor comprises a piezoelectric sensor.

4. The method of claim 1, further comprising:

filtering the received electrical signal for electromagnetic interference;

converting the received electrical signal from analog to digital format;

normalizing the received electrical signal in at least one of frequency and amplitude; and

identifying a portion of the received electrical signal to compare with the reference signal template.

5. The method of claim 1, further comprising converting the received electrical signal from the force sensitive sensor into frequency domain data,

wherein comparing the received electrical signal with a reference signal template comprises comparing the sensor signal frequency domain data to a reference frequency domain template.

6. The method of claim 1, wherein calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates comprises:

calculating cross-correlation values of a portion of the received electrical signal and each of a plurality of reference signal templates.

7. The method of claim 1, wherein comparing the received electrical signal with a reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

converting at least a portion of the received electrical signal into a frequency domain signal portion;

calculating cross-correlation values of the frequency domain portion and each of a plurality of reference templates;

determining a best correlation value; and

determining whether the correlation value is above a threshold value.

8. The method of claim 1, wherein comparing the received electrical signal with a reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

performing a hidden Markov model test on the received electrical signal from the force sensitive sensor.

9. The method of claim 1, wherein comparing the received electrical signal with a reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

calculating one or more signal vectors characterizing the received electrical signal from the force sensitive sensor;

accessing a reference vector characterizing a reference signal;

calculating a cosine value based on the received signal vector and accessed reference vector; and

determining whether the calculated cosine value is less than a threshold value.

10. The method of claim 1, further comprising receiving a sensor input from another sensor, wherein identifying a functionality associated with the best match reference signal template comprises identifying a functionality associated both with the best match reference signal template and the sensor input received from the other sensor.

11. The method of claim 1, further comprising detecting a change in temperature based on the received electrical signal from the force sensitive sensor.

12. The method of claim 1, further comprising:

receiving a user identified functionality to be associated with a user input gesture;

prompting the user to perform the user input gesture;

receiving electrical signals from the force sensitive sensor;

processing the received electrical signals from the force sensitive sensor in order to generate a user-generated reference signal template; and

storing the user-generated reference signal template in memory in conjunction with the received user identified functionality.

13. The method of claim 1, wherein the computing device is a mobile device.

14. The method of claim 1, wherein the computing device is a tablet computing device.

15. The method of claim 1, further comprising determining when a signal from a force sensor ceases, wherein implementing the identified functionality on the computing device is initiated when the signal from the force sensor ceases.

16. The method of claim 1, further comprising determining when a low battery power condition exists, wherein implementing the identified functionality on the computing device comprises initiating a telephone call in a minimum power state.

17. The method of claim 1, further comprising applying a condition-specific weighting factor to the cross-correlation values.

18. A computing device, comprising:

a case;

a processor positioned within the case;

a memory coupled to the processor, the memory storing a reference signal template; and

a force sensitive sensor positioned on the case and coupled to the processor,

wherein the processor is configured with processor-executable instructions to perform operations comprising;

receiving an electrical signal from the force sensitive sensor;

comparing the received electrical signal to each of a plurality of reference signal templates;

calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates;

determining a best match reference signal template for the received electrical signal based on the cross-correlation values;

identifying a functionality associated with the best match reference signal template; and

implementing the identified functionality on the computing device.

19. The computing device of claim 18, wherein the processor is configured with processor-executable instructions such that implementing the identified functionality on the computing device comprises:

generating a user input event notification; and

forwarding the user input event notification to an application executing on the processor.

20. The computing device of claim 18, wherein the force sensitive sensor comprises a piezoelectric sensor.

21. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

filtering the received electrical signal for electromagnetic interference;

converting the received electrical signal from analog to digital format;

normalizing the received electrical signal in at least one of frequency and amplitude; and

identifying a portion of the received electrical signal to compare with the reference signal template.

22. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising converting the received electrical signal from the force sensitive sensor into frequency domain data,

wherein the reference signal template is a frequency domain template, and

wherein the processor is configured with processor-executable instructions such that comparing the received electrical signal with the reference signal template comprises comparing the sensor signal frequency domain data to the reference frequency domain template.

23. The computing device of claim 18, wherein the processor is configured with processor-executable instructions such that calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates comprises:

calculating cross-correlation values of a portion of the received electrical signal and each of the plurality of reference signal templates.

24. The computing device of claim 18, wherein the processor is configured with processor-executable instructions such that comparing the received electrical signal with a reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

converting at least a portion of the received electrical signal into a frequency domain signal portion;

calculating cross-correlation values of the frequency domain portion and each of a plurality of reference templates;

determining a best correlation value; and

determining whether the correlation value is above a threshold value.

25. The computing device of claim 18, wherein the processor is configured with processor-executable instructions such that comparing the received electrical signal with the reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

performing a hidden Markov model test on the received electrical signal from the force sensitive sensor.

26. The computing device of claim 18, wherein the reference signal template stored in the memory comprises frequency domain template, and wherein the processor is configured with processor-executable instructions such that comparing the received electrical signal with the reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

calculating one or more signal vectors characterizing the received electrical signal from the force sensitive sensor;

accessing the reference vector stored in the memory;

calculating a cosine value based on the received signal vector and the accessed reference vector; and

determining whether the calculated cosine value is less than a threshold value.

27. The computing device of claim 18, further comprising another sensor coupled to the processor, wherein the processor is configured with processor-executable instructions to perform operations further comprising receiving a sensor input from the other sensor, wherein identifying a functionality associated with the best match reference signal template comprises identifying a functionality associated both with the best match reference signal template and the sensor input received from the other sensor.

28. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising detecting a change in temperature based on the received electrical signal from the force sensitive sensor.

29. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

receiving a user identified functionality to be associated with a user input gesture;

prompting the user to perform the user input gesture;

receiving electrical signals from the force sensitive sensor;

processing the received electrical signals from the force sensitive sensor in order to generate a user-generated reference signal template; and

storing the user-generated reference signal template in the memory in conjunction with the received user identified functionality.

30. The computing device of claim 18, wherein the computing device is a mobile device.

31. The computing device of claim 18, wherein the computing device is a tablet computing device.

32. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising determining when a signal from a force sensor ceases, wherein implementing the identified functionality on the computing device is initiated when the signal from the force sensor ceases.

33. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising determining when a low battery power condition exists, wherein implementing the identified functionality on the computing device comprises initiating a telephone call in a minimum power state.

34. The computing device of claim 18, wherein the force sensitive sensor is positioned on an external surface of the case.

35. The computing device of claim 18, wherein the force sensitive sensor is positioned on an internal surface of the case.

36. The computing device of claim 18, comprising a plurality of force sensitive sensors positioned on the case and coupled to the processor.

37. The computing device of claim 36, wherein at least a portion of the plurality of force sensitive sensors are positioned on a back surface of the case.

38. The computing device of claim 36, wherein at least a portion of the plurality of force sensitive sensors are positioned on each side of the case.

39. The computing device of claim 36, wherein a portion of the plurality of force sensitive sensors are positioned on each side of the case and a portion of the plurality of force sensitive sensors are positioned on each side of the case.

40. The computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations further comprising applying a condition-specific weighting factor to the correlation values.

41. A computing device, comprising:

force sensing means for sensing a force applied to a case of the computing device;

means for receiving an electrical signal from the force sensing means;

means for comparing the received electrical signal to each of a plurality of reference signal templates;

means for calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates;

means for determining a best match reference signal template for the received electrical signal based on the cross-correlation values;

means for identifying a functionality associated with the best match reference signal template; and

means for implementing the identified functionality on the computing device.

42. The computing device of claim 41, wherein means for implementing the identified functionality on the computing device comprises:

means for generating a user input event notification; and

means for forwarding the user input event notification to an application executing on the computing device.

43. The computing device of claim 41, wherein the force sensing means comprises a piezoelectric sensor.

44. The computing device of claim 41, further comprising:

means for filtering the received electrical signal for electromagnetic interference;

means for converting the received electrical signal from analog to digital format;

means for normalizing the received electrical signal in at least one of frequency and amplitude; and

means for identifying a portion of the received electrical signal to compare with the reference signal template.

45. The computing device of claim 41, further comprising means for converting the received electrical signal from the force sensing means into frequency domain data,

wherein means for comparing the received electrical signal with a reference signal template comprises means for comparing the sensor signal frequency domain data to a reference frequency domain template.

46. The computing device of claim 41, wherein means for calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates comprises:

means for calculating cross-correlation values of a portion of the received electrical signal and each of a plurality of reference signal templates.

47. The computing device of claim 41, wherein means for comparing the received electrical signal with a reference signal template, and means for determining whether the received electrical signal matches the reference signal template comprises:

means for converting at least a portion of the received electrical signal into a frequency domain signal portion;

means for calculating cross-correlation values of the frequency domain portion and each of a plurality of reference templates;

means for determining a best correlation value; and

means for determining whether the correlation value is above a threshold value.

48. The computing device of claim 41, wherein means for comparing the received electrical signal with a reference signal template, and means for determining whether the received electrical signal matches the reference signal template comprises:

means for performing a hidden Markov model test on the received electrical signal from the force sensing means.

49. The computing device of claim 41, wherein means for comparing the received electrical signal with a reference signal template, and means for determining whether the received electrical signal matches the reference signal template comprises:

means for calculating one or more signal vectors characterizing the received electrical signal from the force sensing means;

means for accessing a reference vector characterizing a reference signal;

means for calculating a cosine value based on the received signal vector and accessed reference vector; and

means for determining whether the calculated cosine value is less than a threshold value.

50. The computing device of claim 41, further comprising means for receiving a sensor input from another sensor, wherein means for identifying a functionality associated with the best match reference signal template comprises means for identifying a functionality associated both with the best match reference signal template and the sensor input received from the other sensor.

51. The computing device of claim 41, further comprising means for detecting a change in temperature based on the received electrical signal from the force sensing means.

52. The computing device of claim 41, further comprising:

means for receiving a user identified functionality to be associated with a user input gesture;

means for prompting the user to perform the user input gesture;

means for receiving electrical signals from the force sensing means;

means for processing the received electrical signals from the force sensing means in order to generate a user-generated reference signal template; and

means for storing the user-generated reference signal template in memory in conjunction with the received user identified functionality.

53. The computing device of claim 41, wherein the computing device is a mobile device.

54. The computing device of claim 41, wherein the computing device is a tablet computing device.

55. The computing device of claim 41, further comprising means for determining when a signal from a force sensor ceases, wherein means for implementing the identified functionality on the computing device comprises means for initiated the identified functionality when the signal from the force sensor ceases.

56. The computing device of claim 41, further comprising means for determining when a low battery power condition exists, wherein means for implementing the identified functionality on the computing device comprises means for initiating a telephone call in a minimum power state.

57. The computing device of claim 41, wherein the force sensing means is positioned on an external surface of the case.

58. The computing device of claim 41, wherein the force sensing means is positioned on an internal surface of the case.

59. The computing device of claim 41, wherein the force sensing means comprises a plurality of force sensitive sensors.

60. The computing device of claim 59, wherein at least a portion of the plurality of force sensitive sensors are positioned on a back surface of the case.

61. The computing device of claim 59, wherein at least a portion of the plurality of force sensitive sensors are positioned on each side of the case.

62. The computing device of claim 59, wherein a portion of the plurality of force sensitive sensors are positioned on each side of the case and a portion of the plurality of force sensitive sensors are positioned on each side of the case.

63. The computing device of claim 41, further comprising means for applying a condition-specific weighting factor to the correlation values.

64. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor to perform operations comprising:

receiving an electrical signal from a force sensitive sensor;

comparing the received electrical signal to each of a plurality of reference signal templates;

calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates;

determining a best match reference signal template for the received electrical signal based on the cross-correlation values;

identifying a functionality associated with the best match reference signal template; and

implementing the identified functionality.

65. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured such that implementing the identified functionality on the computing device comprises:

generating a user input event notification; and

forwarding the user input event notification to an application executing on the processor.

66. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to receive electrical signals from a piezoelectric sensor.

67. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are to configured cause a processor to perform operations further comprising:

filtering the received electrical signal for electromagnetic interference;

converting the received electrical signal from analog to digital format;

normalizing the received electrical signal in at least one of frequency and amplitude; and

identifying a portion of the received electrical signal to compare with the reference signal template.

68. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to cause a processor to perform operations further comprising converting the received electrical signal from the force sensitive sensor into frequency domain data,

wherein the reference signal template is a frequency domain template, and

wherein the processor is configured with processor-executable instructions such that comparing the received electrical signal with the reference signal template comprises comparing the sensor signal frequency domain data to the reference frequency domain template.

69. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured such that calculating cross-correlation values of the received electrical signal and each of the plurality of reference signal templates comprises:

calculating cross-correlation values of a portion of the received electrical signal and each of a plurality of reference signal template.

70. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured such that comparing the received electrical signal with a reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

converting at least a portion of the received electrical signal into a frequency domain signal portion;

calculating cross-correlation values of the frequency domain portion and each of a plurality of reference templates;

determining a best correlation value; and

determining whether the correlation value is above a threshold value.

71. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured such that comparing the received electrical signal with the reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

performing a hidden Markov model test on the received electrical signal from the force sensitive sensor.

72. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured such that comparing the received electrical signal with the reference signal template, and determining whether the received electrical signal matches the reference signal template comprises:

calculating one or more signal vectors characterizing the received electrical signal from the force sensitive sensor;

accessing a reference vector characterizing the reference signal;

calculating a cosine value based on the received signal vector and the accessed reference vector; and

determining whether the calculated cosine value is less than a threshold value.

73. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to cause a processor to perform operations further comprising receiving a sensor input from another sensor, wherein the stored processor-executable instructions are configured such that identifying a functionality associated with the best match reference signal template comprises identifying a functionality associated both with the best match reference signal template and the sensor input received from the other sensor.

74. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to cause a processor to perform operations further comprising detecting a change in temperature based on the received electrical signal from the force sensitive sensor.

75. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to cause a processor to perform operations further comprising:

receiving a user identified functionality to be associated with a user input gesture;

prompting the user to perform the user input gesture;

receiving electrical signals from the force sensitive sensor;

processing the received electrical signals from the force sensitive sensor in order to generate a user-generated reference signal template; and

storing the user-generated reference signal template in the memory in conjunction with the received user identified functionality.

76. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to be performed by a processor of a mobile device.

77. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to be performed by a processor of a tablet computing device.

78. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to cause a processor to perform operations further comprising determining when a signal from a force sensor ceases, wherein implementing the identified functionality on the computing device is initiated when the signal from the force sensor ceases.

79. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are configured to cause a processor to perform operations further comprising determining when a low battery power condition exists, wherein implementing the identified functionality on the computing device comprises initiating a telephone call in a minimum power state.

80. The non-transitory processor-readable storage medium of claim 64, wherein the stored processor-executable instructions are to configured cause a processor to perform operations further comprising applying a condition-specific weighting factor to the correlation values.