Grip force sensor array for one-handed and multimodal interaction on handheld devices and methods

• US 9,575,557 B2
• Filed: 04/19/2013
• Issued: 02/21/2017
• Est. Priority Date: 04/19/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Tartz, Robert S., Farley, Richard O., Dumstorff, Clayton G., King, Jay S.
• Primary Examiner(s): Boyd, Jonathan
• Application Number:
  US13/866,502
• Publication Number:
  US 20140317722A1
• Time in Patent Office: 1,404 Days
• Field of Search: 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Aspects of the disclosure relate to a handheld device equipped with arrays of force sensors located along both sides of the device that can provide a novel user interface for operating the device. The sensors can be configured to recognize various grip patterns, gestures, and biometric information of a user operating the device. Using the arrays of force sensors in addition to a touchscreen, a new paradigm for operating a handheld device is provided.

Claims

1. A handheld device comprising:

a display;

a processor; and

a first array of force sensors operatively coupled to the processor, and positioned along a first edge of the handheld device, the first array being configured to detect a grip pattern,

wherein the processor is configured to;

associate the detected grip pattern with a user input to an application that the user is interacting with;

quantify the grip pattern in accordance with a magnitude of a grip force applied by the user;

select a target on the display based on the magnitude of the grip force; and

dynamically reconfigure the association between the detected grip pattern and the user input based on an interaction between the user and the application.

2. The handheld device of claim 1, wherein the processor is further configured to:

compare the grip pattern with biometric data, wherein the biometric data comprise a user specific grip pattern; and

authenticate a user based on the comparison.

3. The handheld device of claim 1, wherein the processor is further configured to perform a user interface operation corresponding to the detected grip pattern.

4. The handheld device of claim 1, wherein a distance between adjacent sensors of the first array is substantially equal to or smaller than a width of a finger of a user.

5. The handheld device of claim 1, wherein the processor is further configured to detect a number of the force sensors gripped by a user.

6. The handheld device of claim 5, wherein the processor is further configured to identify one or more force sensors gripped by the user among the first array of force sensors.

7. The handheld device of claim 1, wherein the processor is further configured to determine a time duration corresponding to each of the force sensors being gripped.

8. The handheld device of claim 1, further comprising

a second array of force sensors positioned along a second edge of the handheld device opposite to the first edge of the handheld device, and operatively coupled to the processor, the second array being configured to detect a grip pattern, and

wherein the processor is further configured to perform a user interface operation corresponding to the grip pattern detected by the second array.

9. The handheld device of claim 1, further comprising:

a mobile communications device; and

a sleeve for receiving at least a portion of the mobile communications device therein,

wherein the first array of force sensors is integrally formed along an edge of the sleeve.

10. The handheld device of claim 1, wherein each force sensor of the first array has a curvature substantively conforming to a shape of the handheld device.

11. The handheld device of claim 1,

wherein the first array comprises:

a flexible circuit comprising

a first portion extending in a first direction along the edge of the handheld device; and

a plurality of finger portions extending from the first portion in a second direction substantially perpendicular to the first direction, and

wherein the force sensors comprise a plurality of pressure sensors, each of the pressure sensors being positioned at an end of a corresponding one of the finger portions, spaced apart from the first portion of the flexible circuit.

12. The handheld device of claim 1, wherein the processor is configured to associate the grip pattern detected by the first array with a user input to the handheld device.

13. The handheld device of claim 12, wherein the grip pattern comprises position information and grip force magnitude information detected by the force sensors.

14. The handheld device of claim 12, wherein the grip pattern corresponds to a call handling function of the handheld device.

15. The handheld device of claim 12, wherein the grip pattern corresponds to a menu or list handling function of the handheld device.

16. The handheld device of claim 12, wherein the grip pattern corresponds to a locking or unlocking function of the handheld device.

17. The handheld device of claim 1,

wherein the first array is configured to manipulate an object displayed on the display.

18. The handheld device of claim 1, further comprising

a touchscreen display,

wherein the first array is configured to function in coordination with the touchscreen display to provide a two-handed interface with the handheld device.

19. The handheld device of claim 18, further comprising

a matrix of force sensors on a side of the handheld device opposite the touchscreen display,

wherein the matrix of force sensors are configured to function in coordination with the touchscreen display to provide a user interface for the handheld device.

20. The handheld device of claim 1, further comprising:

a plurality of force concentrators configured to move substantially independently from each other, wherein the first array of force sensors are respectively located at positions corresponding to the force concentrators.

21. The handheld device of claim 1, wherein the processor is further configured to dynamically reconfigure the association by:

individually activating or inactivating one or more force sensors of the first array depending on the interaction.

22. A method for operating a handheld device, comprising:

utilizing a first array of force sensors positioned along a first edge of the handheld device, to detect a grip pattern;

associating the detected grip pattern with a user input to an application that the user is interacting with;

quantifying the grip pattern in accordance with a magnitude of a grip force applied by the user;

selecting a target on a display of the handheld device based on the magnitude of the grip force; and

dynamically reconfiguring the association between the detected grip pattern and the user input based on an interaction between the user and the application.

23. The method of claim 22, further comprising:

comparing the grip pattern with biometric data, wherein the biometric data comprise a user specific grip pattern; and

authenticating a user based on the comparison.

24. The method of claim 22, further comprising performing a user interface operation corresponding to the detected grip pattern.

25. The method of claim 22, wherein a distance between adjacent sensors of the first array is substantially equal to or smaller than a width of a finger of a user.

26. The method of claim 22, further comprising detecting a number of the force sensors gripped by a user.

27. The method of claim 26, further comprising identifying one or more force sensors gripped by the user among the force sensors.

28. The method of claim 22, further comprising determining a time duration corresponding to each of the force sensors being gripped.

29. The method of claim 22, further comprising:

utilizing a second array of force sensors positioned along a second edge of the handheld device opposite to the first edge, to detect a grip pattern; and

performing a user interface operation corresponding to the grip pattern detected by the second array.

30. The method of claim 22, further comprising associating the grip pattern detected by the first array with a corresponding user input operable on the handheld device.

31. The method of claim 30, wherein the grip pattern comprises position information and grip force magnitude information detected by the force sensors.

32. The method of claim 31, further comprising associating the grip pattern to a call handling function of the handheld device.

33. The method of claim 31, further comprising associating the grip pattern to a menu or list handling function of the handheld device.

34. The method of claim 31, further comprising associating the grip pattern to a locking or unlocking function of the handheld device.

35. The method of claim 22, further comprising utilizing the first array to manipulate an object displayed on the display of the handheld device.

36. The method of claim 22, further comprising utilizing the first array in coordination with a touchscreen display of the handheld device to provide a two-handed interface.

37. The method of claim 36, further comprising utilizing a matrix of force sensors in coordination with the touchscreen display of the handheld device to perform a user interface operation.

38. The method of claim 22, wherein dynamically reconfiguring the association comprises individually activating or inactivating one or more force sensors of the first array depending on the interaction.

39. A handheld device, comprising:

means for utilizing a first array of force sensors positioned along a first edge of the handheld device, to detect a grip pattern;

means for associating the detected grip pattern with a user input to an application that the user is interacting with;

means for quantifying the grip pattern in accordance with a magnitude of a grip force applied by the user;

means for selecting a target on a display of the handheld device based on the magnitude of the grip force; and

means for dynamically reconfiguring the association between the detected grip pattern and the user input based on an interaction between the user and the application.

40. A non-transitory computer-readable medium operable on a handheld device, comprising:

instructions for causing the handheld device to utilize a first array of force sensors positioned along a first edge of the handheld device, to detect a grip pattern;

instructions for causing the handheld device to associate the detected grip pattern with a user input to an application that the user is interacting with;

instructions for quantifying the grip pattern in accordance with a magnitude of a grip force applied by the user;

instructions for selecting a target on a display of the handheld device based on the magnitude of the grip force; and

instructions for causing the handheld device to dynamically reconfigure the association between the detected grip pattern and the user input based on an interaction between the user and the application.