Generating virtual buttons using motion sensors

• US 8,682,606 B2
• Filed: 10/07/2008
• Issued: 03/25/2014
• Est. Priority Date: 10/07/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Horodezky, Samuel Jacob, Yee, Jadine Naomi, Sheynblat, Leonid
• Primary Examiner(s): Lau, Tung S
• Assistant Examiner(s): SUN, XIUQIN
• Application Number:
  US12/246,725
• Publication Number:
  US 20100088061A1
• Time in Patent Office: 1,995 Days
• Field of Search: 702/141, 345/157, 345/173
• US Class Current: 702/141
• CPC Class Codes: G06F 1/1624 with sliding enclosures, e.g. sliding keyboard or display
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

An implementation of a system and method for using sensors such as one or more gyroscopes and/or accelerometers to sense input is provided. For example, one or more of such sensors may be use to provide virtual buttons at various areas on the housing of a mobile device, detect a force against the housing, or to detect relative movement of the mobile device.

Claims

1. A mobile device to detect user selection of one or more virtual buttons, the mobile device comprising:

a housing comprising a first surface area associated with a first virtual button, wherein the first surface area is a subset of the complete surface area of the mobile device;

a first sensor comprising a first axis, wherein the first sensor is configured to generate a first sensor signal, wherein the first sensor signal is indicative of angular movement of the mobile device about the first axis of the first sensor;

a second sensor comprising a first axis, wherein the second sensor is configured to generate a second sensor signal, wherein the second sensor signal is indicative of linear movement of the mobile device along the first axis of the second sensor; and

a processor coupled to access information derived from the first sensor signal and coupled to access data derived from the second sensor signal, and to determine therefrom whether motion of the mobile device indicates user selection of the first virtual button, wherein a minimum sensitivity is needed to determine whether motion of the mobile device indicates user selection of the first virtual button, and wherein the first sensor is positioned at a selected distance and orientation relative to the second sensor, so that a lever arm between the first sensor and the second sensor is greater than or equal to a minimum lever arm associated with the minimum sensitivity.

2. The mobile device of claim 1, wherein the first axis of the first sensor and the first axis of the second sensor are substantially orthogonal to one another.

3. The mobile device of claim 1, wherein the first axis of the first sensor and the first axis of the second sensor are substantially parallel to one another.

4. The mobile device of claim 3, wherein the first axis of the first sensor and the second axis of the first sensor are substantially orthogonal to one another.

5. The mobile device of claim 3, wherein the first sensor further comprises a third axis different from the first axis of the first sensor and the second axis of the first sensor, and wherein the first sensor signal is further indicative of angular movement of the mobile device about the third axis of the first sensor.

6. The mobile device of claim 5, wherein the first axis of the first sensor, the second axis of the first sensor and the third axis of the first sensor are substantially orthogonal to one another.

7. The mobile device of claim 3, wherein the second sensor further comprises a third axis different from the first axis of the second sensor and the second axis of the second sensor, and wherein the second sensor signal is further indicative of linear movement of the mobile device along the third axis of the second sensor.

8. The mobile device of claim 7, wherein the first axis of the second sensor, the second axis of the second sensor and the third axis of the second sensor are substantially orthogonal to one another.

9. The mobile device of claim 1, wherein the first sensor further comprises a second axis different from the first axis of the first sensor, wherein the first sensor signal is further indicative of angular movement of the mobile device about the second axis of the first sensor.

10. The mobile device of claim 1, wherein the first sensor comprises a gyroscope.

11. The mobile device of claim 1, wherein the first sensor comprises an angular accelerometer.

12. The mobile device of claim 1, wherein the second sensor further comprises a second axis different from the first axis of the second sensor, wherein the second sensor signal is further indicative of linear movement of the mobile device along the second axis of the first sensor.

13. The mobile device of claim 1, further comprising a display, and wherein the mobile device is configured to update the display in response to a determination that the motion of the mobile device indicates selection of the first virtual button.

14. The mobile device of claim 1, wherein the second sensor comprises an accelerometer.

15. The mobile device of claim 1, wherein the housing further comprises a maximum linear dimension of the mobile device, and wherein a center of the first sensor and a center of the second sensor are separated by a linear distance greater than half of the maximum linear dimension of the mobile device.

16. The mobile device of claim 1, further comprising a user input interface, wherein the first sensor is positioned between the housing and the user input interface.

17. The mobile device of claim 1, wherein the first sensor is positioned in a first portion of the mobile device and the second sensor is positioned in a second portion of the mobile device, wherein the first portion is vertically displaced from the second portion.

18. The mobile device of claim 1, wherein the first sensor is positioned in a first portion of the mobile device and the second sensor is positioned in a second portion of the mobile device, wherein the first portion is laterally displaced from the second portion.

19. The mobile device of claim 1, wherein the mobile device includes a first board, and wherein the first and second sensors are positioned on the first board.

20. The mobile device of claim 1, wherein the mobile device includes a first board and a second board substantially perpendicular to the first board, and wherein the first sensor is position on the first board and the second sensor is positioned on the second board.

21. A mobile device including one or more virtual buttons, the mobile device comprising:

a first sensing means for generating an output indicative of angular movement of the mobile device about a particular axis;

a second sensing means for generating an output indicative of linear movement of the mobile device along a different axis;

means for processing the output indicative of the angular movement of the mobile device about the particular axis and the output indicative of the linear movement of the mobile device along the different axis to determine therefrom whether motion of the mobile device indicates user selection of a first virtual button of the one or more virtual buttons, wherein a minimum sensitivity is needed to determine whether motion of the mobile device indicates user selection of the first virtual button, and wherein the first sensing means is positioned at a selected distance and orientation relative to the second sensing means, so that a lever arm between the first sensing means and the second sensing means is greater than or equal to a minimum lever arm associated with the minimum sensitivity; and

means for implementing one or more actions based on determining that the motion of the mobile device indicates user selection of the first virtual button.

22. A method in a mobile device of processing user selection of one or more virtual buttons, the method comprising:

detecting angular movement of the mobile device about a first axis of a first sensor using the first sensor;

detecting linear movement of the mobile device along a first axis of a second sensor using the second sensor;

determining that the angular movement of the mobile device and the linear movement of the mobile device indicate user selection of a first virtual button associated with a first surface area of a housing of the mobile device less than the complete surface area of the housing of the mobile device, wherein a minimum sensitivity is needed to determine whether motion of the mobile device indicates user selection of the first virtual button, and wherein the first sensor is positioned at a selected distance and orientation relative to the second sensor, so that a lever arm between the first sensor and the second sensor is greater than or equal to a minimum lever arm associated with the minimum sensitivity.

23. The method of claim 22, further comprising calibrating the first and second sensors, the act of calibrating comprising:

generating an indicator that a user should select the first virtual button;

in response to user response to the indicator, sensing initial angular movement of the mobile device using the first sensor;

sensing initial linear movement of the mobile device using the second sensor;

determining a first threshold based on the initial angular movement;

determining a second threshold based on the initial linear movement; and

storing, in memory, the first threshold and second threshold.

24. The method of claim 22, further comprising calibrating the first sensor, the act of calibrating comprising:

determining stationarity of the device based on information generated by the second sensor;

determining at least one first threshold based on information generated by the first sensor; and

storing, in memory, the at least one first threshold.

25. The method of claim 24, wherein the first threshold is associated with the first axis of the first sensor.

26. The method of claim 25, wherein the first threshold is associated with a temperature value measured by or proximate to the first sensor.

27. The method of claim 26, wherein the first threshold and the temperature value are stored in memory.

28. The method of claim 22, further comprising calibrating the first and second sensors, the act of calibrating comprising:

determining stationarity of the device based on information provided by a user of the mobile device;

determining at least one first threshold based on the information generated by the first sensor; and

storing, in memory, the at least one first threshold.

29. The method of claim 22, wherein the user selection of the first virtual button comprises a tap at the first surface area on the housing of the mobile device.

30. The method of claim 22, wherein the user selection of the first virtual button comprises a plurality of taps at the first surface area on the housing of the mobile device.

31. The method of claim 22, wherein the user selection of the first virtual button comprises a stroke along the first surface area on the housing of the mobile device.

32. The method of claim 22, further comprising determining that the angular movement of the mobile device and the linear movement of the mobile device indicate user selection of a second virtual button associated with a second different surface area of the housing of the mobile device less than the complete surface area of the housing of the mobile device.

33. The method of claim 32, wherein the first surface area and second surface area are on opposite faces of the housing of the mobile device.

34. The method of claim 32, wherein the first surface area and second surface area are on a common face of the housing of the mobile device.

35. A computer-readable product comprising instructions stored on a non-transitory computer-readable medium, wherein the instructions are to cause one or more machines to perform operations comprising:

accessing data indicative of angular motion of a mobile device about one or more axes;

accessing data indicative of linear motion of a mobile device along one or more axes;

processing the data indicative of angular motion and the data indicative of linear motion to determine if user selection of a virtual button is indicated, wherein a minimum sensitivity is needed to determine whether motion of the mobile device indicates user selection of the virtual button, and wherein a first sensor is positioned at a selected distance and orientation relative to a second sensor, so that a lever arm between the first sensor and the second sensor is greater than or equal to a minimum lever arm associated with the minimum sensitivity;

in response to determining that user selection of a virtual button is indicated, generating an output associated with the virtual button.

36. The non-transitory computer readable medium product of claim 35, wherein processing the data indicative of angular motion and the data indicative of linear motion to determine if user selection of a virtual button is indicated comprises comparing the data indicative of angular motion to a first threshold and comparing the data indicative of linear motion to a second threshold.

37. A mobile device comprising:

a defined virtual button area associated with a virtual button, wherein the defined virtual button area is a portion of the surface area of the mobile device less than the complete surface area of the mobile device;

one or more motion sensors included in the mobile device, wherein the one or more sensors are configured to generate a signal indicative of motion of the mobile device; and

control logic to process information based on the signal indicative of the mobile device to determine if the motion of the mobile device indicates selection of the virtual button, wherein a minimum sensitivity is needed to determine whether the motion of the mobile device indicates selection of the virtual button, and wherein a first motion sensor of the one or more motion sensors is positioned at a selected distance and orientation relative to a second motion sensor of the one or more motion sensors, so that a lever arm between the first motion sensor and the second motion sensor is greater than or equal to a minimum lever arm associated with the minimum sensitivity.

38. The mobile device of claim 37, wherein the control logic comprises software, hardware, firmware, or a combination.

39. The mobile device of claim 37, wherein the one or more motion sensors comprise at least one accelerometer and at least one gyroscope.