3D pointing devices and methods

• US 8,766,917 B2
• Filed: 12/10/2012
• Issued: 07/01/2014
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: DRNC Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Hillcrest Laboratories Incorporated (CEVA Incorporated)
• Inventors: Liberty, Matthew G., Simpkins, Daniel S., Gritton, Charles W. K., Turner, Mark, Hunleth, Frank A.
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US13/709,600
• Publication Number:
  US 20130093676A1
• Time in Patent Office: 568 Days
• Field of Search: 345156-169, 345173-179, 178 1801- 1809, 178 1901- 1907
• US Class Current: 345/158
• CPC Class Codes: G06F 1/3215 Monitoring of peripheral devices
• CPC Class Codes: G06F 1/3259 Power saving in cursor control device, e.g. mouse, joystick, trackball
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Systems and methods according to the present invention address these needs and others by providing a handheld device, e.g., a 3D device, which uses at least one sensor to detect motion of the handheld device. The detected motion can then be mapped into a desired output, e.g., cursor movement.

Claims

1. A device comprising:

a first rotational sensor for determining rotation of said device about a first axis and generating a first rotational output associated therewith;

a second rotational sensor for determining rotation of said device about a second axis and generating a second rotational output associated therewith;

an accelerometer for determining an acceleration of said device and outputting an acceleration output associated therewith; and

a processing unit for modifying said first and second rotational outputs based on said acceleration and for generating an output based on said modified first and second rotational outputs,

wherein said first rotational sensor further comprises a first resonating mass attached to a first frame, wherein said first resonating mass in said first rotational sensor resonates relative to said first axis, wherein displacement of said first resonating mass relative to said first axis is measured by said first rotational sensor using the Coriolis acceleration effect to generate said first rotational output.

2. The device of claim 1, wherein said second rotational sensor further comprises:

a second resonating mass attached to a second frame, wherein said second resonating mass in said second rotational sensor resonates relative to said second axis;

wherein displacement of said second resonating mass relative to said second axis is measured by said second rotational sensor using the Coriolis acceleration effect to generate said second rotational output.

3. The device of claim 1, wherein said processing unit modifies said first and second rotational outputs to compensate for linear acceleration of said device.

4. The device of claim 3, wherein said processing unit multiplies a first acceleration detected by said accelerometer along said first axis by a first gain matrix and combines a first result with said first rotational output;

and

multiplies a second acceleration detected by said accelerometer along said second axis by a second gain matrix and combines a second result with said second rotational output.

5. The device of claim 1, wherein said processing unit modifies said first and second rotational outputs to compensate for tilt of said device.

6. The device of claim 5, wherein said processing unit compensates for said tilt by rotating said first and second rotational outputs into an inertial frame of reference of said device.

7. The device of claim 6, wherein said processing unit rotates said first and second rotational outputs into said inertial frame of reference by calculating:

8. The device of claim 3, wherein said processing unit also modifies said first and second rotational outputs to compensate for tilt of said device.

9. The device of claim 8, wherein said processing unit compensates for said tilt by rotating said first and second rotational outputs, after said first and second rotational outputs have been compensated for linear acceleration, into an inertial frame of reference of said device.

10. The device of claim 9, wherein said processing unit rotates said first and second rotational outputs, after said first and second rotational outputs have been compensated for linear acceleration, into said inertial frame of reference by calculating:

11. The device of claim 1, wherein said accelerometer measures acceleration of said device along at least two different axes.

12. A device comprising:

at least one sensor for detecting movement of said device; and

a processing unit for translating movement of said device into an output indicative of said movement and for determining whether said device is stationary based on an output of said at least one sensor, wherein said processing unit transforms said output of said at least one sensor into a frequency domain and analyzes a magnitude of frequency response within a predetermined frequency range to determine whether said device is stationary.

13. The device of claim 12, wherein said at least one sensor further comprises:

a first rotational sensor for determining rotation of said device about a first axis and generating a first rotational output associated therewith;

a second rotational sensor for determining rotation of said device about a second axis and generating a second rotational output associated therewith; and

an accelerometer for determining an acceleration of said device and outputting an acceleration output associated therewith.

14. The device of claim 12, wherein said processor categorizes said device as being one of stationary, stable and active based on said analysis of said frequency response within said predetermined frequency range.

15. The device of claim 13, wherein said processor updates calibration information associated with said at least one sensor when said device has been determined to be stationary for a predetermined time period.

16. The device of claim 15, wherein said processor updates an offset value associated with one or more rotational sensors when said device has been determined to be stationary for a predetermined time period.

17. A device comprising:

a first rotational sensor for determining rotation of said device about a first axis and generating a first rotational output associated therewith;

a second rotational sensor for determining rotation of said device about a second axis and generating a second rotational output associated therewith;

an accelerometer for determining an acceleration of said device and outputting an acceleration output associated therewith; and

a processing unit for modifying said first and second rotational outputs based on said acceleration and for generating an output based on said modified first and second rotational outputs,

wherein said processing unit modifies said first and second rotational outputs to compensate for linear acceleration of said device by multiplying a first acceleration detected by said accelerometer along said first axis by a first gain matrix and combining a first result with said first rotational output and multiplying a second acceleration detected by said accelerometer along said second axis by a second gain matrix and combines a second result with said second rotational output.

18. The device of claim 17, wherein said second rotational sensor further comprises:

a second resonating mass attached to a second frame, wherein said second resonating mass in said second rotational sensor resonates relative to said second axis;

wherein displacement of said second resonating mass relative to said second axis is measured by said second rotational sensor using a Coriolis acceleration effect to generate said second rotational output.

19. The device of claim 17, wherein said processing unit modifies said first and second rotational outputs to compensate for orientation of said device.

20. The device of claim 17, wherein said accelerometer measures acceleration of said device along at least two different axes.

21. A method comprising:

determining rotation of a device about a first axis and generating a first rotational output associated therewith;

determining rotation of said device about a second axis and generating a second rotational output associated therewith;

determining an acceleration of said device and outputting an acceleration output associated therewith; and

modifying said first and second rotational outputs based on said acceleration and generating an output based on said modified first and second rotational outputs by multiplying a first acceleration detected by said accelerometer along said first axis by a first gain matrix and combining a first result with said first rotational output and multiplying a second acceleration detected by said accelerometer along said second axis by a second gain matrix and combines a second result with said second rotational output.

22. The method of claim 21, wherein said determining of rotation about a first axis further comprises:

measuring displacement of a resonating mass relative to said first axis.

23. The method of claim 21, further comprising:

compensating for orientation of said device.

24. The method of claim 21, further comprising:

measuring acceleration of said device along at least two different axes.

25. A device comprising:

a first rotational sensor for determining rotation of said device about a first axis and generating a first rotational output associated therewith;

a second rotational sensor for determining rotation of said device about a second axis and generating a second rotational output associated therewith;

an accelerometer for determining an acceleration of said device and outputting an acceleration output associated therewith; and

a processing unit for modifying said first and second rotational outputs based on said acceleration and for generating an output based on said modified first and second rotational outputs,

wherein said processing unit modifies said first and second rotational outputs to compensate for orientation of said device by rotating said first and second rotational outputs into an inertial frame of reference of said device.

26. The device of claim 25, wherein said second rotational sensor further comprises:

a second resonating mass attached to a second frame, wherein said second resonating mass in said second rotational sensor resonates relative to said second axis;

wherein displacement of said second resonating mass relative to said second axis is measured by said second rotational sensor using a Coriolis acceleration effect to generate said second rotational output.

27. The device of claim 25, wherein said accelerometer measures acceleration of said device along at least two different axes.

28. The device of claim 25, wherein said processing unit also modifies said first and second rotational outputs to compensate for linear acceleration of said device.

29. A method comprising:

determining rotation of a device about a first axis and generating a first rotational output associated therewith;

determining rotation of said device about a second axis and generating a second rotational output associated therewith;

determining an acceleration of said device and outputting an acceleration output associated therewith; and

modifying said first and second rotational outputs based on said acceleration and generating an output based on said modified first and second rotational outputs to compensate for an orientation said device by rotating said first and second rotational outputs into an inertial frame of reference of said device.

30. The method of claim 29, wherein said determining of rotation about a first axis further comprises:

measuring displacement of a resonating mass relative to said first axis.

31. The method of claim 29, further comprising:

measuring acceleration of said device along at least two different axes.

32. The method of claim 29, further comprising:

compensating said output for linear acceleration of said device.

33. A method comprising:

detecting movement of a device;

generating data indicative of said movement;

determining whether said device is stationary based on said data by transforming said data into a frequency domain and analyzing a magnitude of frequency response within a predetermined frequency range to determine whether said device is stationary;

determining rotation of said device about a first axis and generating a first rotational output associated therewith;

determining rotation of said device about a second axis and generating a second rotational output associated therewith; and

determining an acceleration of said device and outputting an acceleration output associated therewith.

34. The method of claim 33, further comprising:

categorizing said device as being one of stationary, stable and active based on said analysis of said frequency response within said predetermined frequency range.

35. The method of claim 33, further comprising:

updating calibration information associated with at least one sensor when said device has been determined to be stationary for a predetermined time period.

36. The method of claim 35, further comprising:

updating an offset value associated with said at least one sensor when said device has been determined to be stationary for a predetermined time period.

37. A device comprising:

a first rotational sensor for determining rotation of said device about a first axis and generating a first rotational output associated therewith;

a second rotational sensor for determining rotation of said device about a second axis and generating a second rotational output associated therewith;

an accelerometer for determining an acceleration of said device and outputting an acceleration output associated therewith; and

a processing unit for receiving said first and second rotational outputs and said acceleration output and for;

(a) determining an orientation of the device relative to an absolute reference, said orientation being determined based upon the acceleration output,

(b) processing at least one of said first rotational output and said second rotational output using said determined orientation; and

(c) determining an unintended motion associated with the device; and

(d) processing at least one of the first rotational output and the second rotational output to compensate for the unintended motion.

38. The device of claim 37, wherein the absolute reference is gravity.

39. The device of claim 37, wherein the unintended motion is hand tremor.

40. The device of claim 37, wherein the unintended motion is associated with a press of a button disposed on the device.

41. The device of claim 37, wherein the processing unit is further configured to convert said first and second rotational outputs from a body frame of reference associated with said device into a user'"'"'s frame of reference in order to remove the effects of said determined orientation.

42. The device of claim 41, wherein said step of converting further comprises the step of:

rotating said first and second rotational outputs into said user'"'"'s frame of reference by calculating;

43. The device of claim 37, wherein said determined orientation is a tilt of the device.

44. A method comprising:

determining rotation of a device about a first axis and generating a first rotational output associated therewith;

determining rotation of said device about a second axis and generating a second rotational output associated therewith;

determining an acceleration of said device and outputting an acceleration output associated therewith; and

receiving, by a processing unit, said first and second rotational outputs and said acceleration output and;

(a) determining an orientation of the device relative to an absolute reference, said orientation being determined based upon the acceleration output,

(b) processing at least one of said first rotational output and said rotational second output using said determined orientation; and

(c) determining an unintended motion associated with the device; and

(d) processing at least one of the first rotational output and the second rotational output to compensate for the unintended motion.

45. The method of claim 44, wherein the absolute reference is gravity.

46. The method of claim 44, wherein the unintended motion is hand tremor.

47. The method of claim 44, wherein the unintended motion is associated with a press of a button disposed on the device.

48. The method of claim 44, further comprising:

converting said first and second rotational outputs from a body frame of reference associated with said device into a user'"'"'s frame of reference in order to remove the effects of said determined orientation.

49. The method of claim 48, wherein said step of converting further comprises the step of:

rotating said first and second rotational outputs into said user'"'"'s frame of reference by calculating;

50. The method of claim 44, wherein said determined orientation is a tilt of the device.