Determining forward pointing direction of a handheld device

• US 9,201,516 B2
• Filed: 06/03/2011
• Issued: 12/01/2015
• Est. Priority Date: 06/03/2010
• Status: Active Grant

• Current Assignee: CEVA Technologies, Inc. (CEVA Incorporated)
• Original Assignee: Hillcrest Laboratories Incorporated (CEVA Incorporated)
• Inventors: Liberty, Matthew G., Cook, Bryan A.
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): MORALES FERNANDE, BENJAMIN
• Application Number:
  US13/701,156
• Publication Number:
  US 20130215019A1
• Time in Patent Office: 1,642 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 17/16 Matrix or vector computation , e.g. matrix-matrix or matrix-vector multiplication, matrix factorization matrix transposition G06F7/78
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

A forward pointing direction associated with a handheld device is estimated or determined by, for example, calculating a center of rotation of the device. A resultant combined or selected bias estimate may then be used to compensate the biased output of the sensor in, e.g., a 3D pointing device.

Claims

1. A device comprising:

an accelerometer for sensing an acceleration of said device and outputting at least one acceleration output associated therewith;

at least one sensor for sensing rotation of said device and outputting at least one angular velocity output associated therewith; and

a processing unit for processing said acceleration output and said at least one angular velocity output to determine a forward pointing direction of said device, wherein the determination of the forward pointing direction of the device is based on a calculation of a center of rotation of said device using the processed acceleration and at least one angular velocity outputs and a gravitational constant.

2. The device of claim 1, wherein said processing comprises converting raw sensor data into International System (SI) unit data.

3. The device of claim 2, wherein said SI unit data is filtered to remove undesirable sensor characteristics comprising at least one of variable bias offset, cross-axis effects, scale variations, non-linearities, temperature effects and aging effects.

4. The device of claim 3, further comprising a radio frequency (RF) transmitter communicatively connected to said processing unit.

5. The device of claim 4, wherein said RF transmitter is configured to transmit said forward direction calculation result to a host machine.

6. The device of claim 4, wherein said RF transmitter is configured to transmit filtered data to a host machine for use by said host machine to determine a forward direction of said device based on a calculation of a center of rotation of said device using said filtered data and a gravitational constant.

7. The device of claim 1,

wherein said calculation uses:

an angular velocity matrix based upon said angular velocity output;

an angular acceleration matrix based upon said angular velocity output;

a direction cosine matrix based upon said angular velocity matrix and said angular acceleration matrix for defining said device frame of reference relative to an earth frame of reference; and

a linear acceleration based on said acceleration output.

8. The device of claim 1, wherein said at least one sensor is a rotational sensor or a gyroscope.

9. The device of claim 1, wherein said at least one sensor is a magnetometer.

10. The device of claim 7, further comprising a magnetometer whose outputs are used to improve calculation of the direction cosine matrix.

11. A method for determining a forward pointing direction of a device, said method comprising:

collecting data, by sensors, associated with said device'"'"'s acceleration and rotation while said device is in motion; and

determining, by a processor, said forward pointing direction of said device based on the collected data,

wherein the determining includes calculating a center of rotation of the device using;

12. The method of claim 11, further comprising:

filtering said data to remove undesirable sensor characteristics.

13. The method of claim 12, wherein said undesirable sensor characteristics comprises at least one of variable bias offset, cross-axis effects, scale variations, non-linearities, temperature effects and aging effects.

14. The method of claim 11, wherein said Omega dot pre-superscript b can be expressed as:

15. The method of claim 11, wherein said Omega pre-superscript b squared can be expressed as:

16. The method of claim 11, wherein multiple calculations of said device'"'"'s center of rotation vector are combined to optimize the center of rotation vector calculation.

17. The method of claim 16 wherein said combining comprises at least one of low-pass filtering, Kalman filtering and Bayesian filtering.

18. The method of claim 11, wherein said center of rotation vector calculation result is offset based on an offset value of an accelerometer, associated with said device, from a center of said device.

19. The method of claim 11, wherein said body frame of reference is adjusted based on calculating said forward direction.

20. The method of claim 11, wherein said forward direction is determined based on averaging the angular position of said device.

21. The method of claim 20, wherein said averaging is dynamically optimized by using a short-term history of said forward direction values.

22. A method for determining a forward pointing direction of a device, said method comprising:

collecting data, by sensors, associated with said device'"'"'s acceleration and rotation while said device is in motion; and

determining, by a processor, said forward pointing direction of said device based on the collected data, wherein the step of determining further comprises calculating a center of rotation of the device and wherein said calculating can be expressed as;

^bc=((^b{dot over (Ω

)}₂+^bΩ

₂²)−

(I+^bΩ

^TΔ

t)(^b{dot over (Ω

)}₁+^bΩ

₁²))<sup>−

1</sup>(^ba₂−

(I+^bΩ

^TΔ

t)^b a₁),

where;

Omega dot pre-superscript b subscript 1 is an angular acceleration matrix of a first sample associated with said device in a body frame of reference, Omega dot pre-superscript b subscript 2 is an angular acceleration matrix of a second sample associated with said device in a body frame of reference, Omega squared pre-superscript b subscript 1 is the square of the angular velocity matrix of said first sample associated with said device in said body frame of reference, Omega squared pre-superscript b subscript 2 is the square of the angular velocity matrix of said second sample associated with said device in said body frame of reference, a pre-superscript b subscript 1 is a linear acceleration of said first sample associated with said device in said body frame of reference, a pre-superscript b subscript 2 is a linear acceleration of said second sample associated with said device in said body frame of reference, Omega pre-superscript b post-superscript T delta t is the average angular velocity between said first sample and said second sample and I is an identity matrix.

23. The method of claim 22 wherein said Omega dot pre-superscript b can be expressed as:

24. The method of claim 22 wherein said Omega pre-superscript b squared can be expressed as:

25. The method of claim 22 wherein multiple calculations of said device'"'"'s center of rotation vector are combined to optimize the center of rotation vector calculation.

26. The method of claim 25 wherein said combining comprises at least one of low-pass filtering, Kalman filtering and Bayesian filtering.

27. The method of claim 22, wherein said body frame of reference is adjusted based on calculating said forward direction.

28. A system for allowing a user to determine a forward direction for a handheld pointing device, said system comprising:

a handheld pointing device comprising;

an accelerometer for sensing an acceleration of said device and outputting at least one acceleration output associated therewith;

a plurality of angular velocity sensors for sensing rotation of said device and outputting at least one angular velocity output associated therewith; and

a processing unit for processing said acceleration output and said at least one angular velocity output and determining a forward direction of said device based on a calculation of a center of rotation of said device using processed outputs and a gravitational constant; and

a host computer comprising;

communication capabilities to said handheld pointing device; and

an output display.

29. The system of claim 28, wherein said handheld device does not have a forward direction specified by design.

30. The system of claim 28, wherein said handheld device transmits results of said calculation to said host computer.

31. The system of claim 30, wherein said host computer adjusts the position of an object on said display based on said calculation.