Motion capture pointer with data fusion

• US 9,261,980 B2
• Filed: 06/26/2009
• Issued: 02/16/2016
• Est. Priority Date: 06/27/2008
• Status: Active Grant

• Current Assignee: Commissariat a L'Energie Atomique (French Alternative Energies and Atomic Energy Commission), Movea
• Original Assignee: Commissariat a L'Energie Atomique (French Alternative Energies and Atomic Energy Commission), Movea
• Inventors: Caritu, Yanis, Flament, Bruno, Vassilev, Andrea, Bassompiere, Cindy
• Primary Examiner(s): Olson, Jason
• Assistant Examiner(s): Abebe, Sosina
• Application Number:
  US13/001,307
• Publication Number:
  US 20110199298A1
• Time in Patent Office: 2,426 Days
• Field of Search: 345156-169
• US Class Current: 1/1
• CPC Class Codes: G01C 21/183 Compensation of inertial measurements, e.g. for temperature effects
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

The invention applies to a pointing device of a mobile element, for example a cursor, on a plane surface. The pointing device comprises a first sensor for measuring the angular rates of the device and a second sensor of the linear accelerations along three dimensions of said device. Preferably, the first sensor is a two-axis or three-axis gyrometer and the second sensor is a three-axis accelerometer. The invention makes it possible to render the movements of the mobile element in the surface of the orientation in which the pointing device is held by its user. This result is achieved by global resolution of the angles of torsion by combining the measurements of the first and second sensors either within an extended Kalman filter or by application of an optimization criterion. The invention also provides a method for estimating the parameters which characterize motion and/or orientation of an object in space from said combination of the measurements of the first and second sensors either within an extended Kalman filter or by application of an optimization criterion.

Claims

1. A pointing device for pointing by a user at a mobile element in a plane surface comprising a reference frame, said pointing device comprising:

at least one first sensor for measuring angular velocities (ω

_Y, ω

_Z) of said pointing device about at least two orthogonal axes (Y, Z) of the pointing device;

at least one second sensor for measuring linear accelerations (a_X, a_Y, a_Z) of said pointing device in relation to said two axes (Y, Z) and a third orthogonal axis (X); and

a module for computing displacements (dy, dz) to be imparted to the mobile element in the plane surface as a function of rotations of the pointing device in space, said computation module comprising a sub-module for compensating for torsion imparted to the pointing device by implementing a data fusion algorithm, wherein said data fusion algorithm is configured for;

i) receiving as input at least measurements by the first sensor of angular velocities (ω

_Y, ω

_Z) and by the second sensor of linear accelerations (a_X, a_Y, a_Z); and

ii) estimating from said measurements a state vector comprising variables representative of a torsion imparted to the pointing device relative to a horizontal plane of a reference frame of the user and further providing at least angular velocities (ω

_v, ω

_w) of the pointing device in the reference frame of the user which provide torsion-compensated displacements (dy, dz) of the mobile element in the reference frame of the plane surface of the mobile element.

2. The pointing device of claim 1, wherein the first sensor is a two-axis gyrometer.

3. The pointing device of claim 1, wherein the first sensor is a three-axis gyrometer.

4. The pointing device of claim 3, wherein the angular velocities (ω

_v, ω

_w) in the reference frame of the user are computed from the first sensor angular velocities, using the variables representative of a torsion.

5. The pointing device of claim 1, wherein the second sensor is a three-axis accelerometer producing outputs (a_X, a_Y, a_Z).

6. The pointing device of claim 1, wherein the data fusion algorithm implements a Kalman filter.

7. The pointing device of claim 6, wherein the Kalman filter satisfies at least one of the following conditions:

a state vector (x) of the Kalman filter comprises at least one angle of torsion (θ

, ψ

) of the pointing device;

a state model comprises at least an expression for an angular rate (ω

) of said pointing device as a function of at least one of the angles of torsion (θ

, ψ

); and

a measurements vector of the Kalman filter comprises at least the outputs of the second sensor (a_X, a_Y, a_Z).

8. The pointing device of claim 7, wherein the state vector of the Kalman filter is initialized to a state [θ

₀ ψ

₀] chosen a priori and in that an a priori estimation of the state vector ({circumflex over (x)}_k⁻

) in a Kalman filter sampling step k is computed through the following formula;

9. The pointing device of claim 7, wherein an a priori estimation of the measurements (ŷ

_k⁻

) in a Kalman filter sampling step k is computed through the following formula;

10. The pointing device of claim 7, wherein a gain G of the Kalman filter is computed through the following formula:

11. The pointing device of claim 7, wherein a correction of the state estimated a priori in a Kalman filter sampling step k is computed through the following formula:

12. The pointing device of claim 7, wherein the components ω

_v and ω

_w of the angular rate in the reference frame of the user are computed through the following formula;

13. The pointing device of claim 7, wherein the Kalman filter satisfies at least one of the following conditions:

a matrix P₀ of confidence accorded to an initial value of a state (x₀) comprises chosen values of an order of 10<sup>−

2</sup>;

a matrix Q of confidence accorded to the state model comprises chosen values, a highest of which are greater than a standard deviation of a noise of the measurements of the first sensor;

a matrix R of confidence accorded to a measurement model of the Kalman filter comprises chosen values, a highest of which are greater than a standard deviation of noise of the measurements of the second sensor.

14. The pointing device of claim 6, wherein the Kalman filter satisfies at least one of the following conditions:

a state vector (x) of the Kalman filter is a quaternion of a form [cos α

/2, sin α

/2 u₁, sin α

/2 u₂, α

/2 u₃];

a state model of the Kalman filter is of the form;

15. The pointing device of claim 14, wherein the components ω

_v and ω

_w of an angular rate in the reference frame of the user are computed through the following formula;

16. The pointing device of claim 6, wherein the Kalman filter satisfies at least one of the following conditions:

a state vector (x) of the Kalman filter is of a form [a, b, c, d]=[sin θ

, cos θ

, sin ψ

, cos ψ

];

a state model of the Kalman filter is of the form;

17. The pointing device of claim 16, wherein the components ω

_v and ω

_w of an angular rate in the reference frame of the user are computed through the following formula;

18. The pointing device of claim 6, wherein a state vector of the Kalman filter (x) is of a form [θ

, ψ

, ω

_u, ω

_v, ω

_w] and in that a measurements vector of the Kalman filter is of a form [a_X, a_Y, a_Z, ω

_X, ω

_Y, ω

_Z].

19. The pointing device of claim 18, wherein a state model of the Kalman filter is of a form:

20. The pointing device of claim 1, wherein the data fusion algorithm implements an optimal resolution procedure.

21. The pointing device of claim 20, wherein the optimal resolution procedure is an optimization having as criterion a function:

22. The pointing device of claim 1, wherein the state vector further comprises the angular velocities (ω

_v, ω

_w) in the reference frame of the user.

23. A method for controlling displacements of a mobile element in a plane surface using a freely moveable object in three-dimensional space, said object being equipped with at least one first sensor for measuring angular velocities (ω

_Y, ω

_Z) of said object about at least two of orthogonal axes (Y, Z) of the object and at least one second sensor for measuring linear accelerations of said object in relation to said two axes (Y, Z) and a third orthogonal axis (X), the method comprising, by a processor carrying out instructions of a data fusion algorithm for performing the steps of;

i) receiving as input at least measurements by the first sensor of angular velocities (ω

_Y, ω

_Z) and by the second sensor of linear accelerations (a_X, a_Y, a_Z); and

ii) estimating from said measurements a state vector comprising variables representative of a torsion imparted to the object relative to a horizontal plane of a reference frame of the user and further providing at least angular velocities (ω

_v, ω

_w) of the object in the reference frame of the user which provide torsion-compensated displacements (dy, dz) of the object in the plane surface.