System and method for motion capture

• US 8,421,854 B2
• Filed: 07/24/2009
• Issued: 04/16/2013
• Est. Priority Date: 07/24/2008
• Status: Expired due to Fees

• Current Assignee: Noah Zerkin
• Original Assignee: Noah Zerkin
• Inventors: Zerkin, Noah
• Primary Examiner(s): Nguyen, Tammy
• Assistant Examiner(s): BUI, JONATHAN A
• Application Number:
  US12/509,248
• Publication Number:
  US 20100110169A1
• Time in Patent Office: 1,362 Days
• Field of Search: 348/77, 600/595
• US Class Current: 348/77
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/1071 measuring angles, e.g. using goniometers A61B5/1123 takes precedence
• CPC Class Codes: A61B 5/1121 Determining geometric values, e.g. centre of rotation or angular range of movement
• CPC Class Codes: A61B 5/4528 Joints A61B5/4533, A61B5/4538 take precedence
• CPC Class Codes: A61B 5/6806 Gloves
• CPC Class Codes: A61B 5/6824 Arm or wrist

Abstract

A motion capture device provided for capturing motion of a limb having two sections, connected by a flexing joint. A sensor array is mounted to a first section of a limb, having at least one gyroscopic sensor element and at least one accelerometer. A sensor for attachment across the flexible joint is coupled to the sensor array and extends away from the sensor array across the flexing joint to a second section of the limb, where the location and motion of the limb is captured by a combination of data obtained from the at least one gyroscopic sensor element and at least one accelerometer of the sensor array and the sensor for said flexible joint.

Claims

1. A motion capture device, for capturing motion of an arm having two sections, connected by an elbow joint, said device comprising:

a sensor array mounted to a first section of an arm, said sensor array having at least one gyroscopic sensor element and at least one accelerometer; and

a sensor for attachment across the elbow joint, coupled to said sensor array and extending away from said sensor array across said elbow joint to a second section of said arm, wherein a combination of data obtained from said at least one gyroscopic sensor element and at least one accelerometer of said sensor array and said sensor for said elbow joint are configured to determine the location and motion of the arm including the lateral circular paths (diameter and relative vertical position), about a shoulder joint of said arm, on which said elbow joint and a corresponding hand are located, and their rotational position on these paths,

such device being further configured to;

i) determine the length and angle of a line drawn directly from the hand to the shoulder, assuming that the hand is positioned directly in front of the shoulder,

ii) determine rotation of said elbow joint about said line drawn directly from the hand to the shoulder using the tilt of the arm segment measured on the axis perpendicular to the axial plane of arm flex; and

iii) cumulatively determine lateral rotation of the arm about said shoulder joint using said lateral circular paths from said combination of data obtained from said at least one gyroscopic sensor element and at least one accelerometer of said sensor array.

2. The motion capture device as claimed in claim 1, further comprising a plurality of sensor arrays on said first section of said arm.

3. The motion capture device as claimed in claim 1, wherein said accelerometer is a multi-axis accelerometer.

4. The motion capture device as claimed in claim 3, wherein said accelerometer is used to determine the orientation (pitch and roll) of the arm segment on which said sensor array is positioned.

5. The motion capture device as claimed in claim 1, wherein said gyroscopic sensor element is selected from the group consisting of a two- or three-axis gyroscopic sensors.

6. The motion capture device as claimed in claim 1, wherein readings from said gyroscopic sensor and said accelerometer are processed through a Kalman Filter for jitter-elimination by means of covariance matrix, and for automatic un-biasing of said gyroscopic sensor.

7. The motion capture device as claimed in claim 1, wherein said sensor for attachment across the elbow joint is selected from the group consisting of flex sensors, rotary potentiometers or other sensors capable of measuring the flex of said elbow joint.

8. The motion capture device as claimed in claim 1, wherein said sensor array is implemented into a single circuit board.

9. The motion capture device as claimed in claim 8, wherein said circuit board employs an integrated means of wireless communication for wireless communication between said device and a host computer.

10. The motion capture device as claimed in claim 1, further comprising a glove connected to said sensor array in order to further include finger movements to augment the motion capture data collected by said device.

11. The motion capture device as claimed in claim 1, said device configured to interpret the data collected by said sensors of said device, where the 3D coordinates of the elbow joint and a wrist joint, relative to the shoulder joint connecting the arm to the body, is derived, according to accelerometer axis tilt values using the standard formula

xTilt=a tan 2(x,sqrt(y*y+z*z));

yTilt=a tan 2(y,sqrt(x*x+z*z)); and

zTilt=a tan 2(z,sqrt(y*y+x*x))

assuming that the z-axis of accelerometer is parallel to the length of the forearm (segment B lower arm);

assuming that the y-axis is parallel to the axis of flex of the elbow;

assuming that the x-axis is perpendicular to the z- and y-axes;

assuming that the length of the upper-arm and the length of the forearm are approximately equal lengths A; and

assuming the reading from flexible sensor across the elbow gives us its angle of flex θ

, wherein.

12. The motion capture device as claimed in claim 11, wherein said device is configured to derive the 3D coordinates of the elbow joint and the wrist joint, relative to the shoulder joint connecting the arm to the body, by calculating the length of a line H drawn between the shoulder and the wrist is equal to:

2(sin(θ

/2)×

A

and, the distance R from the elbow to the line H is equal to;

cos(θ

/2)×

A

wherein an angle psi of a line is determined, relative to the horizontal plane, drawn between the shoulder and the wrist, by the following formula;

zTilt−

a tan((cos(yTilt)×

cos(θ

/2)*A)/(sin(θ

/2)×

A)).

13. The motion capture device as claimed in claim 12, wherein said device is configured to deriving the 3D coordinates of the elbow joint and the wrist joint, relative to the shoulder joint connecting the limb to the body

by calculating that the distance F from the elbow to a horizontal plane rotated around the axis perpendicular to said line drawn between the shoulder and wrist, so as to lay parallel to this line, is equal to:

cos(yTilt)×

R; and

by calculating that the distance V from the shoulder to the hand, on the y-z plane of the environment (disregarding lateral displacement along the x-axis) is equal to;

√

(F2+0.5H2)

such that

elbowX=cos(psi−

a tan(V/0.5H))×

V

elbowY=sin(psi−

a tan(V/0.5H))×

V

elbowZ=sin(yTilt)×

R

so as to determine the location of limb, within a two dimensional plane.

14. The motion capture device as claimed in claim 13, wherein wherein said device is configured to derive the 3 D coordinates of the elbow joint and the wrist joint, relative to the shoulder joint connecting the limb to the body by using data from the accelerometer (X, Y, Z tilt) and from the flex sensor (θ

), supplemented by gyroscopic data input in at least the two dimensions perpendicular to the length of the forearm member, where

gx=radians(map(gxRaw,gxZero,gxZero+gyroScaleX,0,90));

and gy=radians(map(gyRaw,gyZero,gyZero+gyroScaleY,0,90)).

15. A motion capture device, for capturing motion of a leg having two sections, connected by a knee joint, said device comprising:

a sensor array mounted to a first section of a leg, said sensor array having at least one gyroscopic sensor element and at least one accelerometer; and

a sensor for attachment across the knee joint, coupled to said sensor array and extending away from said sensor array across said knee joint to a second section of said leg, wherein a combination of data obtained from said at least one gyroscopic sensor element and at least one accelerometer of said sensor array and said sensor for said knee joint are configured to determine the location and motion of the leg including the lateral circular paths (diameter and relative vertical position), about a hip joint of the leg, on which said knee joint and a corresponding foot are located, and their rotational position on these paths,

such device being further configured to;

i) determine the length and angle of a line drawn directly from the foot to the hip join, assuming that the foot is positioned directly in front of the hip,

ii) determine rotation of said elbow joint about said line drawn directly from the foot to the hip using the tilt of the leg segment measured on the axis perpendicular to the axial plane of leg flex; and

iii) cumulatively determine lateral rotation of the leg about said hip joint using said lateral circular paths from said combination of data obtained from said at least one gyroscopic sensor element and at least one accelerometer of said sensor array.