Motion analysis system

• US 5,459,793 A
• Filed: 09/02/1992
• Issued: 10/17/1995
• Est. Priority Date: 01/24/1990
• Status: Expired due to Term

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Naoi, Satoshi, Ozaki, Tohru
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): Tran, Phuoc
• Application Number:
  US07/939,837
• Time in Patent Office: 1,140 Days
• Field of Search: 382/17, 382/18, 382/1, 358/105, 358/107, 358/108, 358/228, 358/213.19, 364/551.01, 364/413.01, 364/410, 348/157, 348/363, 348/365, 348/154, 348/155, 348/169, 348/171, 348/172
• US Class Current: 382/165
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188
• CPC Class Codes: H04N 9/74 for obtaining special effects H04N9/65 - H04N9/73 take precedence

Abstract

A motion analysis system utilizing an image processing technique includes a color marker attached to an object which is to be analyzed. Each color marker has a high directivity reflective member on a surface thereof, and the reflection member reflects light having a particular wavelength. A light source generates light for irradiation onto the color marker. A color TV camera aligned in roughly the same direction as that of the light source receives reflected light from the color marker and outputs a color image. A color extraction unit connected to the TV camera, extracts only a particular color from the color image produced by the TV camera. An area calculation unit connected to the color extraction unit, calculates the area of the particular color extracted by the color extraction unit. A diaphragm adjustment unit connected between the TV camera and the area calculation unit adjusts the diaphragm of the TV camera so as to make the area calculated by the area calculation unit equivalent to the actual color area of the color marker and a center of gravity calculation unit connected to the area calculation unit, calculates a position of the center of gravity of the particular color based on the area calculated by the area calculation unit.

Claims

1. A motion analysis system comprising:

at least one color marker attached to an object to be analyzed, the at least one color marker having a high directivity reflective member on a surface of the at least one color marker, and the high directivity reflective member reflecting light of a particular color;

a light source for generating light to be irradiated onto at least one color marker;

a stationary color TV camera aligned in approximately the same direction as the light source, for receiving light of the particular color reflected from the at least one color marker and outputting a color image;

a color extraction means operatively coupled to the stationary color TV camera, for extracting the particular color from the color image produced by the stationary color TV camera;

area calculation means operatively coupled to the color extraction means, for calculating an area of the particular color extracted by the color extraction means;

diaphragm adjustment means operatively coupled between the stationary color TV camera and the area calculation means, for adjusting a diaphragm of the stationary color TV camera so as to adjust an amount of light of the particular color reflected from the at least one color marker entering the stationary color TV camera so that the area calculated by the area calculation means coincides with an actual color area of the at least one color marker; and

center of gravity calculation means operatively coupled to the area calculation means, for calculating a position of a center of gravity of the particular color based on the area calculated by the area calculation means.

2. A motion analysis system as claimed in claim 1, wherein said at least one color marker is formed as a spherical body having the high directivity reflective member attached on the surface of said at least one color marker.

3. A motion analysis system as claimed in claim 1, wherein said at least one color marker is formed by a polygonal body having the high directivity reflective member attached on the surface of said at least one color marker.

4. A motion analysis system as claimed in claim 1, wherein said color extraction means comprises a look-up table for a data conversion from an R, G, B signal to a particular color bit, the R, G, B signal being input from the stationary color TV camera through an analog-to-digital converter.

5. A motion analysis system as claimed in claim 4, wherein said look-up table outputs a bit "1" when the particular color indicating a color of the color marker is detected, and outputs a bit "0" when another color is detected.

6. A motion analysis system as claimed in claim 1, wherein said area calculation means comprises a particular color extraction circuit, and a projection amount calculation circuit for calculating the area of the particular color obtained by adding values of pixels for each row and column of the color image.

7. A motion analysis system as claimed in claim 1, wherein said center of gravity calculation means comprises:

a digital signal processor associated with a host computer, the digital signal processor having section decision means for determining a section width for a calculation of the center of gravity in accordance with a size of the object, section projection calculation means for calculating a projection amount in a section by adding values of pixels for each row and column of the section, section selection means for selecting the section corresponding to a maximum projection amount, and section center of gravity calculation means for calculating the center of the gravity at a selected section.

8. A motion analysis system as claimed in claim 7, wherein said digital signal processor further comprises an external random access memory (RAM), the external RAM storing a horizontal projection value, a vertical projection value, a projection valid section, a section width, a maximum section projection, and a position of the center of gravity.

9. A motion analysis system as claimed in claim 1, wherein the at least one color marker includes two or more color markers having mutually different respective colors with respective predetermined wavelength ranges.

10. A method for adjusting a diaphragm of a color TV camera and for determining an effective image center of an object represented by object data associated with a color marker, included within a plurality of image data, comprising the steps of:

a) dividing the plurality of image data into a plurality of columns of image data and a plurality of rows of image data;

b) calculating an amount of object data included within each of the plurality of columns of image data and each of the plurality of rows of image data by adding values of the image data, to provide a plurality of respective vertical projection values and a plurality of respective horizontal projection values;

c) dividing the plurality of vertical projection values and the plurality of horizontal projection values into a plurality of sections;

d) summing the plurality of vertical projection values and the plurality of horizontal projection values for each of the plurality of sections to provide a plurality of respective section projection values;

e) determining a maximum of the plurality of respective section projection values;

f) selecting one of the plurality of sections as a selected section, based on the maximum;

g) determining a sum of the object data by adding the values of the image data for all rows and columns;

h) comparing the sum with a predetermined object area; and

i) adjusting the diaphragm of the color TV camera, based on said step (h).

11. A method as claimed in claim 10, further comprising the steps of:

g) multiplying the plurality of vertical projection values by respective ones of a plurality of columns numbers to provide a plurality of respective weighted vertical projection values for the selected section;

h) multiplying the plurality of horizontal projection values by respective ones of a plurality of row numbers to provide a plurality of respective weighted horizontal projection values for the selected section; and

i) dividing the plurality of respective weighted horizontal projection values and the plurality of respective weighted vertical projection values by the amount of object data to provide a Y center and an X center, respectively.

12. A method as claimed in claim 10, further comprising the steps of:

j) adjusting a size of the plurality of sections so that image data corresponding to the object is entirely included within one of the plurality of sections.

13. A method as claimed in claim 10, further comprising the steps of:

j) dividing the plurality of sections into a first plurality of sections and a second plurality of sections, and repeating said steps (d) through (f) for each of the first and second plurality of sections.

14. A method for generating data corresponding to an object subject to movement, comprising the steps of:

a) attaching a marker capable of producing a reflected light of a predetermined wavelength range, to an object;

b) irradiating the object with a light;

c) receiving a light image including the object and the reflected light from the marker with a stationary light receiver;

d) converting the light image into an electronic signal including data;

e) extracting data corresponding to the predetermined wavelength range from the electronic signal;

f) calculating an area of the predetermined wavelength range based on the data corresponding to the predetermined wavelength range;

g) comparing the area of the predetermined wavelength range with a predetermined area to provide a result; and

h) adjusting a diaphragm of the stationary light receiver based on the result so as to adjust an amount of light in the light image entering the stationary light receiver.

15. A method as claimed in claim 14, wherein said steps (c)-(h) are repeatedly executed.

16. A method as claimed in claim 14, further comprising the steps of:

(i) generating a display based on the data.

17. A method as recited in claim 16, wherein said steps (c)-(i) are repeatedly executed.

18. A motion analysis system comprising:

at least one color marker attached to an object to be analyzed, the at least one color marker having a high directivity reflective member on a surface of the at least one color marker, and the high directivity reflective member reflecting light of a particular color;

a light source for generating light to be irradiated onto at least one color marker;

a stationary color TV camera aligned in approximately the same direction as the light source, for receiving light of the particular color reflected from the at least one color marker and outputting a color image;

a color extraction means operatively coupled to the stationary color TV camera, for extracting the particular color from the color image produced by the stationary color TV camera;

area calculation means operatively coupled to the color extraction means, for calculating an area of the particular color extracted by the color extraction means;

diaphragm adjustment means operatively coupled between the stationary color TV camera and the area calculation means, for adjusting a diaphragm of the stationary color TV camera so as to adjust an amount of light of the particular color reflected from the at least one color marker entering the stationary color TV camera so that the area calculated by the area calculation means coincides with an actual color area of the at least one color marker;

center of gravity calculation means operatively coupled to the area calculation means, for calculating a position of a center of gravity of the particular color based on the area calculated by the area calculation means;

said center of gravity calculation means comprising a digital signal processor associated with a host computer, the digital signal processor having section decision means for determining a section width for a calculation of the center of gravity in accordance with a size of the object, section projection calculation means for calculating a projection amount in a section by adding values of pixels for each row and column of the section, section selection means for selecting the section corresponding to a maximum projection amount, and section center of gravity calculation means for calculating the center of the gravity at a selected station; and

said section selection means providing two kinds of sections, and selecting one of the two kinds of the sections so as to include the object within one section.

19. A motion analysis system comprising:

at least one color marker attached to an object to be analyzed, the at least one color marker having a high directivity reflective member on a surface of the at least one color marker, and the high directivity reflective member reflecting light of a particular color;

a light source for generating light to be irradiated onto at least one color marker;

a stationary color TV camera aligned in approximately the same direction as the light source, for receiving light of the particular color reflected from the at least one color marker and outputting a color image;

a color extraction means operatively coupled to the stationary color TV camera, for extracting the particular color from the color image produced by the stationary color TV camera;

area calculation means operatively coupled to the color extraction means, for calculating an area of the particular color extracted by the color extraction means;

diaphragm adjustment means operatively coupled between the stationary color TV camera and the area calculation means, for adjusting a diaphragm of the stationary color TV camera so as to adjust an amount of light of the particular color reflected from the at least one color marker entering the stationary color TV camera so that the area calculated by the area calculation means coincides with an actual color area of the at least one color marker;

center of gravity calculation means operatively coupled to the area calculation means, for calculating a position of a center of gravity of the particular color based on the area calculated by the area calculation means;

said center of gravity calculation means comprising a digital signal processor associated with a host computer, the digital signal processor having section decision means for determining a section width for a calculation of the center of gravity in accordance with a size of the object, section projection calculation means for calculating a projection amount in a section by adding values of pixels for each row and column of the section, section selection means for selecting the section corresponding to a maximum projection amount, and section center of gravity calculation means for calculating the center of the gravity at a selected station; and

said section selection means enlarging a section width so as to completely include the object within one section when the object is found to be included in two sections.