Method, apparatus and system for recognizing actions
First Claim
1. A recognition system for recognizing motion and/or actions of an object under observation, said recognition apparatus comprising:
- measurement means attached to said object under observation in order to measure a status change entailing the motions and/or actions of said object under observation;
characteristic quantity extraction means for extracting characteristic quantities from the measurements taken by said measurement means;
recognition means for recognizing the motions and/or actions of said object under observation in accordance with the characteristic quantities extracted from said measurements;
output means for outputting a recognized result; and
wherein said characteristic quantity extraction means extracts said characteristic quantities by subjecting said measurements to time-frequency analysis.
3 Assignments
0 Petitions
Accused Products
Abstract
An object of the present invention is to provide a method, an apparatus and a system for automatically recognizing motions and actions of moving objects such as humans, animals and machines. Measuring instruments are attached to an object under observation to measure a status change entailing the object'"'"'s motion or action and to issue a signal denoting the measurements. A characteristic quantity extraction unit extracts a characteristic quantity from the measurement signal received which represents the motion or action currently performed by the object under observation. A signal processing unit for motion/action recognition correlates the extracted characteristic quantity with reference data in a database containing previously acquired characteristic quantities of motions and actions. The motion or action represented by the characteristic quantity with the highest degree of correlation is recognized and output.
423 Citations
29 Claims
-
1. A recognition system for recognizing motion and/or actions of an object under observation, said recognition apparatus comprising:
-
measurement means attached to said object under observation in order to measure a status change entailing the motions and/or actions of said object under observation;
characteristic quantity extraction means for extracting characteristic quantities from the measurements taken by said measurement means;
recognition means for recognizing the motions and/or actions of said object under observation in accordance with the characteristic quantities extracted from said measurements;
output means for outputting a recognized result; and
wherein said characteristic quantity extraction means extracts said characteristic quantities by subjecting said measurements to time-frequency analysis. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 17, 18)
motion time measurement means for obtaining from said measurements a motion time representing a temporal characteristic of said motions and/or actions; and
normalization means for normalizing said measurements on a time base provided by the acquired motion time;
wherein said characteristic quantity extraction means extracts said characteristic quantities by subjecting the normalized measurements to said time-frequency conversion.
-
-
4. A recognition system according to claim 1, further comprising:
-
motion time measurement means for obtaining from said measurements a motion time representing a temporal characteristic of said motions and/or actions; and
characteristic quantity correction means for using said motion time to correct the characteristic quantities extracted by said characteristic quantity extraction means, thereby acquiring the corrected quantities as new characteristic quantities;
wherein said recognition means recognizes the motions and/or actions of said object under observation in accordance with the corrected characteristic quantities and with said stored characteristic quantities.
-
-
5. A recognition system according to claim 3, wherein said output means outputs not only the recognized result but also said motion time measured in connection with the recognized motions and actions.
-
6. A recognition system according to claim 1, further comprising expansion and contraction means for expanding and contracting said measurements on a time base;
wherein said characteristic quantity extraction means extracts said characteristic quantities from the measurements expanded and contracted by said expansion and contraction means.
-
7. A recognition system according to claim 1, further comprising expansion and contraction means for expanding and contracting said measurements on a measuring intensity base;
wherein said characteristic quantity extraction means extracts said characteristic quantities from the measurements expanded and contracted by said expansion and contraction means.
-
8. A recognition system according to claim 6, wherein said output means outputs a value representing an expansion-contraction ratio used by said expansion and contraction means in the processing thereof.
-
17. A recognition system according to claim 1, wherein the recognition means recognizes whether an object under observation is in a motion state of walking or running.
-
18. A recognition system according to claim 3, wherein the recognition means recognizes whether an object under observation is in a motion state of walking or running.
-
9. A recognition system for recognizing motions and/or actions of an object under observation, said recognition apparatus comprising:
-
measurement means attached to said object under observation in order to measure a status change entailing the motions and/or actions of said object under observation;
characteristic quantity extraction means for extracting characteristic quantities from the measurements taken by said measurement means;
recognition means for recognizing the motions and/or actions of said object under observation in accordance with the characteristic quantities extracted from said measurements, output means for outputting a recognized result;
further comprising characteristic quantity composition means for selecting a plurality of quantities from among the characteristic quantities stored in said storage means so as to compose the selected characteristic quantities into a new characteristic quantity;
wherein said recognition means recognizes, given the newly composed characteristic quantity and the characteristic quantities corresponding to said measurements, the motions and/or actions of said object under observation as those composed of a plurality of motions and/or actions corresponding to the selected characteristic quantities. - View Dependent Claims (10)
-
-
11. A recognition system for recognizing motions and/or actions of an object under observation, said recognition apparatus comprising:
-
measurement means attached to said object under observation in order to measure a status change entailing the motions and/or actions of said object under observation;
characteristic quantity extraction means for extracting characteristic quantities from the measurements taken by said measurement means;
recognition means for recognizing the motions and/or actions of said object under observation in accordance with the characteristic quantities extracted from said measurements;
output means for outputting a recognized result; and
wherein, upon recognizing said motions and/or actions, said recognition means obtains correlations between the characteristic quantities corresponding to said measurements on the one hand, and the characteristic quantities stored in said storage means on the other hand, so that said recognition means recognizes said motions and/or actions in accordance with levels of the correlations thus obtained.
-
-
12. A recognition system for recognizing motions and/or actions of an object under observation, said recognition apparatus comprising:
-
measurement means attached to said object under observation in order to measure a status change entailing the motions and/or actions of said object under observation;
characteristic quantity extraction means for extracting characteristic quantities from the measurements taken by said measurement means;
recognition means for recognizing the motions and/or actions of said object under observation in accordance with the characteristic quantities extracted from said measurements;
output means for outputting a recognized result; and
further comprising position measurement means for measuring positions of said object under observation.
-
-
13. A recognition system for monitoring motions and/or actions of an object under observation, said recognition system comprising a monitored-side device and a monitoring-side device;
-
wherein said monitored-side device includes a recognition unit for recognizing motions and/or actions of said object under observation, a storage unit for storing reference data about specific motions and/or actions to be reported, a judgment unit for judging whether any motions and/or actions of said object under observation need to be reported in accordance with the recognized motions and/or actions and with said reference data, and a report transmission unit for transmitting a report reflecting a judged result; and
wherein said monitoring-side device includes a reception unit for receiving the report transmitted from said report transmission unit, and an output unit for effecting an output representing the received report. - View Dependent Claims (14, 19)
wherein said storage unit stores predetermined reference data about specific action patterns to be reported, each of said patterns being composed of specific motions and/or actions; and
wherein said judgment unit judges whether any pattern of combined motions and/or actions of said object under observation should be reported in accordance with the history stored in said history storage unit as well as with said reference data.
-
-
19. A recognition system according to claim 13, wherein the recognition means recognizes whether an object under observation is in a motion state of walking or running.
-
15. A recognition apparatus for recognizing gestures of an object under observation, said recognition apparatus comprising:
-
first storage means for storing reference data determined in advance about gestures to be recognized;
recognition means for recognizing a gesture corresponding to the motion of said object under observation on the basis of said reference data;
second storage means for storing in advance corresponding relations between said gestures to be recognized and meanings thereof;
meaning isolation means for isolating the meaning of any recognized gesture in accordance with the stored corresponding relations; and
output means for outputting the isolated meaning of the recognized gesture. - View Dependent Claims (20)
-
-
16. An apparatus for displaying recognized motions and/or actions of an object under observation, said apparatus comprising:
-
measurement means attached to said object under observation in order to measure a status change entailing the motions and/or actions of said object under observation;
characteristic quantity extraction means for extracting characteristic quantities from the measurements taken by said measurement means;
motion generating means for generating a motion of animated object of said object under observation in accordance with the characteristic quantities extracted from said measurements; and
display means for displaying said motion of animated object. - View Dependent Claims (21)
-
-
22. An apparatus for measuring a moving distance of an object under observation comprising:
-
measurement means attached to said object under observation in order to measure a status change in said object'"'"'s position;
recognition means for recognizing the motions and/or actions of said object under observation; and
calculation means for calculating the moving distance of an object by computing a product of a number of walking steps output by the measurement means and an average step length of said object. - View Dependent Claims (23)
-
-
24. A recognition method for recognizing motions and/or actions of an object under observation, said recognition method comprising the steps of:
-
measuring a status change entailing the motions and/or actions of an object under observation;
extracting characteristic quantities from the measurements of status change;
recognizing the motions and/or actions of said object under observation in accordance with the characteristic quantities extracted; and
outputting a recognized result, wherein said characteristic quantities are extracted by subjecting said measurements to time-frequency analysis. - View Dependent Claims (25, 26, 27, 28, 29)
obtaining from said measurements a motion time representing a temporal characteristic of said motions and/or actions; and
normalizing said measurements on a time base provided by the acquired motion time, said characteristic quantities are extracted by subjecting the normalized measurements to said time-frequency conversion.
-
-
27. A recognition method according to claim 24, further comprising the steps of:
-
obtaining from said measurements a motion time representing a temporal characteristic of said motions and/or actions; and
using said motion time to correct the characteristic quantities extracted, thereby acquiring the corrected quantities as new characteristic quantities, wherein the motions and/or actions of said object under observation are recognized in accordance with the corrected characteristic quantities and with said stored characteristic quantities.
-
-
28. A recognition method according to claim 24, further comprising the step of expanding and contracting said measurements on a time base,
wherein said characteristic quantities extracted from the measurements are expanded and contracted. -
29. A recognition method according to claim 24, further comprising the step of expanding and contracting said measurements on a measuring intensity base;
wherein said characteristic quantities extracted from the measurements are expanded and contracted.
Specification