System and method for object identification and behavior characterization using video analysis
First Claim
1. A device comprising:
- a first module configured to receive video images and to identify objects of interest in response to the video images;
a second module coupled to the first module and configured to classify a plurality of shape and posture categories based on a plurality of observed states of the objects of interest; and
a third module coupled to the second module, wherein the third module is configured to identify behaviors of the objects of interest using the plurality of shape and posture categories and standard object behaviors, and is further configured to analyze temporal ordering of behavior primitives time-series analysis to indentify a transition from a previous behavior primitive to a next behavior primitive.
1 Assignment
0 Petitions
Accused Products
Abstract
In general, the present invention is directed to systems and methods for finding the position and shape of an object using video. The invention includes a system with a video camera coupled to a computer in which the computer is configured to automatically provide object segmentation and identification, object motion tracking (for moving objects), object position classification, and behavior identification. In a preferred embodiment, the present invention may use background subtraction for object identification and tracking, probabilistic approach with expectation-maximization for tracking the motion detection and object classification, and decision tree classification for behavior identification. Thus, the present invention is capable of automatically monitoring a video image to identify, track and classify the actions of various objects and the object'"'"'s movements within the image. The image may be provided in real time or from storage. The invention is particularly useful for monitoring and classifying animal behavior for testing drugs and genetic mutations, but may be used in any of a number of other surveillance applications.
-
Citations
37 Claims
-
1. A device comprising:
-
a first module configured to receive video images and to identify objects of interest in response to the video images; a second module coupled to the first module and configured to classify a plurality of shape and posture categories based on a plurality of observed states of the objects of interest; and a third module coupled to the second module, wherein the third module is configured to identify behaviors of the objects of interest using the plurality of shape and posture categories and standard object behaviors, and is further configured to analyze temporal ordering of behavior primitives time-series analysis to indentify a transition from a previous behavior primitive to a next behavior primitive. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method of characterizing an activity comprising:
-
obtaining a stream of video image frames from a monitoring device; identifying objects of interest from the stream of video image frames; providing feature information of the objects of interest in response to the stream of video image frames; classifying postures of the objects of interest in response to the feature information; obtaining standard object behaviors from a storage memory device; and characterizing behaviors of the objects of interest in response to a comparison between the postures of the objects of interest and the standard object behaviors, wherein the characterizing the behaviors of the objects of interest further includes analyzing temporal ordering of behavior primitive using time-series analysis to identify a transition from a previous behavior primitive to a next behavior primitive. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. An apparatus for characterizing an activity comprising:
-
means for obtaining a stream of video image frames from a monitoring device; means for identifying objects of interest from the stream of video image frames; means for providing feature information of the objects of interest in response to the stream of video image frames; means for classifying postures of the objects of interest in response to the feature information; means for obtaining standard object behaviors from a storage memory device; and means for characterizing behaviors of the objects of interest in response to comparison between the postures of the objects of interest and the standard object behaviors;
wherein the means for characterizing further includes means for analyzing temporal ordering of behavior primitives using transitional information from a previous behavior primitive to a next behavior primitive;
wherein the means for analyzing temporal ordering of behavior primitives further includes means for utilizing Hidden Markov Model time-series analysis. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
-
32. A machine-readable medium having stored thereon computer executable instructions, which cause a digital processing system to perform a function, the function comprising:
-
obtaining a stream of video image frames from a monitoring device; identifying objects of interest from the stream of video image frames; providing feature information of the objects of interest in response to the stream of video image frames; classifying postures of the objects of interest in response to the feature information; obtaining standard object behaviors from a storage memory device; and characterizing behaviors of the objects of interest in response to comparison between the postures of the objects of interest and the standard object behaviors, wherein the characterizing the behaviors of the objects of interest further includes analyzing temporal ordering of behavior primitives. - View Dependent Claims (33, 34, 35, 36, 37)
-
Specification