Determination of object presence and motion state
First Claim
1. A computer-implemented method for applying computer vision techniques to automatically detect and classify the presence or absence of an object within a region of interest, the method comprising executing on a processor the steps of:
- determining for an auto-correction time period a distribution of object present and object absent labels that are assigned one each to each of a plurality of the video segments of video image scene data acquired from a region of interest, wherein the video segments are each assigned the object present label in response to determining that foreground feature data values meet a background subtraction threshold value indicative of a presence of a foreground object having a specified size, the object absent label in response to determining that the foreground feature data values do not meet the background subtraction threshold value, a motion present label in response to determining that motion feature data values for the frames differ from motion feature data values of previous frames by a motion threshold value that is selected as indicative of a change in visual features consistent with movement of the object within the frame data, and a static label in response to determining that the motion feature data values for the frames do not differ from the motion feature data values of the previous frames by the motion threshold value;
in response to determining that the distribution of the object present and the object absent labels does not meet an expected distribution for the auto-correction time period, exchanging the object present and the object absent labels that are assigned to each of the video frames;
classifying segments of the input video data comprising consecutive video frames that are each assigned the object absent label and the static label as “
no object present”
segments;
classifying segments of the input video data comprising consecutive video frames that are each assigned the object present label and the motion present label as “
object present and in transition”
segments; and
classifying segments of the input video data comprising consecutive video frames that are each assigned the object present label and the static label as “
object present and stopped”
segments.
2 Assignments
0 Petitions
Accused Products
Abstract
Foreground feature data and motion feature data is determined for frames of video data acquired from an object region of interest. The frames are labeled as “object present” if the determined foreground feature data value meets a threshold value, else as “object absent; and as “motion present” if the motion feature data meets a motion threshold, else as “static.” The labels are used to classify segments of the video data comprising groups of consecutive video frames, namely as within a “no object present” segment for groups with “object absent” and “static” labels; within a “object present and in transition” segment for groups “object present” and “motion present” labels; and within a “object present and stopped” segment for groups with “object present” and “static” labels. The presence or motion state of an object at a time of inquiry is thereby determined from the respective segment classification.
18 Citations
17 Claims
-
1. A computer-implemented method for applying computer vision techniques to automatically detect and classify the presence or absence of an object within a region of interest, the method comprising executing on a processor the steps of:
-
determining for an auto-correction time period a distribution of object present and object absent labels that are assigned one each to each of a plurality of the video segments of video image scene data acquired from a region of interest, wherein the video segments are each assigned the object present label in response to determining that foreground feature data values meet a background subtraction threshold value indicative of a presence of a foreground object having a specified size, the object absent label in response to determining that the foreground feature data values do not meet the background subtraction threshold value, a motion present label in response to determining that motion feature data values for the frames differ from motion feature data values of previous frames by a motion threshold value that is selected as indicative of a change in visual features consistent with movement of the object within the frame data, and a static label in response to determining that the motion feature data values for the frames do not differ from the motion feature data values of the previous frames by the motion threshold value; in response to determining that the distribution of the object present and the object absent labels does not meet an expected distribution for the auto-correction time period, exchanging the object present and the object absent labels that are assigned to each of the video frames; classifying segments of the input video data comprising consecutive video frames that are each assigned the object absent label and the static label as “
no object present”
segments;classifying segments of the input video data comprising consecutive video frames that are each assigned the object present label and the motion present label as “
object present and in transition”
segments; andclassifying segments of the input video data comprising consecutive video frames that are each assigned the object present label and the static label as “
object present and stopped”
segments. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An article of manufacture, comprising:
-
a computer readable hardware storage device having computer readable program code embodied therewith, the computer readable program code comprising instructions for execution by a computer processing unit that cause the computer processing unit to; determine for an auto-correction time period a distribution of object present and object absent labels that are assigned one each to each of a plurality of the video segments of video image scene data acquired from a region of interest, wherein the video segments are each assigned the object present label in response to determining that foreground feature data values meet a background subtraction threshold value indicative of a presence of a foreground object having a specified size, the object absent label in response to determining that the foreground feature data values do not meet the background subtraction threshold value, a motion present label in response to determining that motion feature data values for the frames differ from motion feature data values of previous frames by a motion threshold value that is selected as indicative of a change in visual features consistent with movement of the object within the frame data, and a static label in response to determining that the motion feature data values for the frames do not differ from the motion feature data values of the previous frames by the motion threshold value; in response to determining that the distribution of the object present and the object absent labels does not meet an expected distribution for the auto-correction time period, exchange the object present and the object absent labels that are assigned to each of the video frames; classify segments of the input video data comprising consecutive video frames that are each assigned the object absent label and the static label as “
no object present”
segments;classify segments of the input video data comprising consecutive video frames that are each assigned the object present label and the motion present label as “
object present and in transition”
segments; andclassify segments of the input video data comprising consecutive video frames that are each assigned the object present label and the static label as “
object present and stopped”
segments. - View Dependent Claims (10, 11, 12, 13)
-
-
14. A system, comprising:
-
a processing unit; a computer readable memory in communication with the processing unit; and a computer-readable storage medium in communication with the processing unit; wherein the processing unit executes program instructions stored on the computer-readable storage medium via the computer readable memory and thereby; determines for an auto-correction time period a distribution of object present and object absent labels that are assigned one each to each of a plurality of the video segments of video image scene data acquired from a region of interest, wherein the video segments are each assigned the object present label in response to determining that foreground feature data values meet a background subtraction threshold value indicative of a presence of a foreground object having a specified size, the object absent label in response to determining that the foreground feature data values do not meet the background subtraction threshold value, a motion present label in response to determining that motion feature data values for the frames differ from motion feature data values of previous frames by a motion threshold value that is selected as indicative of a change in visual features consistent with movement of the object within the frame data, and a static label in response to determining that the motion feature data values for the frames do not differ from the motion feature data values of the previous frames by the motion threshold value; in response to determining that the distribution of the object present and the object absent labels does not meet an expected distribution for the auto-correction time period, exchanges the object present and the object absent labels that are assigned to each of the video frames; classifies segments of the input video data comprising consecutive video frames that are each assigned the object absent label and the static label as “
no object present”
segments;classifies segments of the input video data comprising consecutive video frames that are each assigned the object present label and the motion present label as “
object present and in transition”
segments; andclassifies segments of the input video data comprising consecutive video frames that are each assigned the object present label and the static label as “
object present and stopped”
segments. - View Dependent Claims (15, 16, 17)
-
Specification