Method and apparatus for automatic visual event detection
First Claim
1. A method for automatic visual detection and reporting of an event, comprising:
- capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of an object along a path, the path having a mark point, the event further comprising a mark time at which the object is located at the mark point;
choosing, responsive to a first analysis of the plurality of frames, a plurality of event frames from the plurality of frames, such that the first analysis indicates sufficient evidence that the object is located along the path for each frame of the plurality of event frames;
obtaining a plurality of capture times corresponding to the plurality of event frames, each capture time of the plurality of capture times being a function of a time at which the corresponding event frame was captured;
computing, responsive to a second analysis of the plurality of event frames, a plurality of location values, each location value of the plurality of location values responsive to a position of the object along the path in an associated event frame as computed by the second analysis;
determining the mark time using the plurality of location values and the plurality of capture times; and
producing, by an output signaler, a signal at a report time that follows the mark time by a delay interval.
4 Assignments
0 Petitions
Accused Products
Abstract
Disclosed are methods and apparatus for automatic visual detection of events, for recording images of those events and retrieving them for display and human or automated analysis, and for sending synchronized signals to external equipment when events are detected. An event corresponds to a specific condition, among some time-varying conditions within the field of view of an imaging device, that can be detected by visual means based on capturing and analyzing digital images of a two-dimensional field of view in which the event may occur. Events may correspond to rare, short duration mechanical failures for which obtaining images for analysis is desirable. Events are detected by considering evidence obtained from an analysis of multiple images of the field of view, during which time moving mechanical components can be seen from multiple viewing perspectives.
181 Citations
45 Claims
-
1. A method for automatic visual detection and reporting of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of an object along a path, the path having a mark point, the event further comprising a mark time at which the object is located at the mark point; choosing, responsive to a first analysis of the plurality of frames, a plurality of event frames from the plurality of frames, such that the first analysis indicates sufficient evidence that the object is located along the path for each frame of the plurality of event frames; obtaining a plurality of capture times corresponding to the plurality of event frames, each capture time of the plurality of capture times being a function of a time at which the corresponding event frame was captured; computing, responsive to a second analysis of the plurality of event frames, a plurality of location values, each location value of the plurality of location values responsive to a position of the object along the path in an associated event frame as computed by the second analysis; determining the mark time using the plurality of location values and the plurality of capture times; and producing, by an output signaler, a signal at a report time that follows the mark time by a delay interval. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A system for automatic visual detection and reporting of an event, comprising:
-
an imager configured to perform a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of an object along a path, the path having a mark point, the event further comprising a mark time at which the object is located at the mark point; a first selection process that chooses a plurality of event frames from the plurality of frames, such that the first selection process judges that there is sufficient evidence that the object is located along the path for each frame of the plurality of event frames; a timing process that obtains a plurality of capture times corresponding to the plurality of event frames, each capture time of the plurality of capture times being a function of a time at which the corresponding event frame was captured; a first analysis process that computes a plurality of location values, each location value of the plurality of location values responsive to a position of the object along the path in an associated event frame; a second analysis process that determines the mark time using the plurality of location values and the plurality of capture times; and a input/output module configured to perform an output process that produces a signal at a report time that follows the mark time by a delay interval. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32)
-
-
33. A system for automatic visual detection and reporting of an event, comprising:
-
an imager with a global shutter configured to perform capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of an object along a path, the path having a mark point, the event further comprising a mark time at which the object is located at the mark point; a first selection process that chooses a plurality of event frames from the plurality of frames, such that the first selection process judges that there is sufficient evidence that the object is located along the path for each frame of the plurality of event frames; a timing process that obtains a plurality of capture times corresponding to the plurality of event frames, each capture time of the plurality of capture times being a function of a time at which the corresponding event frame was captured; a first analysis process that computes a plurality of location values, each location value of the plurality of location values responsive to a position of the object along the path in an associated event frame; a second analysis process that determines the mark time using the plurality of location values and the plurality of capture times; and a input/output module configured to perform an output process that produces a signal at a report time that follows the mark time by a delay interval. - View Dependent Claims (34, 35, 36)
-
-
37. An article of manufacture including a tangible computer-readable medium having instructions stored thereon that if executed by a computing device, cause the computing device to perform operations comprising:
-
receiving a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which an event occurs, the event comprising a motion of an object along a path, the path having a mark point, the event further comprising a mark time at which the object is located at the mark point; selecting a plurality of event frames from the plurality of frames based on that there is sufficient evidence that the object is located along the path for each frame of the plurality of event frames; obtaining a plurality of capture times corresponding to the plurality of event frames, each capture time of the plurality of capture times being a function of a time at which the corresponding event frame was captured; computing a plurality of location values, each location value of the plurality of location values responsive to a position of the object along the path in an associated event frame; computing the mark time using the plurality of location values and the plurality of capture times; and providing a value responsive to the mark time for the consumption by an input/output module, wherein the input/output module uses the value for control in an industrial process. - View Dependent Claims (38, 39, 40, 41)
-
-
42. A system for automatic visual detection and reporting of an event, comprising:
-
a data processing device programmed to; receive a plurality of frames, captured by an imager with a global shutter, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of an object along a path, the path having a mark point, the event further comprising a mark time at which the object is located at the mark point; choose a plurality of event frames from the plurality of frames based on sufficient evidence that the object is located along the path for each frame of the plurality of event frames; obtain a plurality of capture times corresponding to the plurality of event frames, each capture time of the plurality of capture times being a function of a time at which the corresponding event frame was captured; compute a plurality of location values, each location value of the plurality of location values responsive to a position of the object along the path in an associated event frame; calculate the mark time using the plurality of location values and the plurality of capture times; and provide a value responsive to the mark time for the consumption by an input/output module, wherein the input/output module uses the value for control in an industrial process. - View Dependent Claims (43, 44, 45)
-
Specification