Method and apparatus for automatic visual event detection
3 Assignments
0 Petitions
Accused Products
Abstract
Disclosed are methods and apparatus for automatic visual detection of events, for recording images of those events and retrieving them for display and human or automated analysis, and for sending synchronized signals to external equipment when events are detected. An event corresponds to a specific condition, among some time-varying conditions within the field of view of an imaging device, that can be detected by visual means based on capturing and analyzing digital images of a two-dimensional field of view in which the event may occur. Events may correspond to rare, short duration mechanical failures for which obtaining images for analysis is desirable. Events are detected by considering evidence obtained from an analysis of multiple images of the field of view, during which time moving mechanical components can be seen from multiple viewing perspectives.
-
Citations
56 Claims
-
1-16. -16. (canceled)
-
17. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of a predetermined object;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
18. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a repetitive motion;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
19. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion across a fixed reference point;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
20. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of advance and retreat;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
21. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising an incorrectly manufactured object passing through the field of view;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
22. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising an incorrect motion of an object in the field of view;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred. - View Dependent Claims (23, 24, 25, 26)
-
-
27. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising an incorrectly positioned object;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
28. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a substantial change in a dimension of a continuous web;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
29. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights;
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred; and
producing a signal that is synchronized with a time at which the event occurs.
-
-
30. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred, the event analysis comprising a plurality of comparison operations producing a corresponding plurality of logical results, each comparison operation of the plurality of comparison operations comprising a comparison of a first value and a second value, wherein at least one of the first value and the second value are responsive to a numerical statistic of the subset of the plurality of event detection weights; and
at least one logical operation that combines the plurality of logical results to determine whether the event has occurred.
-
-
31. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred, the event analysis comprising a text string representing an expression in a syntax substantially similar to the syntax of a conventional programming language.
-
-
32. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the field of view comprising no more than about 40,000 pixels;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
33. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights;
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred; and
wherein the steps of the method are performed at a rate of not less than two hundred frames per second.
-
-
34. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view, the visual analysis comprising, for each frame in the plurality of frames, using a locator to adjust a position of a region of interest in the field of view; and
analyzing the region of interest;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
35. A method for automatic visual detection of an event, comprising:
-
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting, responsive to an activity analysis of the plurality of event detection weights, a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights, the activity analysis comprising entering an active state when the visual analysis computes an event detection weight that indicates sufficient evidence that the event is occurring; and
exiting the active state when the visual analysis computes a plurality of event detection weights that each indicate insufficient evidence that the event is occurring; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
36. A method for automatic visual detection of an event, comprising:
-
using a human-machine interface to specify the event, the human-machine interface comprising a logic view;
capturing a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
computing, responsive to a visual analysis of the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
selecting a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
determining, responsive to an event analysis of the subset of the plurality of event detection weights, whether the event has occurred.
-
-
37. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of a predetermined object;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
38. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a repetitive motion;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
39. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion across a fixed reference point;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
40. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a motion of advance and retreat;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
41. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising an incorrectly manufactured object passing through the field of view;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
42. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising an incorrect motion of an object in the field of view;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred. - View Dependent Claims (43, 44, 45, 46)
-
-
47. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising an incorrectly positioned object;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
48. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the event comprising a substantial change in a dimension of a continuous web;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
49. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights;
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred; and
an output process that produces a signal that is synchronized with a time at which the event occurs.
-
-
50. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred, the event analysis process comprising a plurality of comparison operations producing a corresponding plurality of logical results, each comparison operation of the plurality of comparison operations comprising a comparison of a first value and a second value, wherein at least one of the first value and the second value are responsive to a numerical statistic of the subset of the plurality of event detection weights; and
at least one logical operation that combines the plurality of logical results to determine whether the event has occurred.
-
-
51. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred, the event analysis process comprising a text string representing an expression in a syntax substantially similar to the syntax of a conventional programming language.
-
-
52. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs, the capture process comprising an imager comprising no more than about 40,000 pixels;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
53. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights;
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred; and
wherein the capture process, the visual analysis process, the selection process, and the event analysis process operate at a rate of not less than two hundred frames per second.
-
-
54. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view, the visual analysis process comprising, for each frame in the plurality of frames, a locator that adjusts a position of a region of interest in the field of view; and
a region analysis process that analyzes the region of interest;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
55. A system for automatic visual detection of an event, comprising:
-
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
an activity analysis process that selects, responsive to the plurality of event detection weights, a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights, the activity analysis process comprising an active state that is entered when the visual analysis process computes an event detection weight that indicates sufficient evidence that the event is occurring, and that is exited when the visual analysis process computes a plurality of event detection weights that each indicate insufficient evidence that the event is occurring; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
-
56. A system for automatic visual detection of an event, comprising:
-
a human-machine interface that specifies the event, the human-machine interface comprising a logic view;
a capture process that captures a plurality of frames, each frame in the plurality of frames comprising an image of a two-dimensional field of view in which the event occurs;
a visual analysis process that computes, responsive to the plurality of frames, a plurality of event detection weights, each event detection weight of the plurality of event detection weights corresponding respectively to each frame of the plurality of frames and comprising evidence that the event is occurring in the field of view;
a selection process that selects a plurality of event frames from the plurality of frames, the plurality of event frames corresponding to a subset of the plurality of event detection weights; and
an event analysis process that determines, responsive to the subset of the plurality of event detection weights, whether the event has occurred.
-
Specification