Moving object detection apparatus
First Claim
1. A moving object detection apparatus comprising:
- means for inputting a movie;
means for detecting a moving object from the inputted movie; and
means for outputting the detected result,wherein said moving object detection means comprises background judgment means including;
means for setting a window area of interest for the background with respect to the inputted movie;
means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame;
means for judging the interval which is predicted to belong to the background because of absence of the moving object from the pattern of at least one of the calculated correlated value; and
means for deciding the interval for which a moving object is present from the interval which is predicted to belong to the judged background;
wherein said means for judging the interval to be predicted to belong to the background judges whether the background change is caused by the illuminance change or the structure change, from the pattern of at least one of the correlated values.
2 Assignments
0 Petitions
Accused Products
Abstract
A moving object is detected from a movie which has a complicated background. In order to detect the moving object, there is provided a unit for inputting the movie, a display unit for outputting a processed result, a unit for judging an interval which is predicted to belong to the background as part of a pixel region in the movie, a unit for extracting the moving object and a unit for calculating the moving direction and velocity of the moving object. Even with a complicated background in which not only a change in illumination condition, but also a change in structure occurs, the presence of the structure change of the background can be determined so as to detect and/or extract the moving object in real time. Additionally, the moving direction and velocity of the moving object can be determined.
102 Citations
20 Claims
-
1. A moving object detection apparatus comprising:
-
means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judgment means including; means for setting a window area of interest for the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval which is predicted to belong to the background because of absence of the moving object from the pattern of at least one of the calculated correlated value; and means for deciding the interval for which a moving object is present from the interval which is predicted to belong to the judged background; wherein said means for judging the interval to be predicted to belong to the background judges whether the background change is caused by the illuminance change or the structure change, from the pattern of at least one of the correlated values.
-
-
2. A moving object detection apparatus comprising:
-
means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including; means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame by assuming the data of the window area of interest as vectors to use the distance, the inner product or the angle between the vectors as the correlated value.
-
-
3. A moving object detection apparatus comprising:
-
means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including; means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for detecting of the moving object comprises moving object motion analyzing means including; means for acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and for acquiring two background images, respectively, from such intervals to be predicted to belong to the background as are located before and after the interval for which the moving object is present; means for creating two background differential images from the frame image and the background images located before and after the period of said frame image; means for determining a merging region from the two background differential images; and means for cutting a moving object image out of said frame image and said merging region; whereby the moving object image is extracted. - View Dependent Claims (4)
-
-
5. A moving object detection apparatus comprising:
-
means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including; means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for deciding the interval for which the moving object is present includes; means for cutting out the spatial-temporal image of the interval for which the moving object is present; means for separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image; means for correcting the obtained moving object region by the morphology processing and the hole fill processing; means for determining the region which is obtained from the corrected background differential image and in which the two moving object regions are merged; and means for estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12)
-
-
13. A moving object detection apparatus comprising:
-
means for inputting a movie; means for detection a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including; means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; moving object motion analyzing means including; means for acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and for acquiring two background images, respectively;
means for creating two background differential images from the frame image and the background images located before and after the period of said frame image;
means for determining a merging region from the two background differential images; and
means for cutting a moving object image out of said frame image and said merging region; andmoving object extracting means including;
means for cutting out the spatial-temporal image of the interval for which the moving object is present;
means for separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image;
means for correcting the obtained moving object region by the morphology processing and the hole fill processing;
means for determining the region which is obtained from the corrected background differential image and in which the two moving object regions are merged; and
means for estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region.
-
-
14. A moving object detection method comprising:
-
setting a window area of interest for judging the background for an inputted movie; calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and deciding the interval, for which a moving object is present, from the interval for which is predicted to belong to the judged background; acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and acquiring two background images, respectively, from such intervals to be predicted to belong to the background as are located before and after the interval for which the moving object is present; creating two background differential images from the frame image and the background images located before and after the period of said frame image; determining a merging region from the two background differential images; and cutting a moving object image out of said frame image and said merging region, and extracting the moving object image. - View Dependent Claims (15)
-
-
16. A moving object detection apparatus for detecting a moving object in a video image comprising:
-
a first memory for storing background image data; a second memory for storing inputted video image data; means for detecting a moving object according to background differences between the background image data stored in the first memory and a frame of the video image stored in the second memory; background judging means for determining a background image, said background judging means setting a window of interest, and detecting a moving object period and a background period based on a correlation between data of the window area of interest in the background image and data of the window area of interest in each frame image following a position of the set window area of interest; wherein said means for detecting a moving object utilizes a new background image for the previously determined background image when the new background image is in the background period where a correlation pattern is different from a correlation pattern in the background period including the previously determined background image. - View Dependent Claims (17, 18, 19, 20)
-
Specification