Moving object detection apparatus

• US 20020030739A1
• Filed: 09/06/2001
• Published: 03/14/2002
• Est. Priority Date: 02/17/1995
• Status: Abandoned Application

• Current Assignee: Shigeki Nagaya, Takafumi Miyatake, Takehiro Fujita
• Original Assignee: Shigeki Nagaya, Takafumi Miyatake, Takehiro Fujita
• Inventors: Nagaya, Shigeki, Miyatake, Takafumi, Fujita, Takehiro
• Application Number:
  US09/946,528
• Publication Number:
  US 20020030739A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: F41G 7/2226 comparing the observed data with stored target data, e.g. target configuration data
• CPC Class Codes: F41G 7/2253 Passive homing systems, i.e. comprising a receiver and do not requiring an active illumination of the target
• CPC Class Codes: F41G 7/2293 using electromagnetic waves other than radio waves
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/421 by analysing segments intersecting the pattern
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19691 Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors

Abstract

A moving object is detected from a movie. The actual movie has a complicated background. In order to detect the moving object, the invention is constructed to comprise, in addition to means 500 for inputting the movie, and display 300 for outputting the processed result: means 700 for judging the interval which is predicted to belong to the background as to a pixel region in the movie; means 800 for extracting the moving object; and means 900 for calculating the moving direction and velocity of the moving object.

Thanks to the above-specified construction, even under the complicated background in which not only the change in the illumination condition but also the structure change will occur, the presence of the structure change of the background can be judged to detect/extract the moving object on real time. Moreover, the moving direction and velocity of the moving object can also be calculated.

Claims

1. A method for monitoring a moving object, comprising the steps of:

setting a window area of interest for an inputted time-varying image;

calculating a correlation between a first data of the window area in a frame (A) and a second data of the window area in a frame (B); and

deciding a first interval in which a moving object is present in the window area, based on a pattern of a calculated correlation value over a predetermined time period.

2. A method for monitoring a moving object according to claim 1, further comprising the step of:

displaying a representative screen of time-varying images in the first interval.

3. A method for monitoring a moving object according to claim 1, further comprising the steps of:

storing representative screens of time-varying images in a plurality of the first intervals; and

displaying the representative screens.

4. A method for monitoring a moving object according to claim 1, further comprising the steps of:

deciding a second interval in which a moving object is not present in the window area, based on the pattern of the calculated correlation value over the predetermined time period; and

displaying a representative screen of time-varying images in the second interval as a background screen.

5. A method of monitoring a moving object according to claim 1, wherein the data of the window area are represented as a feature and the calculated correlation value is assumed by the distance between the features.

6. A method for monitoring a moving object according to claim 1, wherein the window area has an arbitrary shape.

7. A method for monitoring a moving object, comprising the steps of:

setting a window area of interest for an inputted time-varying image;

calculating a correlation between a reference data of the window area in a reference frame and a current data of the window area in a current frame;

deciding whether images of the window area of the current frame includes an image of a moving object correlation value over a predetermined time period; and

updating the reference data as the current data when the image of the window area of the current frame does not include the image of the moving object.

8. A method of monitoring a moving object according to claim 7, wherein the window area has an arbitrary shape.

9. A method of monitoring a moving object according to claim 8, wherein the arbitrary shape is one of a straight line, a segment shape, a square shape, a circular shape and a concentric shape.

10. A method for monitoring a moving object, comprising the steps of:

setting a window area of interest for an inputted time-varying image;

calculating a correlation between a reference data of the window area in a reference frame and a current data of the window area in a current frame;

deciding whether images of the window area in the current frame is a background image which is a reference image for detecting a moving object, based on a plurality of calculated correlation values; and

updating the reference data as the current data when the image of the window area in the current frame is a background image.

11. A method of monitoring a moving object according to claim 10, further comprising the steps of:

deciding whether the background image is changed or not; and

judging whether the background change is caused by an illuminance change or a structure change.

13. A method of monitoring a moving object according to claim 12, further comprising the step of:

displaying a representative screen of time-varying images in the interval.

15. A monitoring system according to claim 14, wherein the data of the window area are represented as a feature vector and the calculated correlation value is assumed by a distance between the feature vectors.

17. A monitoring system according to claim 16, wherein the reference data is updated by the current data when an image of the window area of the current frame does not include the image of the moving object.

12. A method for monitoring a moving object, comprising the steps of:

setting a window area of interest for an inputted time-varying image;

calculating a correlation between a first data of the window area in a frame (A) and a second data of the window area in a frame (B); and

deciding an interval in which an image of the window area changes temporarily, based on a plurality of calculated correlation values.

14. A monitoring system, comprising:

a TV camera for taking in time-varying images;

a computer for monitoring the time-varying images; and

a display for displaying the result of the monitoring;

wherein said computer calculates a correlation between a first data of a window area in a frame (A) and a second data of the window area in a frame (B) and decides a interval in which a moving object is present in the window area based on a pattern of a calculated correlation value over a predetermined time period; and

wherein said display displays a representative screen of the time-varying images in the first interval.

16. A monitoring system, comprising:

a TV camera for taking in time-varying images;

a computer for monitoring the time-varying images; and

a display for displaying the result of monitoring;

wherein said computer calculates a correlation between a reference data and a current data of the window area in a current frame and decides whether an image of the window area of the current frame includes an image of a moving object or not based on a pattern of a calculated correlation value over a predetermined time period.

18. A monitoring system, comprising:

a TV camera for taking in time-varying images;

a computer for monitoring the time-varying images; and

a display for displaying the result of monitoring;

wherein said computer calculates a correlation between a first data of a window area in a frame (A) and a second data of the window area in a frame (B) and decides an interval in which an image of the window area changes temporarily, based on a plurality of calculated correlation value.

19. A monitoring system, comprising:

means for taking in time-varying images;

means for setting a window area of interest for the time-varying images;

means for calculating a correlation between a first data of the window area in a frame (A) and a second data of the window area in a frame (B); and

means for deciding a first interval in which a moving object is present in the window area, based on a pattern of a calculated correlation value over a predetermined time period.

20. A monitoring system, comprising:

means for taking in time-varying images;

means for setting a window area of interest for the time-varying images;

means for calculating a correlation between a first data of the window area in a frame (A) and a second data of the window area in a frame (B); and

means for deciding an interval in which an image of the window area changes temporarily, based on a plurality of a calculated correlation value.