Optical monitoring apparatus with image-based distance accommodation

• US 7,239,720 B2
• Filed: 05/25/2001
• Issued: 07/03/2007
• Est. Priority Date: 05/29/2000
• Status: Expired due to Term

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Shima, Toru
• Primary Examiner(s): Ahmed; Samir
• Assistant Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US09/866,011
• Publication Number:
  US 20010046310A1
• Time in Patent Office: 2,230 Days
• Field of Search: 382/103, 382/104, 382/106, 382/107, 348/154, 348/155, 356/27, 734/88
• US Class Current: 382/107
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19636 pertaining to the camera
• CPC Class Codes: G08B 17/125 by using a video camera to detect fire or smoke

Abstract

An optical monitoring system is capable of automatically identifying whether a moving body is a monitored subject based upon information in an optical (i.e., video) image. A moving body detection sub-system images a monitored region and detects a moving body from changes over time in the image of the monitored region. A speed detection sub-system detects the speed of a moving body in the image plane (i.e., speed of the moving body image in the image plane). A scale detection sub-system detects the size of a moving body in the image plane (i.e., size of the moving body in the image plane). A moving body estimation sub-system decides whether a moving body is the monitored subject (e.g., a human being) based on the image plane speed detected by the speed detection sub-system and the image plane size detected by the scale detection sub-system.

Claims

1. An optical monitoring system, comprising:

a moving body detection sub-system that images a monitored region onto an optical image plane and detects a moving body from changes over time in the monitored region;

a speed detection sub-system that detects a speed of the moving body in the optical image plane;

a scale detection sub-system that detects a size for the moving body in the optical image plane; and

a moving body estimation sub-system that decides whether the moving body is a predetermined monitored subject based on the speed detected by the speed detection sub-system and the size detected by the scale detection sub-system, the moving body estimation sub-system having an actual scale estimation sub-system that determines an estimated actual size of the moving body based on the speed detected by the speed detection sub-system and the size detected by the scale detection sub-system, the moving body estimation sub-system deciding whether the moving body is the predetermined monitored subject based on the estimated actual size of the moving body.

2. The monitoring system of claim 1, wherein the moving body estimation sub-system includes:

a correlation relationship storage sub-system that stores correlation relationships between the speed and size of predetermined classes of moving bodies; and

a class estimation sub-system that compares the speed detected by the speed detection sub-system and the size detected by the scale detection sub-system against the correlation relationships stored in the correlation relationship storage sub-system to estimate a class for the moving body, the class estimation sub-system deciding whether the moving body is the predetermined monitored subject based on the estimated class of the moving body.

3. The monitoring system of claim 2, wherein the correlation relationship storage sub-system stores correlation relationships between speed and size statistically obtained from previous imaging test results for each class of moving body.

4. The monitoring system of claim 1, wherein the moving body estimation sub-system includes a moving body evaluation sub-system that determines an evaluation value indicating a certainty that the moving body is the predetermined monitored subject based on the speed detected by the speed detection sub-system and the size detected by the scale detection sub-system, the moving body evaluation sub-system deciding whether the moving body is the predetermined monitored subject based on the evaluation value determined by the moving body evaluation sub-system.

5. The monitoring system of claim 1, wherein the scale detection sub-system detects a size for the moving body in only one dimension in the image plane.

6. The monitoring system of claim 1, wherein the scale detection sub-system detects a size for the moving body in two dimensions in the optical image plane.

7. The monitoring system of claim 6, wherein the scale detection sub-system applies different weighting factors to the two dimensions in the optical image plane to provide improved identification of the predetermined monitored subject.

8. The monitoring system of claim 6, wherein the two dimensions in the optical image plane correspond to horizontal and vertical directions in the monitored region, and the scale detection sub-system applies different weighting factors to the two dimensions in the optical image plane, with a greater weighting factor being applied to the dimension in the optical image plane corresponding to the vertical direction in the monitored region.

9. The monitoring system of claim 1, wherein the moving body detection sub-system includes a solid-state imaging element in which image signals are generated in plural pixels for each of first and second successive image frames, wherein a difference is obtained between the image signals generated in each pixel for successive first and second image frames.

14. The monitoring system of any of claims 1, 2, 4, and 9–

11 wherein the moving body estimation sub-system decides whether a moving body is the predetermined monitored subject for a limited specified area of the monitored region.

10. An optical monitoring system, comprising:

a moving body detection sub-system that images a monitored region onto an optical image plane and detects a moving body from changes over time in the monitored region;

a position detection sub-system that detects a position of the moving body in the optical image plane;

a scale detection sub-system that detects a size of the moving body in the optical image plane; and

a moving body estimation sub-system that decides whether the moving body is a predetermined monitored subject based on the position detected by the position detection sub-system and the size detected by the scale detection sub-system, the moving body estimation sub-system including;

a correlation relationship storage sub-system that stores correlation relationships between the position and size of predetermined moving bodies; and

a class estimation sub-system that checks the position detected by the position detection sub-system and the size detected by the scale detection sub-system against the correlation relationships stored in the correlation relationship storage sub-system to estimate the class of the moving body and decides whether it is the predetermined monitored subject based on the estimated class of the moving body.

11. The monitoring system of claim 10, wherein the moving body estimation sub-system includes an actual scale estimation sub-system that determines an estimated actual size of the moving body based on the position detected by the position detection sub-system and the size detected by the scale detection sub-system, the actual scale estimation sub-system deciding whether the moving body is the predetermined monitored subject based on the estimated actual size of the moving body.

12. The monitoring system of claim 10, wherein the moving body estimation sub-system includes a moving body evaluation sub-system that calculates an evaluation value indicating a certainty that the moving body is the predetermined monitored subject based on the position detected by the position detection sub-system and the size detected by the scale detection sub-system, the moving body evaluation sub-system deciding whether the moving body is the predetermined monitored subject based on the evaluation value of the moving body evaluation sub-system.

13. The monitoring system of claim 10, wherein the moving body detection sub-system includes a solid-state imaging element in which image signals are generated in plural pixels for each of first and second successive image frames, wherein a difference is obtained between the image signals generated in each pixel for successive first and second image frames.

15. An optical monitoring method, comprising:

imaging a monitored region onto an optical image plane and detecting a moving body from changes over time in the monitored region;

detecting a speed of the moving body in the optical image plane;

detecting a size for the moving body in the optical image plane;

deciding whether the moving body is a predetermined monitored subject based on the detected speed in the optical image plane and the detected size in the optical image plane;

storing correlation relationships between an optical image plane speed and an optical image plane size for predetermined classes of moving bodies;

comparing the detected speed in the optical image plane and the size detected in the optical image plane against the stored correlation relationships to estimate a class for the moving body; and

deciding whether the moving body is the predetermined monitored subject based on the estimated class of the moving body.

16. The monitoring method of claim 15, further including;

determining an estimated actual size of the moving body based on the speed detected in the optical image plane and the size detected in the optical image plane; and

deciding whether the moving body is the predetermined monitored subject based on the estimated actual size of the moving body.

17. The monitoring method of claim 15, further including:

determining an evaluation value indicating a certainty that the moving body is the predetermined monitored subject based on the speed detected in the optical image plane and the size detected in the optical image plane; and

deciding whether the moving body is the predetermined monitored subject based on the evaluation value.

18. The monitoring method of claim 15, further comprising deciding whether a moving body is the predetermined monitored subject only for a limited specified area of the monitored region.

19. An optical monitoring method, comprising:

imaging a monitored region onto an optical image plane and detecting a moving body from changes over time in the monitored region;

detecting a position of the moving body in the optical image plane;

detecting a size of the moving body in the optical image plane;

deciding whether the moving body is a predetermined monitored subject based on the position detected in the optical image plane and the size detected in the optical image plane;

determining an estimated actual size of the moving body based on the position detected in the optical image plane and the size detected in the optical image plane, and

deciding whether the moving body is the predetermined monitored subject based on the estimated actual size of the moving body.

20. The monitoring method of claim 19, further including:

storing correlation relationships between an image plane position and an image plane size of predetermined moving bodies; and

checking the position detected in the optical image plane and the size detected in the optical image plane against the stored correlation relationships to estimate the class of the moving body; and

deciding whether the moving body is the predetermined monitored subject based on the estimated class of the moving body.

21. The monitoring method of claim 19, further including determining an evaluation value indicating a certainty that the moving body is the predetermined monitored subject based on the position detected in the optical image plane and the size detected in the image plane;

and

deciding whether the moving body is the predetermined monitored subject based on the evaluation value.

22. The monitoring method of claim 19, further comprising deciding whether a moving body is the predetermined monitored subject only for a limited specified area of the monitored region.