Object detection

• US 7,200,246 B2
• Filed: 10/16/2001
• Issued: 04/03/2007
• Est. Priority Date: 11/17/2000
• Status: Expired due to Term

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Hamza, Rida M., Cofer, Darren Duane
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): Kassa; Yosef
• Application Number:
  US09/981,928
• Publication Number:
  US 20020061134A1
• Time in Patent Office: 1,995 Days
• Field of Search: 382/103, 382/199, 382/282, 382/291, 382/307, 382/209, 382/219, 382/104, 382/286, 348/143, 348/152, 348/135, 348/156, 348/139
• US Class Current: 382/103
• CPC Class Codes: F16P 3/142 using image capturing devices
• CPC Class Codes: G08B 13/19606 Discriminating between target movement or movement in an area of interest and other non-signicative movements, e.g. target movements induced by camera shake or movements of pets, falling leaves, rotating fan

Abstract

A visual object detection system to provide access and/or presence monitoring of an area of interest. In steady state operation, that is when no object is entering or within the area of interest, only those portions of the incoming images that correspond to the border of the area of interest are analyzed. Once the border is breached by an object, the present invention may begin analyzing the entire area or selected regions inside the border of the area of interest. This may provide some level of presence monitoring of the area of interest. It is contemplated that both modes of analysis can take place simultaneously or sequentially, depending on the application. Once the object leaves the area of interest, the present invention preferably returns to the original steady state, and monitors only the border regions of the incoming images.

Claims

1. A method for monitoring an area of interest containing a hazardous or sensitive object, the area of interest having a border and an interior region, wherein the interior region is at least partially defined by the border region, the method comprising the steps of:

defining an interior region containing the hazardous or sensitive object;

defining a border region around at least part of the interior region, the border region defining at least part of a safety zone that extends around at least part of the hazardous or sensitive object;

monitoring at least a portion of the border region of the area of interest for breach by an object while not monitoring at least part of the interior region of the area of interest; and

monitoring at least a portion of the interior region of the area of interest for the object after the object breaches the border region.

2. The method of claim 1 further comprising the step of:

ceasing to monitor the interior region of the area of interest after the object leaves the area of interest; and

continuing to monitor at least a portion of the border region of the area of interest after the object leaves the area of interest.

3. The method of claim 1 wherein the interior region of the area of interest is not monitored until the object no longer breaches the border region of the area of interest.

4. The method of claim 1 further comprising the step of:

continuing to monitor at least a portion of the border region of the area of interest while the interior region is being monitored.

5. The method of claim 1 further comprising the step of providing a safety output when the border region is breached by the object.

6. The method of claim 5 wherein the safety output disables a piece of hazardous or sensitive equipment located in the area of interest.

7. The method of claim 5 wherein the safety output sounds an alarm.

8. The method of claim 1 wherein the border region comprises a continuous region.

9. The method of claim 1 wherein the border region comprises an interrupted region.

10. The method of claim 1 wherein the area of interest excludes a defined region from its interior.

42. The method of claim 1, wherein the step of monitoring at least a portion of the safety zone optically monitors at least a portion of the border region of the area of interest for breach by an object.

11. A method for monitoring an area of interest having a border and an interior, the method comprising the steps of:

capturing a sequence of capture images of the area of interest, wherein each of the capture images capture at least part of the interior of the area of interest;

identifying one or more border regions in each of the captured images that correspond to the border of the area of interest;

analyzing the one or more border regions in the captured images and determining if an object has entered the one or more border regions of the area of interest; and

outputting a signal indicating when an object has entered the one or more border regions of the area of interest, wherein at least part of the interior of the area of interest of the capture images is not monitored until a determination is made that an object has entered the one or more border regions.

12. The method of claim 11 wherein the one or more border regions include a reference marking.

13. The method of claim 11 wherein the reference marking is a predetermined pattern.

14. The method of claim 11 wherein the step of analyzing the one or more border regions of the captured images comprises the step of comparing the one or more border regions of the capture images to one or more corresponding regions of a reference image.

15. The method of claim 14 wherein the border of the area of interest includes a reference marking, and the one or more border regions in the reference image are identified by identifying the reference marking in the reference image.

16. The method of claim 15 wherein the reference marking is a predetermined pattern.

17. The method of claim 16 wherein the predetermined pattern determines a minimum size of the objects to be detected.

18. The method of claim 11 further comprising the step of storing a capture image when an object has entered the area of interest.

19. The method of claim 18 further comprising the step of viewing the stored capture image at a later time.

20. The method of claim 14 wherein the reference image is taken in response to a change in one or more conditions in the area of interest.

21. The method of claim 14 wherein the reference image is taken at a set time interval.

22. The method of claim 11 wherein the step of analyzing the one or more border regions of the captured images comprises the step of comparing the one or more border regions of the capture images to corresponding regions of two or more reference images.

23. The method of claim 22 wherein at least one comparison detects relatively immediate changes, and at least one comparison detects accumulated changes.

24. A method for monitoring an area of interest having a border and an interior region, the method comprising the steps of:

capturing at least two images of the area of interest using two separate image capturing devices;

identifying one or more border regions in each captured image that corresponds to the border of the area of interest, each captured image including at least a portion of the interior region;

analyzing the one or more border regions of the captured images but not at least part of the interior region to determine when an object enters the area of interest; and

outputting a signal indicating whether or not an object has entered the area of interest.

25. The method of claim 24, wherein the image capturing devices are video cameras.

26. The method of claim 24, wherein the image capturing devices are digital cameras.

27. A system for monitoring an area of interest having a border and an interior region, comprising:

capturing means for capturing a capture image of the area of interest; and

analyzing means for analyzing at least a portion of the capture image corresponding to the border region of the area of interest for breach by an object, and for analyzing at least a portion of the capture image corresponding to the interior region of the area of interest for the presence of the object after the object breaches the border;

wherein the analyzing means does not analyze at least part of the capture image corresponding to at least part of the interior region unless an object breaches the border region.

43. The system of claim 27, wherein the analyzing means optically analyzes at least a portion of the capture image corresponding to at least a portion of the border region of the area of interest for breach by an object.

28. A system for monitoring an area of interest, comprising:

image capturing means for capturing at least one image of the area of interest;

first processing means for processing at least one of the capture images to determine if an object has entered the area of interest;

second processing means for processing at least one of the capture images to determine if an object has entered the area of interest; and

output means for outputting a signal indicating that an object has entered the area of interest when both the first processing means and second processing means indicate that an object has entered the object of interest.

29. A system according to claim 28 wherein the image capturing means includes a single image capture device.

30. A system according to claim 28 wherein the image capturing means includes two image capture devices each providing a separate image of the area of interest, wherein a first one of the image capture devices provides a first image of the area of interest to the first processing means and a second one of the image capture devices provides a second image of the area of interest to the second processing means.

31. A method for monitoring an area of interest having a border region and an interior region, the method comprising the steps of:

monitoring at least a portion of the border region of the area of interest for breach by an object having a first minimum size; and

monitoring at least a portion of the interior region of the area of interest for an object having a second minimum size after the object breaches the border region of the area of interest.

32. The method of claim 31 wherein the first minimum size is smaller than the second minimum size.

33. The method of claim 31 wherein the first minimum size is bigger than the second minimum size.

34. The method of claim 31 wherein the interior region is defined to include the border region.

35. The method of claim 31 wherein the interior region is defined to exclude the border region.

36. A method for monitoring an area of interest having two or more regions, each region having a border region and an interior region, the method comprising the steps of:

capturing a capture image of the area of interest;

monitoring the border region of a first region of the area of interest for breach by an object while not monitoring at least part of the interior region of the first region, and monitoring at least a portion of the interior region of the first region for the object after the object breaches the border region of the first region;

monitoring the border region of a second region of the area of interest for breach by an object while not monitoring at least part of the interior region of the second region, and monitoring at least a portion of the interior region of the second region for the object after the object breaches the border region of the second region.

37. The method of claim 36 wherein the border and/or interior region of the first region are monitored independently of the border and/or interior region of the second region.

38. The method of claim 36 wherein the border and/or interior regions of the first and second region are selectively monitored.

39. The method of claim 38 wherein the border and/or interior region of the first region are monitored and the border and/or interior region of the second region are not monitored.

40. The method of claim 38 wherein the border and/or interior region of the first region are monitored and the border and/or interior region of the second region are also monitored.

41. The method of claim 38 wherein the border and/or interior region of the first region are not monitored and the border and/or interior region of the second region are not monitored.

44. A method for monitoring an area of interest in a field of view of an image capture device, the method comprising the steps of:

defining a border in the field of view of the image capture device, wherein the border at least partially defines an interior region of the area of interest;

monitoring at least a portion of the border region of the area of interest for breach by an object while not monitoring at least part of the interior region of the area of interest; and

monitoring at least a portion of the interior region of the area of interest for the object after the object breaches the border.

45. A method for monitoring an area of interest having a border and an interior, the method comprising the steps of:

capturing a capture image of the area of interest;

identifying one or more border regions in the captured image that correspond to the border of the area of interest;

analyzing the one or more border regions of the captured image and determining if an object has entered the one or more border regions of the area of interest, wherein the one or more border regions of the captured image are analyzed by comparing the one or more border regions of the capture image to corresponding regions of two or more reference images, wherein at least one comparison detects relatively immediate changes, and at least one comparison detects accumulated changes; and

outputting a signal indicating when an object has entered the one or more border regions of the area of interest.