Viewing a compartment

• US 7,302,101 B2
• Filed: 08/21/2002
• Issued: 11/27/2007
• Est. Priority Date: 05/20/2002
• Status: Expired due to Fees

• Current Assignee: Simmonds Precision Products, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Simmonds Precision Products, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Zakrzewski, Radoslaw Romuald, Sadok, Mokhtar
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): SCHAFFER, JONATHAN C
• Application Number:
  US10/224,709
• Publication Number:
  US 20030215143A1
• Time in Patent Office: 1,924 Days
• Field of Search: 382/218
• US Class Current: 382/218
• CPC Class Codes: G06F 18/253 of extracted features
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 17/125 by using a video camera to detect fire or smoke

Abstract

Detecting video phenomena, such as fire in an aircraft cargo bay, includes receiving a plurality of video images from a plurality of sources, compensating the images to provide enhanced images, extracting features from the enhanced images, and combining the features from the plurality of sources to detect the video phenomena. The plurality of sources may include cameras having a sensitivity of between 400 nm and 1000 nm and/or may include cameras having a sensitivity of between 7 and 14 micrometers. Extracting features may include determining an energy indicator for each of a subset of the plurality of frames. Detecting video phenomena may also include comparing energy indicators for each of the subset of the plurality of frames to a reference frame. The reference frame corresponds to a video frame taken when no fire is present, video frame immediately preceding each of the subset of the plurality of frames, or a video frame immediately preceding a frame that is immediately preceding each of the subset of the plurality of frames.

Claims

1. A method of viewing a compartment, comprising:

providing at least one camera in the compartment;

receiving image signals from the at least one camera;

enhancing the image signals to provide enhanced image signals;

providing a selector switch that receives the image signals and receives the enhanced image signals;

providing a screen that receives a video signal from the selector switch, wherein the video signal is one of the image signals or the enhanced image signals depending upon actuation of the selector switch;

providing on the screen for viewing at least one of an image using the image signals or an enhanced image using the enhanced image signals in accordance with the selector switch at a first point in time to visually inspect the compartment and determine whether a fire is present;

providing a means to perform a fire suppression action in response to determining that a fire is present after viewing at the first point in time; and

providing an indicator indicating whether said fire suppression action is performed, wherein, when said indicator indicates that said fire suppression action is performed, said enhancing includes filtering the image signals to remove image distortion caused by said fire suppression action.

2. A method, according to claim 1, wherein enhancing the image signals includes at least one of:

compensating for vibration, compensating for camera aging, compensation for dynamic range unbalance, compensation for temperature variations, compensation for smog and smoke effects and compensating for lenses provided with at least one camera.

3. A method, according to claim 1, wherein the at least one camera has a sensitivity between 400 nm and 1000 nm.

4. A method, according to claim 1, wherein the at least one camera has a sensitivity between 7 and 14 micrometers.

5. A method, according to claim 1, wherein the compartment is a cargo by of an aircraft.

6. A method, according to claim 3, wherein the at least one camera generates 640×

480 pixels per frame.

7. A method, according to claim 6, wherein the at least one camera is a CCD camera.

8. A method, according to claim 6, wherein the at least one camera is CMOS camera.

9. A method according to claim 3, wherein the at least one camera provides gray scale output.

10. A method, according to claim 4, wherein the at least one camera is an IR camera.

11. A method, according to claim 5, wherein the screen displays different colors corresponding to different temperatures detected by the IR camera.

12. A method, according to claim 1, wherein the at least one camera generates 30 frames per second.

13. A method, according to claim 12, wherein one in ten frames is selected for processing.

14. A method, according to claim 1, wherein the at least one camera is mounted in an upper corner of the compartment.

15. A method, according to claim 1, further comprising:

providing at least one LED that provides illumination for the at least one camera.

16. A method, according to claim 15, wherein the at least one LED has an optical wave length of around 820 nanometers.

17. A method, according to claim 16, wherein there are a plurality of cameras and a plurality of LED'"'"'s and wherein each of the plurality of cameras has a corresponding one of the plurality of LED'"'"'s mounted therewith.

18. A method, according to claim 1, wherein there are a plurality of cameras and wherein at least one of the plurality of cameras has a sensitivity of between 400 nm and 1000 nm and at least one other of the plurality of cameras has a sensitivity of between 7 and 14 micrometers.

19. A method, according to claim 1, wherein enhancing includes using edge detection techniques to highlight features.

20. A method, according to claim 1, further comprising:

providing a synthesized three dimensional view on the screen.

21. A method, according to claim 2, wherein compensation for temperature includes using ambient temperature of the compartment to compensate signals from an IR camera.

24. The method of claim 1, wherein, after viewing at said first point in time and performing said fire suppression action, the method further comprises:

providing on the screen for viewing at a second point in time to visually inspect the compartment at least one of an image using the image signals or an enhanced image using the enhanced image signals in accordance with the selector switch.

25. The method of claim 1, wherein said fire suppression action includes spraying Halon.

26. The method of claim 25, wherein said enhancing includes filtering out image distortion caused by the spraying Halon.

27. The method of claim 24, wherein said enhanced video signals are provided on the screen for viewing at said second point in time.

22. A computer program product on a computer readable medium that allows viewing a compartment, the computer program product comprising:

executable code that receives image signals from at least one camera;

executable code that enhances the image signals to provide enhanced image signals;

executable code that provides image signals and enhanced image signals to a selector switch;

executable code that receives a video signal from the selector switch, wherein the video signal is one of the image signals or the enhanced image signals depending upon actuation of the selector switch;

executable code that displays on a screen at least one of an image using the image signals or an enhanced image using the enhanced image signals in accordance with actuation of the selector switch;

executable code that initiates a fire suppression action; and

executable code that provides an indicator indicating whether said fire suppression action is performed, wherein, when said indicator indicates that said fire suppression action is performed, said enhancing includes filtering the image signals to remove image distortion caused by said fire suppression action.

23. Apparatus that allows viewing a compartment, comprising:

at least one camera in the compartment, wherein the at least one camera provides image signals;

at least one selector switch;

at least one screen coupled to the selector switch;

a first component that provides an indicator indicating whether a fire suppression action is performed; and

at least one processor, coupled between the at least one camera and the at least one selector switch, wherein the at least one processor provides enhanced image signals by enhancing the image signals and wherein the at least one select switch selects for display on the at least one screen one of;

the image signals and the enhanced image signals, wherein when said indicator indicates that said fire suppression action is performed, said enhancing includes filtering the image signals to remove image distortion caused by said fire suppression action.