Video detection/verification system
First Claim
1. A method of detecting video phenomena, comprising:
- receiving a plurality of video images from a plurality of sources;
compensating the images to provide enhanced images;
extracting features from the enhanced images;
performing local fusion using said features for each set of enhanced images from each of the plurality of sources and producing a local fusion result for said each source related to a video phenomenon, wherein at least one of said features for one of the enhanced images is a numerical value characterizing a plurality of related pixels of said one enhanced image, said local fusion result for said each source being an indicator indicating whether said video phenomenon is present; and
combining the local fusion results for each of said plurality of sources to produce a final result indicating whether the video phenomenon is present.
2 Assignments
0 Petitions
Accused Products
Abstract
Detecting video phenomena, such as fire in an aircraft cargo bay, includes receiving a plurality of video images from a plurality of sources, compensating the images to provide enhanced images, extracting features from the enhanced images, and combining the features from the plurality of sources to detect the video phenomena. The plurality of sources may include cameras having a sensitivity of between 400 nm and 1000 nm and/or may include cameras having a sensitivity of between 7 and 14 micrometers. Extracting features may include determining an energy indicator for each of a subset of the plurality of frames. Detecting video phenomena may also include comparing energy indicators for each of the subset of the plurality of frames to a reference frame. The reference frame corresponds to a video frame taken when no fire is present, video frame immediately preceding each of the subset of the plurality of frames, or a video frame immediately preceding a frame that is immediately preceding each of the subset of the plurality of frames.
-
Citations
108 Claims
-
1. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; performing local fusion using said features for each set of enhanced images from each of the plurality of sources and producing a local fusion result for said each source related to a video phenomenon, wherein at least one of said features for one of the enhanced images is a numerical value characterizing a plurality of related pixels of said one enhanced image, said local fusion result for said each source being an indicator indicating whether said video phenomenon is present; and combining the local fusion results for each of said plurality of sources to produce a final result indicating whether the video phenomenon is present. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 11, 13, 14, 15, 16, 17, 23, 24, 25, 26, 27, 31, 32, 51, 52, 53, 54, 57, 58, 103, 104, 105, 106, 107, 108)
-
-
10. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; and combining the features from the plurality of sources to detect the video phenomena, wherein combining features includes using a multiple model estimator.
-
-
12. A method for detecting fire in an aircraft cargo bay, comprising:
-
providing a plurality of cameras in the cargo bay; obtaining image signals from the cameras; compensating the image signals to provide enhanced image signals, wherein said compensating includes performing processing using at least one input parameter determined in accordance with one or more external input values, at least one of said external input values indicating an environmental condition; extracting features from the enhanced image signals, wherein at least one of the features of at least one enhanced image signal is a numerical value characterizing a plurality of related pixels thereof; and combining the features to detect the presence of fire, said combining including producing a local fusion result for each of said cameras, said local fusion result being an indicator indicating whether fire is present, said combining also including producing a final result in accordance with said local fusion result for each of said cameras. - View Dependent Claims (101)
-
-
18. A method for detecting fire in an aircraft cargo bay, comprising:
-
providing a plurality of cameras in the cargo bay; obtaining image signals from the cameras; enhancing the image signals to provide enhanced image signals; extracting features from the enhanced image signals; and combining the features to detect the presence of fire, wherein combining the features includes using information provided by a cargo bay smoke detector.
-
-
19. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that performs local fusion using said features for each set of enhanced images from each of the plurality of sources and produces a local fusion result for said each source related to a video phenomenon, wherein at least one of said features for one of the enhanced images is a numerical value characterizing a plurality of related pixels of said one enhanced image, said local fusion result for said each source being an indicator indicating whether said video phenomenon is present; and executable code that combines the local fusion results for each of said plurality of sources to produce a final result indicating whether the video phenomenon is present. - View Dependent Claims (37, 38, 39, 40, 41, 45, 46, 59, 60, 61, 62, 65, 66)
-
-
20. An apparatus that detects video phenomena, comprising:
-
a plurality of cameras; and at least one processor, coupled to said cameras, wherein said processor receives a plurality of video images from a plurality of sources, compensates the images to provide enhanced images, extracts features from the enhanced images, performs local fusion using said features for each set of enhanced images from each of the plurality of sources and produces a local fusion result for said each source related to a video phenomenon, wherein at least one of said features for one of the enhanced images is a numerical value characterizing a plurality of related pixels of said one enhanced image, said local fusion result for said each source being an indicator indicating whether said video phenomenon is present, and combines the local fusion results for each of said plurality of sources to produce a final result indicating whether the video phenomenon is present. - View Dependent Claims (21, 22)
-
-
28. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; and combining the features from the plurality of sources to detect the video phenomena, wherein said compensating includes adjusting a video image for vibration and wherein said compensation includes performing temperature compensation for at least one of said plurality of video images obtained using an IR camera.
-
-
29. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; and combining the features from the plurality of sources to detect the video phenomena, wherein said compensating includes adjusting a video image for vibration and wherein said compensation includes performing calibration in accordance with an age of a camera used to obtain at least one of said plurality of video images.
-
-
30. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; and combining the features from the plurality of sources to detect the video phenomena, wherein said compensating includes adjusting a video image for vibration and wherein said compensation uses at least one external input value including one of;
results from a smoke detection control unit, ambient temperature used in IR camera image compensation, an aircraft altitude signal, and a cargo bay door open signal.
-
-
33. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; combining the features from the plurality of sources to detect the video phenomena, wherein said compensating includes adjusting a video image for vibration; and filtering image noise due to a vibration using a Wiener filter, wherein said vibration is due to an unstable camera due to vibration; and processing a video image in the frequency domain using a homomorphic filter to perform simultaneous brightness range compression and contrast enhancement.
-
-
34. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; combining the features from the plurality of sources to detect the video phenomena, wherein said compensating includes adjusting a video image for vibration; and filtering image noise due to a vibration using a Wiener filter, wherein said vibration is due to an unstable camera due to vibration; and applying a logarithmic transformation to a video image to split the illumination and reflection components producing a resulting image which is processed in the frequency domain where functions of brightness range compression and contrast enhancement are performed simultaneously.
-
-
35. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; combining the features from the plurality of sources to detect the video phenomena, wherein said compensating includes adjusting a video image for vibration; and filtering image noise due to a vibration using a Wiener filter, wherein said vibration is due to an unstable camera due to vibration; and using matrix multiplication on a video image to suppress a camera vibration effect wherein the elements of a matrix used in the matrix multiplication are determined and verified in accordance with at least one vibration pattern observed in an aircraft environment. - View Dependent Claims (36)
-
-
42. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena, wherein said executable code that compensates includes executable code that adjusts a video image for vibration, and wherein said executable code that compensates includes executable code that performs temperature compensation for at least one of said plurality of video images obtained using an IR camera.
-
-
43. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena, wherein said executable code that compensates includes executable code that adjusts a video image for vibration, and wherein said executable code that compensates includes executable code that performs calibration in accordance with an age of a camera used to obtain at least one of said plurality of video images.
-
-
44. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena, wherein said executable code that compensates includes executable code that adjusts a video image for vibration, and wherein said executable code that compensates uses at least one external input value including one of;
results from a smoke detection control unit, ambient temperature used in IR camera image compensation, an aircraft altitude signal, and a cargo bay door open signal.
-
-
47. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena, wherein said executable code that compensates includes executable code that adjusts a video image for vibration; executable code that filters image noise due to a vibration using a Wiener filter, wherein said vibration is due to an unstable camera due to vibration; and executable code that processes a video image in the frequency domain using a homomorphic filter to perform simultaneous brightness range compression and contrast enhancement.
-
-
48. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena, wherein said executable code that compensates includes executable code that adjusts a video image for vibration; executable code that filters image noise due to a vibration using a Wiener filter, wherein said vibration is due to an unstable camera due to vibration; and executable code that applies a logarithmic transformation to a video image to split the illumination and reflection components producing a resulting image which is processed in the frequency domain where functions of brightness range compression and contrast enhancement are performed simultaneously.
-
-
49. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena, wherein said executable code that compensates includes executable code that adjusts a video image for vibration; executable code that filters image noise due to a vibration using a Wiener filter, wherein said vibration is due to an unstable camera due to vibration; and executable code that suppresses a camera vibration effect using matrix multiplication on a video image wherein the elements of a matrix used in the matrix multiplication are determined and verified in accordance with at least one vibration pattern observed in an aircraft environment. - View Dependent Claims (50)
-
-
55. A method of detecting video phenomena, comprising:
-
receiving a plurality of video images from a plurality of sources; compensating the images to provide enhanced images; extracting features from the enhanced images; combining the features from the plurality of sources to detect the video phenomena; detecting a hotspot in a first video image; enhancing said video image using a gray level slicing technique to highlight a specific range of gray levels associated with a hotspot-related feature. - View Dependent Claims (56)
-
-
63. A computer program product stored on a computer readable medium that detects video phenomena, comprising:
-
executable code that receives a plurality of video images from a plurality of sources; executable code that compensates the images to provide enhanced images; executable code that extracts features from the enhanced images; executable code that combines the features from the plurality of sources to detect the video phenomena; executable code that detects a hotspot in a first video image; and executable code that enhances said video image using a gray level slicing technique to highlight a specific range of gray levels associated with a hotspot-related feature. - View Dependent Claims (64)
-
-
67. A method of detecting fire in an aircraft cargo bay comprising:
-
receiving a plurality image frames from a plurality of cameras in the cargo bay; enhancing the plurality of image frames to compensate for a condition associated with at least one of;
a camera condition and a cargo bay condition;selecting a portion of each of said plurality of image frames; extracting features from said portions, wherein at least one of said features for each of said portions is a numerical value characterizing a plurality of related pixels included in said each portion; performing local fusion using said features for each set of enhanced image frames from each of the plurality of cameras and producing a local fusion result for said each set of enhanced image frames from each camera, said local fusion result for each camera being an indicator indicating whether fire is present; and combining the local fusion results for each set of enhanced images to produce a final result indicating whether a fire is present. - View Dependent Claims (68, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83)
-
-
69. A method of detecting fire in an aircraft cargo bay comprising:
-
receiving a plurality image frames from a plurality of cameras in the cargo bay; enhancing the plurality of image frames to compensate for a condition associated with at least one of;
a camera condition and a cargo bay condition;selecting a portion of each of said plurality of image frames; extracting features from said portions; and using the extracted features to detect the presence of fire, wherein said cargo bay condition includes known hot spots within said cargo bay, and wherein at least one of said known hot spots is caused by at least one of;
temperature of cargo in the cargo bay, a mechanical cooler generating a hot spot, and an aircraft being in a warm area.
-
-
84. A computer program product stored on a computer readable medium that detects fire in an aircraft cargo bay comprising:
-
executable code that receives a plurality image frames from a plurality of cameras in the cargo bay; executable code that enhances the plurality of image frames to compensate for a condition associated with at least one of;
a camera condition and a cargo bay condition;executable code that selects a portion of each of said plurality of image frames; executable code that extracts features from said portions, wherein at least one of said features for each of said portions is a numerical value characterizing a plurality of related pixels included in said each portion; executable code that performs local fusion using said features for each set of enhanced image frames from each of the plurality of cameras and produces a local fusion result for said each set of enhanced image frames from each camera, said local fusion result for each camera being an indicator indicating whether fire is present; and combining the local fusion results for each set of enhanced images to produce a final result indicating whether the fire is present. - View Dependent Claims (85, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100)
-
-
86. A computer program product stored on a computer readable medium that detects fire in an aircraft cargo bay comprising:
-
executable code that receives a plurality image frames from a plurality of cameras in the cargo bay; executable code that enhances the plurality of image frames to compensate for a condition associated with at least one of;
a camera condition and a cargo bay condition;executable code that selects a portion of each of said plurality of image frames; executable code that extracts features from said portions, wherein said cargo bay condition includes known hot spots within said cargo bay; and executable code that uses the extracted features to detect the presence of firewherein at least one of said known hot spots is caused by at least one of;
temperature of cargo in the cargo bay, a mechanical cooler generating a hot spot, and an aircraft being in a warm area.
-
-
102. A method for detecting fire in an aircraft cargo bay, comprising:
-
providing a plurality of cameras in the cargo bay; obtaining image signals from the cameras; compensating the image signals to provide enhanced image signals, wherein said compensating is performed in accordance with one or more external input values, at least one of said external input values indicating an environmental condition; extracting features from the enhanced image signals; and combining the features to detect the presence of fire, wherein said external input values includes at least one value indicating a flight profile condition of an aircraft, said flight profile condition of an aircraft being associated with one of a plurality of flight profiles including loading, landing, taking off, and cruising.
-
Specification