Moving object detection using low illumination depth capable computer vision
First Claim
1. A computer vision system for detecting moving objects from a moving platform, the system comprising:
- an imaging subsystem for capturing scene image data at a plurality of times, the image data comprising information for deriving a depth measure for objects in the scene, the imaging subsystem for operation under low illumination conditions;
a computing subsystem communicatively coupled to the imaging subsystem for receiving the image data and for providing motion detection data based on an average scene disparity calculation, the motion detection data indicating the detection of independently moving objects within the scene; and
an output subsystem coupled to the computing subsystem for receiving the motion detection data and for providing a motion detection signal in response to the detection of one or more independently moving objects.
1 Assignment
0 Petitions
Accused Products
Abstract
Moving object detection is based on low illumination image data that includes distance or depth information. The vision system operates on a platform with a dominant translational motion and with a small amount of rotational motion. Detection of moving objects whose motions are not consistent with the movement of the background is complementary to shape-based approaches. For low illumination computer-based vision assistance a two-stage technique is used for simultaneous and subsequent frame blob correspondence. Using average scene disparity, motion is detected without explicit ego-motion calculation. These techniques make use of characteristics of infrared sensitive video data, in which heat emitting objects appear as hotspots.
105 Citations
20 Claims
-
1. A computer vision system for detecting moving objects from a moving platform, the system comprising:
-
an imaging subsystem for capturing scene image data at a plurality of times, the image data comprising information for deriving a depth measure for objects in the scene, the imaging subsystem for operation under low illumination conditions;
a computing subsystem communicatively coupled to the imaging subsystem for receiving the image data and for providing motion detection data based on an average scene disparity calculation, the motion detection data indicating the detection of independently moving objects within the scene; and
an output subsystem coupled to the computing subsystem for receiving the motion detection data and for providing a motion detection signal in response to the detection of one or more independently moving objects. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer based method for detecting moving objects from a moving platform under low illumination conditions, the method comprising the steps of:
-
capturing image data of a scene from a moving platform at two or more points in time, the image data including low illumination imaging information and depth related information;
processing the image data to determine three-dimensional coordinates for points corresponding to a plurality of objects in the scene;
calculating an average scene disparity from changes in the three-dimensional coordinates for a first subset of objects in the scene likely to be stationary;
calculating an estimated position shift for each object in a second subset of objects in the scene based at least in part on the average scene disparity;
calculating an actual position shift for each object in the second subset of objects in the scene based, at least in part, on the three-dimensional coordinates for said second subset of objects;
calculating a position error for each object in the second subset of objects in the scene based, at least in part, on the difference between the estimated position shift and the actual position shift for each object; and
detecting at least one moving object from the objects in the second subset of objects based, at least in part, on a comparison between the position error for said at least one object and an empirically determined-maximum threshold value. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer system for detecting moving objects from a moving platform under low illumination conditions, the system comprising the steps of:
-
means for capturing image data of a scene from a moving platform at two or more points in time, the image data including low illumination imaging information and depth related information;
means for processing the image data to determine three-dimensional coordinates for points corresponding to a plurality of objects in the scene;
means for calculating an average scene disparity from changes in the three-dimensional coordinates for a first subset of objects in the scene likely to be stationary;
means for calculating an estimated position shift for each object in a second subset of objects in the scene based at least in part on the average scene disparity;
means for calculating an actual position shift for each object in the second subset of objects in the scene based, at least in part, on the three-dimensional coordinates for said second subset of objects;
means for calculating a position error for each object in the second subset of objects in the scene based, at least in part, on the difference between the estimated position shift and the actual position shift for each object; and
means for detecting at least one moving object from the objects in the second subset of objects based, at least in part, on a comparison between the position error for said at least one object and an empirically determined maximum threshold value. - View Dependent Claims (15, 16, 17)
-
-
18. A pedestrian detection system in a vehicle for assisting a driver to detect pedestrians and other moving objects in a path of the vehicle during low illumination conditions, the pedestrian detection system comprising:
-
an infrared stereo vision module for capturing scene image data at a plurality of times, the image data comprising information for deriving a depth measure for objects in the scene, the infrared stereo vision module comprising a plurality of infrared-sensitive cameras configured to operate under low illumination conditions;
a data processing module communicatively coupled to the infrared stereo vision module for receiving the image data and for providing motion detection data based on an average stationary scene disparity calculation, the motion detection data indicating the detection of independently moving objects within the scene; and
an output interface coupled to the data processing module for receiving the motion detection data and for providing an output signal to a safety system processing unit within the vehicle for providing an alert signal to the driver in response to the detection of one or more pedestrians. - View Dependent Claims (19, 20)
-
Specification