SYSTEMS AND METHODS FOR RECOGNIZING OBJECTS IN RADAR IMAGERY
First Claim
1. A system for detecting objects in a radar image stream, comprising:
- a flying vehicle;
a radar sensor on the flying vehicle;
a processor on the flying vehicle;
an object detection module loaded on the processor, the object detection module comprising a deep learning algorithm trained on a plurality of labeled radar image chips;
the processor configured to receive a stream of radar image data from the radar sensor, the processor further configured to provide the received stream of radar image data to the object detection module;
the object detection module programmed to invoke the deep learning algorithm to process the received stream of radar image data into a semantic label corresponding to a detected object in the stream; and
the processor further configured to provide the semantic label to an operational control module onboard the flying vehicle.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention is directed to systems and methods for detecting objects in a radar image stream. Embodiments of the invention can receive a data stream from radar sensors and use a deep neural network to convert the received data stream into a set of semantic labels, where each semantic label corresponds to an object in the radar data stream that the deep neural network has identified. Processing units running the deep neural network may be collocated onboard an airborne vehicle along with the radar sensor(s). The processing units can be configured with powerful, high-speed graphics processing units or field-programmable gate arrays that are low in size, weight, and power requirements. Embodiments of the invention are also directed to providing innovative advances to object recognition training systems that utilize a detector and an object recognition cascade to analyze radar image streams in real time. The object recognition cascade can comprise at least one recognizer that receives a non-background stream of image patches from a detector and automatically assigns one or more semantic labels to each non-background image patch. In some embodiments, a separate recognizer for the background analysis of patches may also be incorporated. There may be multiple detectors and multiple recognizers, depending on the design of the cascade. Embodiments of the invention also include novel methods to tailor deep neural network algorithms to successfully process radar imagery, utilizing techniques such as normalization, sampling, data augmentation, foveation, cascade architectures, and label harmonization.
-
Citations
16 Claims
-
1. A system for detecting objects in a radar image stream, comprising:
-
a flying vehicle; a radar sensor on the flying vehicle; a processor on the flying vehicle; an object detection module loaded on the processor, the object detection module comprising a deep learning algorithm trained on a plurality of labeled radar image chips; the processor configured to receive a stream of radar image data from the radar sensor, the processor further configured to provide the received stream of radar image data to the object detection module; the object detection module programmed to invoke the deep learning algorithm to process the received stream of radar image data into a semantic label corresponding to a detected object in the stream; and the processor further configured to provide the semantic label to an operational control module onboard the flying vehicle. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method for processing a radar data stream, comprising:
-
receiving, at a graphics processing unit onboard a flying vehicle, a stream of radar data generated by a synthetic aperture radar sensor; processing, by an object recognition module on the graphics processing unit, the stream of radar data into a semantic label corresponding to an object in the stream, the object recognition module comprising a deep learning algorithm; and providing the semantic label to an operational control module onboard the flying vehicle. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A system for assembling a database of labeled radar images for object recognition, comprising:
-
a processor onboard a flying vehicle, the processor configured to receive a stream of sensor data obtained from a synthetic aperture radar device onboard the flying vehicle; the processor further configured to process the stream of sensor data into a plurality of two-dimensional radar image chips, each chip including a set of pixels comprising magnitude and phase information derived from radar return signals in the stream of sensor data; the processor further configured to wrangle at least one of a set of semantic labels from each of the plurality of two-dimensional radar image chips; and the processor further configured to generate a database of labeled radar image chips as a result of the wrangling.
-
-
14. A system for training a deep learning network to recognize objects in a radar image, comprising:
-
a processor configured to receive a database of labeled radar image chips; the processor further configured to normalize the labeled radar image chips; the processor further configured to train a deep learning network recognizer cascade based on the normalized and labeled radar image chips, the deep learning network recognizer cascade including a deep learning network comprising at least 5 layers; the processor additionally configured to output the trained deep learning object recognizer cascade as a result of the training. - View Dependent Claims (15, 16)
-
Specification