Diverse Radio Frequency Signature, Video, and Image Sensing for Detection and Localization
First Claim
1. A method for coprocessing radio signals and video to identify and locate a radio transmitter, comprising:
- receiving positions and orientations for cameras and RF sensors;
receiving an RF signature associated with the radio transmitter from the RF sensors;
determining an RF persona associated with the RF signature;
estimating a first physical location for the radio transmitter according to a physical radio propagation model operating on signals associated with the RF sensors;
associating the RF persona with the first physical location;
receiving a video stream from one or more of the cameras covering an area associated with the RF sensors;
identifying an individual in the video stream using computer vision techniques;
estimating a second physical location for the radio transmitter according to the identified individual within the video stream;
establishing a first relationship between the first physical location and the second physical location;
establishing a second relationship between the RF persona and the identified individual; and
presenting the first established relationship and the second established relationship to one or more operator interfaces.
0 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods can support coprocessing radio signals and video to identify and locate a radio transmitter. Positions and orientations for cameras and RF sensors may be maintained. An RF signature associated with the radio transmitter may be received from the RF sensors to determine an RF persona. A first physical location for the radio transmitter may be estimated according to a physical radio propagation model operating on RF signals. A video stream from one or more of the cameras may be received. An individual may be identified in the video stream using computer vision techniques. A second physical location for the radio transmitter may be estimated from the video stream. Relationships may be established between the first physical location and the second physical location and between the RF persona and the identified individual. The relationships may be presented to an operator interface.
218 Citations
20 Claims
-
1. A method for coprocessing radio signals and video to identify and locate a radio transmitter, comprising:
-
receiving positions and orientations for cameras and RF sensors; receiving an RF signature associated with the radio transmitter from the RF sensors; determining an RF persona associated with the RF signature; estimating a first physical location for the radio transmitter according to a physical radio propagation model operating on signals associated with the RF sensors; associating the RF persona with the first physical location; receiving a video stream from one or more of the cameras covering an area associated with the RF sensors; identifying an individual in the video stream using computer vision techniques; estimating a second physical location for the radio transmitter according to the identified individual within the video stream; establishing a first relationship between the first physical location and the second physical location; establishing a second relationship between the RF persona and the identified individual; and presenting the first established relationship and the second established relationship to one or more operator interfaces. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system for determining a physical position of a radio transmitter, comprising:
-
one or more sensor antennas; one or more cameras; one or more RF sensors configured to couple radio frequency signals from the one or more sensor antennas and generate data samples representing at least a portion of the radio frequency signals; and a signal analysis engine comprising one or more processing units, and one or more processing modules configuring the one or more processing units to; receive positions and orientations associated with the cameras; receive positions and orientations associated with the RF sensors; receive an RF signature associated with the radio transmitter from the RF sensors; determine an RF persona associated with the RF signature; estimate a first physical location for the radio transmitter according to a physical radio propagation model operating on signals associated with the RF sensors; associate the RF persona with the first physical location; receive a video stream from the cameras covering an area associated with the RF sensors; identify an individual in the video stream using computer vision techniques; estimate a second physical location for the radio transmitter according to the identified individual within the video stream; establish an error distance between the first physical location and the second physical location; and refine the physical radio propagation model according to the error distance. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A system for coprocessing radio signals and video to identify and locate a radio transmitter, comprising:
-
one or more RF sensors within the electromagnetic environment; one or more cameras covering an area associated with the electromagnetic environment; one or more operator interfaces for communicating information associated with wireless devices; and a signal analysis engine comprising one or more processing units, and one or more processing modules configuring the one or more processing units to; receive positions and orientations for the cameras and the RF sensors; establish one or more geometrical transformations between a geometry associated with the cameras and a geometry associated with the RF sensors; receive an RF signature associated with the radio transmitter from the RF sensors; determine an RF persona associated with the RF signature; estimate a first physical location for the radio transmitter according to a physical radio propagation model operating on signals associated with the RF sensors; associate the RF persona with the first physical location; receive a video stream from one or more of the cameras; identify an individual in the video stream using computer vision techniques; estimate a second physical location for the radio transmitter according to the identified individual within the video stream; overlay the video stream with information associated with the RF persona; establish a first relationship between the first physical location and the second physical location; establish a second relationship between the RF persona and the identified individual; and present the first established relationship and the second established relationship to the one or more operator interfaces.
-
Specification