Coordinating sensor platforms performing persistent surveillance

• US 10,359,287 B2
• Filed: 12/05/2014
• Issued: 07/23/2019
• Est. Priority Date: 12/05/2014
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Kreienheder, Charles Robert, Sheffield, Gregory L.
• Primary Examiner(s): Bythrow, Peter M
• Assistant Examiner(s): Seraydaryan, Helena H
• Application Number:
  US14/561,876
• Publication Number:
  US 20170199039A1
• Time in Patent Office: 1,691 Days
• Field of Search: 342 22, 342 29- 32, 342702, 342 52
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64D 47/08 Arrangements of cameras
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2101/31 for surveillance
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 21/005 with correlation of navigation data from several sources, e.g. map or contour matching G01C21/30 takes precedence
• CPC Class Codes: G01S 13/003 Bistatic radar systems; Multistatic radar systems
• CPC Class Codes: G01S 13/88 Radar or analogous systems specially adapted for specific applications electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/104 involving a plurality of aircrafts, e.g. formation flying traffic control systems for aircraft G08G5/00

Abstract

A method and apparatus for controlling a set of sensor platforms. The apparatus comprises a map manager and a controller. The manager creates a visibility map for an area of interest for a set of sensor platforms. The map manager further updates the visibility map over time while the set of sensor platforms monitors the area of interest. The controller controls a route of each of the set of sensor platforms using the visibility map.

Claims

1. An apparatus comprising:

a map manager that creates a visibility map for an area of interest for a set of sensor platforms, wherein the visibility map identifies a number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms, and that updates the visibility map over time to change the identification of the number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms while the set of sensor platforms monitors the area of interest as sensor platforms in the set of sensor platforms move in positions with respect to the area of interest to change lines of sight of the sensor platforms with respect to the area of interest; and

a controller that controls a route of movement of each of the set of sensor platforms to different positions with respect to the area of interest using the visibility map by;

identifying a plurality of candidate positions for moving a sensor platform in the set of sensor platforms based on a current position of the sensor platform,

creating a plurality of candidate visibility maps comprising a candidate visibility map for each of the plurality of candidate positions, wherein each candidate visibility map in the plurality of candidate visibility maps identifies a number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms with the sensor platform at one of the candidate positions,

identifying a candidate visibility map in the plurality of candidate visibility maps that identifies the largest number of locations within the area of interest that are visible to at least one sensor platform in the plurality of sensor platforms as compared to other candidate visibility maps in the plurality of candidate visibility maps, and

controlling the sensor platform to move from the current position of the sensor platform to the candidate position in the plurality of candidate positions for which the candidate visibility map identifies the largest number of locations within the area of interest that are visible to at least one sensor platform in the plurality of sensor platforms.

2. The apparatus of claim 1, wherein the map manager creates the visibility map using an elevation map of the area of interest.

3. The apparatus of claim 2, wherein the map manager updates a plurality of grid points in the visibility map at a selected time based on a visibility of a location corresponding to each of the plurality of grid points to the set of sensor platforms.

4. The apparatus of claim 1 further comprising:

the set of sensor platforms.

5. The apparatus of claim 4, wherein the each of the set of sensor platforms comprises:

a sensor system that generates surveillance data for a portion of the area of interest in a line of sight of the sensor system, wherein the portion of the area of interest that is in the line of sight of the sensor system changes over time.

6. The apparatus of claim 4, wherein a quantity of sensor platforms that is in the set of sensor platforms changes over time.

19. The apparatus of claim 4 wherein the set of sensor platforms comprises a set of unmanned aerial vehicles.

7. A method for controlling a set of sensor platforms, the method comprising:

creating a visibility map for an area of interest for the set of sensor platforms, wherein the visibility map identifies a number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms;

updating the visibility map over time to change the number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms as the set of sensor platforms monitor the area of interest while sensor platforms in the set of sensor platforms move in positions with respect to the area of interest to change lines of sight of the sensor platforms with respect to the area of interest; and

controlling a route of movement of each of the set of sensor platforms to different positions with respect to the area of interest using the visibility map by;

identifying a plurality of candidate positions for moving a sensor platform in the set of sensor platforms based on a current position of the sensor platform,

creating a plurality of candidate visibility maps comprising a candidate visibility map for each of the plurality of candidate positions, wherein each candidate visibility map in the plurality of candidate visibility maps identifies a number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms with the sensor platform at one of the candidate positions,

identifying a candidate visibility map in the plurality of candidate visibility maps that identifies the largest number of locations within the area of interest that are visible to at least one sensor platform in the plurality of sensor platforms as compared to other candidate visibility maps in the plurality of candidate visibility maps, and

controlling the sensor platform to move from the current position of the sensor platform to the candidate position in the plurality of candidate positions for which the candidate visibility map identifies the largest number of locations within the area of interest that are visible to at least one sensor platform in the plurality of sensor platforms.

8. The method of claim 7, wherein creating the visibility map comprises:

creating the visibility map for the area of interest using an elevation map of the area of interest.

9. The method of claim 7, wherein creating the visibility map comprises:

creating the visibility map having a plurality of grid points that correspond to a plurality of locations in the area of interest; and

assigning an initialization value to each of the plurality of grid points.

10. The method of claim 9, wherein assigning the initialization value comprises:

assigning a selected minimum value to each grid point in the plurality of grid points.

11. The method of claim 9, wherein updating the visibility map over time comprises:

determining whether a location in the area of interest corresponding to a grid point in the plurality of grid points is visible to at least one of the set of sensor platforms at a selected time; and

assigning a new value corresponding to the selected time to the grid point in response to a determination that the location is visible by the at least one of the set of sensor platforms at the selected time.

12. The method of claim 11, wherein determining whether the location is visible to the at least one of the set of sensor platforms comprises:

determining whether the at least one of the set of sensor platforms has a line of sight to the location in the area of interest corresponding to the grid point based on an elevation map and a current position of the each of the set of sensor platforms.

13. The method of claim 11, wherein updating the visibility map over time further comprises:

preserving a current value assigned to the grid point in response to a determination that the location is not visible by the at least one of the set of sensor platforms at the selected time.

14. The method of claim 7 further comprising:

generating a score for each of the plurality of candidate positions using the corresponding candidate visibility map for each of the plurality of candidate positions; and

selecting the candidate position from the plurality of candidate positions having a highest score as a next position for the sensor platform.

15. The method of claim 7, wherein controlling the route of the each of the set of sensor platforms further comprises:

creating a route segment for a corresponding route for the sensor platform between the current position of the sensor platform and the candidate position in the plurality of candidate positions for which the candidate visibility map identifies the largest number of locations within the area of interest that are visible to at least one sensor platform in the plurality of sensor platforms; and

sending a number of commands to the sensor platform to cause the sensor platform to move along the route segment.

16. The method of claim 7, wherein identifying the plurality of candidate positions comprises:

identifying a selected number of positions as the plurality of candidate positions in which each of the selected number of positions has a substantially equal distance from the current position of the sensor platform.

20. The method of claim 7, wherein the set of sensor platforms comprises a set of unmanned aerial vehicles.

17. A persistent surveillance system comprising:

a set of sensor platforms that monitor an area of interest, wherein the set of sensor platforms comprises a set of unmanned aerial vehicles associated with a set of sensor systems;

a map manager that creates a visibility map for the area of interest for the set of sensor platforms, wherein the visibility map identifies a number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms, and that updates the visibility map over time to change the number of locations within the area of interest that are visible to at least one sensor platform in the set of sensor platforms while the set of sensor platforms monitors the area of interest as sensor platforms in the set of sensor platforms move in positions with respect to the area of interest to change lines of sight of the sensor platforms with respect to the area of interest; and

a controller that controls a route of movement of each of the set of sensor platforms using the visibility map to achieve a highest collective visibility of the area of interest over time.

18. The persistent surveillance system of claim 17 wherein the set of sensor systems comprises a set of imaging systems.