System and method for graphically entering views of terrain and other features for surveillance

• US 9,860,489 B2
• Filed: 09/26/2013
• Issued: 01/02/2018
• Est. Priority Date: 09/26/2013
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Martignoni, III, Andrew Joseph, Paunicka, James Louis
• Primary Examiner(s): Sosanya, Obafemi
• Application Number:
  US14/038,100
• Publication Number:
  US 20150085112A1
• Time in Patent Office: 1,559 Days
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A surveillance system is disclosed that includes one or more data acquisition devices, an image database, and a processing system. The data acquisition devices are configured to acquire surveillance data from one or more geographic locations, and the image database stores image data for the one or more geographic locations. The processing system is configured to electronically display an image of one or more of the geographic locations using the image data stored in the image database. The processing system is further configured to accept input through a user interface to allow graphical manipulation of the displayed image in three-dimensional space to select a view of the geographical location that is to be subject to surveillance by the data acquisition devices. The displayed image selected by the user is employed to generate acquisition parameters for controlling the one or more data acquisition devices to surveil the geographical location corresponding to the displayed image.

Claims

1. A surveillance system comprising:

one or more data acquisition devices configured to acquire surveillance data from one or more geographic locations;

an image database storing image data for the one or more geographic locations; and

a processing system configured to;

electronically display an image of one or more of the geographic locations using the image data stored in the image database;

accept input through a user interface to allow graphical manipulation of the displayed image by a user, wherein the graphical manipulation is in three-dimensional space, and wherein the graphical manipulation allows the user to graphically select a view of the one or more geographic locations that is to be subject to surveillance by the one or more data acquisition devices; and

use the graphically selected view of the displayed image to generate acquisition parameters for controlling the one or more data acquisition devices, wherein the one or more data acquisition devices are moved by a drone from one geographical position to another geographical position by changing the graphically selected view of a three-dimensional view corresponding to the one or more geographical locations.

2. The surveillance system of claim 1, wherein the electronically displayed image of the one or more geographic locations and the user interface are incorporated into a mobile device.

3. The surveillance system of claim 1, wherein at least one of the data acquisition devices is an image acquisition device.

4. The surveillance system of claim 1, wherein the one or more data acquisition devices comprise a plurality of image acquisition devices.

5. The surveillance system of claim 1, wherein the one or more data acquisition devices are disposed at a plurality of separate geographic locations.

6. The surveillance system of claim 1, wherein the plurality of data acquisition devices are disposed to monitor a single geographic location.

7. The surveillance system of claim 1, wherein the one or more data acquisition devices comprise at least one of an infrared sensor and/or a magnetometer sensor.

8. The surveillance system of claim 1, wherein the acquisition parameters include field of view parameters.

9. The surveillance system of claim 1, wherein the acquisition parameters include an elevation parameter and an azimuth parameter.

10. The surveillance system of claim 1, wherein the acquisition parameters include a latitude parameter, a longitude parameter, and an altitude parameter.

11. The surveillance system of claim 1, wherein the acquisition parameters include a time parameter.

12. The surveillance system of claim 1, wherein the acquisition parameters include a sensor type parameter.

13. The surveillance system of claim 1, wherein the user interface comprises one or more of a pointing device, a keyboard, a touchscreen, a mobile device, an accelerometer, or gyroscope.

14. The surveillance system of claim 1, further comprising a data acquisition control system configured to transmit control data to the one or more acquisition devices based on the acquisition parameters.

15. The surveillance system of claim 10, further comprising a data acquisition control system configured to receive the surveillance data from the one or more data acquisition devices for display to the user.

16. The surveillance system of claim 11, wherein the surveillance data comprises image data, and wherein the surveillance system further comprises a database update system configured to update the image data stored in the image database.

17. The surveillance system of claim 1, wherein the one or more acquisition devices include an explosive materials detector.

18. The surveillance system of claim 1, wherein the one or more acquisition devices include locally executed facial recognition software.

19. A surveillance system comprising:

an image database storing image data for one or more geographic locations that may be subject to surveillance;

a graphical surveillance selection system configured to allow a user to manipulate a displayed image obtained from the image database in three-dimensional space to designate a view of the one or more geographic locations that is to be subject to surveillance by one or more data acquisition devices; and

a graphical-to-parametric conversion system configured to receive data corresponding to the designated view of the one or more geographical locations that is to be subject to surveillance from the graphical surveillance selection system, wherein the graphical-to-parametric conversion system converts the received data to acquisition parameters employed to control the one or more data acquisition devices, wherein the one or more data acquisition devices are moved by a drone from one geographical position to another geographical position by changing the designated view of a three-dimensional view corresponding to the one or more geographical locations.

20. The surveillance system of claim 19, further comprising a data acquisition control system configured to use the acquisition parameters to control the one or more data acquisition devices and to receive surveillance data from the one or more data acquisition devices.

21. The surveillance system of claim 20, wherein the data acquisition control system communicates acquisition parameters and/or control signals corresponding to the acquisition parameters to the one or more data acquisition devices.

22. The surveillance system of claim 19, wherein the graphical surveillance selection system is incorporated into a mobile device.

23. The surveillance system of claim 19, wherein the acquisition parameters include an azimuth parameter and elevation parameter.

24. The surveillance system of claim 19, wherein the acquisition parameters include a latitude parameter, longitude parameter, and an altitude parameter.

25. The surveillance system of claim 19, wherein the acquisition parameters include a time parameter.

26. The surveillance system of claim 19, wherein the plurality of data acquisition devices are disposed to monitor a single geographic location.

27. The surveillance system of claim 19, wherein the one or more data acquisition devices comprise at least one of an infrared sensor and/or a magnetometer sensor.

28. The surveillance system of claim 19, wherein the acquisition parameters include field of view parameters.

29. A method of conducting surveillance comprising:

electronically displaying an image of one or more geographic locations associated with one or more data acquisition devices, wherein the displayed image is generated using three-dimensional image data stored in an image database;

accepting user input to graphically manipulate the displayed image in three-dimensional space to select a view of the displayed image corresponding to the one or more geographic locations that are to be subject to surveillance; and

using the selected view of the displayed image to generate acquisition parameters for controlling the one or more image acquisition devices, wherein the one or more image acquisition devices are moved by a drone from one geographical position to another geographical position by changing the selected view of a three-dimensional view corresponding to the one or more geographical locations.

30. The method of surveillance of claim 29, wherein the generated acquisition parameters include a parameter selected from the group of a latitude parameter, a longitude parameter, an elevation parameter, an altitude parameter, an azimuth parameter, a field of view parameter, a zoom parameter, a time parameter, and a sensor type parameter.