SYSTEM AND METHOD OF AERIAL SURVEILLANCE

• US 20080144884A1
• Filed: 07/18/2007
• Published: 06/19/2008
• Est. Priority Date: 07/20/2006
• Status: Abandoned Application

• Current Assignee: Roboticvisiontech LLC
• Original Assignee: Roboticvisiontech LLC
• Inventors: Habibi, Babak
• Application Number:
  US11/779,812
• Publication Number:
  US 20080144884A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: B64U 10/30 Lighter-than-air aircraft, e.g. aerostatic aircraft
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2101/70 for use inside enclosed spaces, e.g. in buildings or in vehicles
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/0202 specially adapted to aircraft
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/19689 Remote control of cameras, e.g. remote orientation or image zooming control for a PTZ camera

Abstract

A system and method for an aerial surveillance system are disclosed. Briefly described, one embodiment comprises a lighter-than-air aerial platform, at least one image capture device carried by the lighter-than-air aerial platform and operable to sequentially capture a plurality of images, and at least one control surface physically coupled to the lighter-than-air aerial platform and operable to control direction of movement of the lighter-than-air aerial platform along a surveillance path in response to a guidance control signal determined in part upon the sequentially captured plurality of images.

Claims

1. An aerial surveillance method, the method comprising:

sequentially capturing a plurality of images of selected portions of a surveillance region;

automatically determining a surveillance path for a lighter-than-air aerial platform through the surveillance region based at least in part upon the sequentially captured plurality of images; and

moving the lighter-than-air aerial platform along the determined surveillance path.

2. The method of claim 1, further comprising:

processing the plurality of sequentially-captured images using a processing system carried on the lighter-than-air aerial platform; and

determining at least one guidance command to move the lighter-than-air aerial platform along the determined surveillance path.

3. The method of claim 1, further comprising:

communicating the plurality of sequentially-captured images to a remote base station;

processing the plurality of sequentially-captured images using a processing system residing in the remote base station;

dynamically determining at least one guidance command to move the lighter-than-air aerial platform along the determined surveillance path; and

communicating the at least one guidance command to the lighter-than-air aerial platform.

4. The method of claim 3, further comprising:

communicating the plurality of images over a network from the remote base station to a remote user station;

receiving at least one user specification identifying a location of interest in the surveillance region;

dynamically determining a second surveillance path for the lighter-than-air aerial platform through the surveillance region, wherein the second surveillance path starts from a current location of the lighter-than-air aerial platform and ends at the location of interest; and

moving the lighter-than-air aerial platform to the location of interest along the determined second surveillance path.

5. The method of claim 4, further comprising:

capturing at least one image of the location of interest;

communicating the at least one image of the location of interest to the remote base station; and

communicating the at least one image of the location of interest over the network to the remote user station.

6. The method of claim 4 where, in response to arriving at the location of interest, further comprising:

performing a task with the lighter-than-air aerial platform at the location of interest.

7. The method of claim 4 wherein communicating the plurality of images over the network further comprises:

accessing the remote user station using a dial-up connection.

8. The method of claim 4 wherein communicating the plurality of images over the network further comprises:

accessing an Internet; and

communicating the plurality of images to a website.

9. The method of claim 1, further comprising:

analyzing at least one of the plurality of sequentially-captured images to identify at least one location marker residing in the surveillance region;

dynamically determining a second surveillance path which avoids the detected at least one location marker; and

dynamically modifying the surveillance path to the second surveillance path such that the lighter-than-air aerial platform moves along the second surveillance path to avoid the detected at least one location marker.

10. The method of claim 1, further comprising:

analyzing at least one of the plurality of sequentially-captured images to identify at least one location marker residing in the surveillance region;

capturing an image of a region of interest that is associated with the at least one detected location marker; and

communicating the image of the region of interest to a remote base station.

11. The method of claim 1, further comprising:

analyzing at least one of the plurality of sequentially-captured images to identify at least one obstacle residing in the surveillance region;

dynamically determining a second surveillance path which avoids the detected at least one obstacle; and

dynamically modifying the surveillance path to the second surveillance path such that the lighter-than-air aerial platform moves along the second surveillance path to avoid the detected at least one obstacle.

12. The method of claim 1, further comprising:

receiving movement instructions from a remote base station;

dynamically determining a second surveillance path that modifies the surveillance path in accordance with the received movement instructions; and

moving the lighter-than-air aerial platform along the determined second surveillance path.

13. The method of claim 1, further comprising:

dynamically analyzing at least one of the plurality of sequentially-captured images to detect presence of an alarm condition;

where, in response to detecting a presence of the alarm condition, communicating at least one analyzed image associated with the alarm condition to a remote base station.

14. The method of claim 13 wherein communicating the plurality of images to the remote base station comprises:

communicating an alarm associated with the detected alarm condition to the remote base station.

15. The method of claim 1, further comprising:

receiving a surveillance request to locate an object of interest;

dynamically determining a second surveillance path that modifies the surveillance path in accordance with a search pattern for locating the object of interest;

moving the lighter-than-air aerial platform along the determined second surveillance path;

analyzing the sequentially captured plurality of images captured while moving along the determined second surveillance path until the object of interest is identified; and

communicating at least one captured image of the object of interest to a remote base station.

16. An aerial surveillance system, comprising:

a lighter-than-air aerial platform;

at least one image capture device carried by the lighter-than-air aerial platform and operable to sequentially capture a plurality of images; and

at least one control surface physically coupled to the lighter-than-air aerial platform and operable to control direction of movement of the lighter-than-air aerial platform along a surveillance path in response to a guidance control signal determined in part upon the sequentially captured plurality of images.

17. The aerial surveillance system of claim 16, further comprising:

a processing system carried by the lighter-than-air aerial platform and operable to dynamically generate the guidance control signal such that the lighter-than-air aerial platform independently patrols at least a three-dimensional surveillance region.

18. The aerial surveillance system of claim 17 wherein the surveillance path is determined in part by processing of the sequentially captured plurality of images in at least near real-time by the processing system.

19. The aerial surveillance system of claim 16, further comprising:

an aerial transceiver carried by the lighter-than-air aerial platform and communicatively coupled to the at least one image capture device, and operable to communicate the sequentially captured plurality of images to at least one remote base station on at least a near real-time basis.

20. The aerial surveillance system of claim 19, further comprising:

the at least one remote base station operable to receive at least one of the sequentially-captured images from the aerial transceiver and operable to dynamically generate the guidance control signal on at least the near real-time basis such that the lighter-than-air aerial platform independently patrols at least the surveillance region.

21. The aerial surveillance system of claim 20 wherein the surveillance path is determined in part by processing of the sequentially captured plurality of images on at least the near real-time basis by a processing system.

22. An aerial surveillance system, comprising:

at least one lighter-than-air aerial platform, comprising;

at least one image capture device carried by the lighter-than-air aerial platform and operable to sequentially capture a plurality of images; and

at least one control surface physically coupled to the lighter-than-air aerial platform and operable to control direction of movement of the lighter-than-air aerial platform along a surveillance path in response to a guidance control signal determined in part upon the sequentially captured plurality of images;

a remote base station communicatively coupled to the lighter-than-air aerial platform via a radio frequency (RF) signal and operable to receive data corresponding to at least one captured image from the lighter-than-air aerial platform; and

a remote user station communicatively coupled to the remote base station via a network, and operable to receive the at least one captured image.

23. The aerial surveillance system of claim 22 wherein the remote base station is operable to receive at least one user instruction from the remote user station that identifies at least one location of interest in a surveillance area, and wherein the remote base station comprises:

a processing system operable to dynamically determine a new surveillance path for the lighter-than-air aerial platform, and operable to communicate the new surveillance path to the lighter-than-air aerial platform such that the lighter-than-air aerial platform moves along the new surveillance path to the location of interest.

24. The aerial surveillance system of claim 22 wherein the remote base station comprises:

a processing system operable to analyze the received data corresponding to at least one captured image from the lighter-than-air aerial platform to identify at least one obstacle, and further operable to dynamically determine a new surveillance path for the lighter-than-air aerial platform that avoids the obstacle, such that the new surveillance path is communicated to the lighter-than-air aerial platform which moves along the new surveillance path to avoid the at least one identified obstacle.

25. The aerial surveillance system of claim 22 wherein the least one lighter-than-air aerial platform comprises:

a processing system operable to analyze the at least one captured image from the image capture device to identify at least one obstacle, and further operable to dynamically determine a new surveillance path for the lighter-than-air aerial platform that avoids the obstacle, such that the lighter-than-air aerial platform moves along the new surveillance path to avoid the at least one identified obstacle.

26. An aerial surveillance method, the method comprising:

obtaining information of interest of selected portions of a surveillance region;

automatically determining a surveillance path for a lighter-than-air aerial platform through the surveillance region based at least in part upon the obtained information; and

moving the lighter-than-air aerial platform along the determined surveillance path.

27. The aerial surveillance method of claim 26 wherein obtaining information of interest comprises:

capturing images with an image capture device.

28. The aerial surveillance system of claim 26 wherein obtaining information of interest comprises:

capturing video images with an video camera.

29. The aerial surveillance system of claim 26 wherein obtaining information of interest comprises:

obtaining acoustic information with a sonar device.

30. The aerial surveillance system of claim 26 wherein obtaining information of interest comprises:

laser information with laser scanning device.