METHODS AND SYSTEMS FOR REMOTE SENSING WITH DRONES AND MOUNTED SENSOR DEVICES

• US 20170336203A1
• Filed: 10/26/2015
• Published: 11/23/2017
• Est. Priority Date: 10/26/2014
• Status: Abandoned Application

• Current Assignee: Galileo Group, Inc.
• Original Assignee: Galileo Group, Inc.
• Inventors: Barnes, Donald Michael, Grichnik, James Michael
• Application Number:
  US15/522,175
• Publication Number:
  US 20170336203A1
• Time in Patent Office: Days
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 11/34 Aerial triangulation
• CPC Class Codes: G01S 17/88 Lidar systems specially adapted for specific applications
• CPC Class Codes: G03B 15/006 Apparatus mounted on flying objects
• CPC Class Codes: G03B 15/0447 Energy sources; Batteries; Capacitors
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/104 involving a plurality of aircrafts, e.g. formation flying traffic control systems for aircraft G08G5/00

Abstract

A self-contained battery-operated device is fixedly mounted to a drone device in a plurality of drone devices. The first self-contained battery-operated device includes one or more processors, an accelerometer, a gyroscope, a location detection device, a two-dimensional pixilated detector, and memory, all connected by a common bus. Time-stamped images of an environmental region are captured using the two-dimensional pixilated detector at a time when the drone device is airborne. For each of the captured time-stamped images, a respective set of meta data is obtained, which includes (1) rotational values obtained using the gyroscope, indicating a relative orientation of the self-contained battery-operated device with respect to a respective reference orientation at a time of image capture, and (2) location information obtained using the location detection device at a time of image capture. The time-stamped images and the respective sets of meta data are sent to a remote processing device.

Claims

1. A method of remote sensing using a plurality of drone devices, comprising:

at a first self-contained battery operated device fixedly mounted to a first drone device in the plurality of drone devices, the first self-contained battery operated device including, connected by a common bus, one or more first processors, a first accelerometer, a first gyroscope, a first location detection device, a first two-dimensional pixilated detector, and memory for storing one or more programs for execution by the one or more first processors;

capturing one or more first time-stamped images of a first environmental region using the first two-dimensional pixilated detector at a time when the first drone device is airborne;

for each respective first time-stamped image of the captured one or more first time-stamped images, obtaining a respective set of meta data, the respective set including;

rotational values obtained using the first gyroscope, the rotational values indicating a relative orientation of the first self-contained battery operated device with respect to a respective reference orientation at a time when the respective first time-stamped image is captured; and

location information obtained using the first location detection device at a time when the respective first time-stamped image is captured; and

sending, to a remote processing device, the one or more first time-stamped images and the respective sets of meta data for the one or more first time-stamped images.

2. The method of claim 1, wherein capturing the one or more first time-stamped images includes storing the one or more first time-stamped images in a first memory location of the memory of the first self-contained battery operated device.

3. The method of claim 1, wherein the rotational values include roll, pitch, yaw axis values and wherein the meta data further comprises movement data from the first accelerometer.

4. The method of claim 1, wherein a respective set of meta data for a respective first time-stamped image further includes altitude information, indicating a respective altitude of the first self-contained battery operated device when the respective time-stamped image was captured.

5. The method of claim 1, wherein the one or more first time-stamped images are formatted to be stitched together using the respective sets of meta data, wherein stitching together the one or more first time-stamped images thereby forms a composite image.

6. The method of claim 1, further comprising:

receiving, from a remote control device over a wireless communications channel, and providing, to the first airborne drone device, one or more control commands for manipulating a flight pattern of the first airborne drone device.

7. The method of claim 6, wherein the one or more control commands correspond to commands for executing a flight pattern having an orbital trajectory.

8. The method of claim 6, wherein the one or more control commands correspond to commands for executing a flight pattern having a linear trajectory.

9. The method of claim 6, wherein sending the one or more first time-stamped images and the respective sets of meta data to the remote processing device includes transmitting the one or more first time-stamped images and the respective sets of meta data over the wireless communications channel.

10. The method of claim 6, wherein:

the first self-contained battery operated device is a first smart phone and the remote control device is a second smart phone, and

the control commands received from the second smart phone are based on user inputs detected within an instance of a drone control application executing on the second smart phone.

11. The method of claim 1, wherein the sending includes transferring the one or more first time-stamped images and the respective sets of meta data to the remote processing device via a wired interface.

12. The method of claim 1, wherein the sending includes transmitting the one or more first time-stamped images and the respective sets of meta data to the remote processing device via a wireless communications interface.

13. The method of claim 1, wherein:

the first self-contained battery operated device further comprises a communications device configured for communication using a cellular communication protocol, and

the sending includes transmitting to the remote processing device, with the cellular communication protocol, the one or more first time-stamped images and the respective sets of meta data.

14. The method of claim 13, wherein transmitting to the remote processing device is performed concurrently with capturing the one or more first time-stamped images.

15. The method of claim 1, wherein the one or more first time-stamped images comprise a video stream.

16. The method of claim 1, further comprising:

at a second self-contained battery operated device fixedly mounted to a second drone device, the second self-contained battery operated device including, connected by a common bus, one or more second processors, a second accelerometer, a second gyroscope, a second location detection device, a second two-dimensional pixilated detector, and memory for storing one or more programs for execution by the one or more second processors;

capturing one or more second time-stamped images of a second environmental region using the second two-dimensional pixilated detector at a time when the second drone device is airborne;

for each of the captured one or more second time-stamped images, obtaining a respective set of meta data, the respective set including;

rotational values obtained using the second gyroscope, the rotational values indicating a relative orientation of the second self-contained battery operated device with respect to a respective reference orientation at a time when the respective first time-stamped image is captured; and

location information obtained using the second location detection device at a time when the respective first time-stamped image is captured;

sending, to the remote processing device, the one or more second time-stamped images and the respective sets of meta data for the one or more second time-stamped images.

17. The method of claim 16, further comprising, at the second self-contained battery operated device:

receiving, from a remote control device over a wireless communications channel, and providing, to the first airborne drone device and the second airborne drone device, one or more control commands for manipulating respective flight patterns of the first airborne drone device and the second airborne drone device.

18. The method of claim 16, further comprising:

at the first self-contained battery operated device;

receiving, from a remote control device over a wireless communications channel, and providing, to the first airborne drone device, one or more control commands; and

at the second self-contained battery operated device;

receiving, from the remote control device over the wireless communications channel, and providing, to the second airborne drone device, the one or more control commands,

wherein the one or more control commands are based on an identified characteristic of the one or more first time-stamped images, the one or more second time-stamped images, the first environmental region, and/or the second environmental region, and

wherein the one or more control commands include one or more commands for remedying the identified characteristic.

19. The method of claim 17, wherein the identified characteristic corresponds to a portion of the one or more first and/or second time-stamped images for which insufficient image data and/or meta data was captured by the first self-contained battery operated device and/or the second self-contained battery operated device, and wherein the one or more control commands include instructions for capturing additional time-stamped images of the portion of the one or more first and/or second time-stamped images.

20. The method of claim 17, wherein the identified characteristic corresponds to a portion of the one or more first and/or second time-stamped images having a resolution that is below a resolution threshold, and wherein the one or more control commands include instructions for capturing additional time-stamped images, at a resolution higher than the resolution threshold, of the portion of the one or more first and/or second time-stamped images.

21-27. -27. (canceled)