AERIAL IMAGE COLLECTION

• US 20140257595A1
• Filed: 03/05/2013
• Published: 09/11/2014
• Est. Priority Date: 03/05/2013
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: Navteq B.V.
• Inventors: Tillmann, Marco
• Granted Patent: US 9,429,425 B2
• Time in Patent Office: Days
• US Class Current: 701/2
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 10/10 Rotorcrafts
• CPC Class Codes: B64U 10/14 with four distinct rotor axes, e.g. quadcopters
• CPC Class Codes: B64U 10/17 Helicopters flying platforms B64U10/13
• CPC Class Codes: B64U 10/60 Tethered aircraft
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: G01C 11/08 the pictures not being supported in the same relative position as when they were taken
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

In one embodiment, an aerial collection system includes an image collection field vehicle that travels at street level and an image collection aerial vehicle that travels in the air above the street. The aerial vehicle collects image data including at least a portion of the field vehicle. The field vehicle includes a marker, which is identified from the collected image data. The marker is analyzed to determine an operating characteristic of the aerial vehicle. In one example, the operating characteristic in the marker includes information for a flight instruction for the aerial vehicle. In another example, the operating characteristic in the marker includes information for the three dimensional relationship between the vehicles. The three dimensional relationship is used to combine images collected from the air and images collected from the street level.

Claims

1. A method comprising:

receiving image data of a terrestrial vehicle, wherein the image data is collected by an aerial vehicle;

identifying a marker from the image data; and

analyzing the marker to determine an operating characteristic of the aerial vehicle.

2. The method of claim 1, wherein the operating characteristic includes a flight instruction for the aerial vehicle.

3. The method of claim 2, wherein the flight instruction includes a height or a speed for the aerial vehicle.

4. The method of claim 1, wherein the operating characteristic includes an orientation of the aerial vehicle.

5. The method of claim 4, wherein the image data is a first panoramic image collected by the aerial vehicle, the method further comprising:

receiving a second panoramic image collected by the terrestrial vehicle; and

combining the first panoramic image and the second panoramic image based on the orientation of the aerial vehicle.

6. The method of claim 5, wherein combining the first panoramic image and the second panoramic image comprises interpolating the first panoramic image and the second image according to a variable rate.

7. The method of claim 6, wherein the variable rate varies according to elevation such that only the first panoramic image is used at a first height in a combined image and only the second panoramic image is used at a second height in the combined image, wherein the first height is greater than the second height.

8. The method of claim 1, wherein the marker is an augmented reality code or a quick response code.

9. The method of claim 1, wherein the marker is displayed on a display screen mounted on the terrestrial vehicle.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to;

receive image data of a marker, wherein the image data is collected by an aerial vehicle; and

analyzing the marker to determine an operating characteristic of the aerial vehicle.

11. The apparatus of claim 10, wherein the operating characteristic includes a flight instruction for the aerial vehicle.

12. The apparatus of claim 11, wherein the flight instruction includes a height for the aerial vehicle.

13. The apparatus of claim 11, wherein the operating characteristic includes a camera angle for a camera mounted on the aerial vehicle.

14. The apparatus of claim 10, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

receive a street side image collected by the terrestrial vehicle; and

combine the street side image with the image data collected by the aerial vehicle.

15. The apparatus of claim 10, wherein the street side image and the image data collected by the aerial vehicle are combined according to geometry derived from the marker.

16. The apparatus of claim 10, wherein the marker is an augmented reality code or a quick response code.

17. The apparatus of claim 10, further comprising:

a display mounted on the terrestrial vehicle and configured to display the marker, wherein the marker changes in time.

18. A non-transitory computer readable medium including instructions that when executed are operable to:

receive first image data collected by a terrestrial vehicle;

receive second image data collected by an aerial vehicle;

calculate a spatial relationship between the terrestrial vehicle and the aerial vehicle based on the second image data; and

combine the first image data and the second image data according to the spatial relationship between the terrestrial vehicle and the aerial vehicle.

19. The non-transitory computer readable medium of claim 18, the instructions configured to:

analyze the second image data to identify a flight command for the aerial vehicle.

20. The non-transitory computer readable medium of claim 18, wherein the second image data includes data depicting the terrestrial vehicle and a marker.