METHOD OF OBTAINING GEOGRAPHICALLY RELATED IMAGES USING A VEHICLE

• US 20180120105A1
• Filed: 12/18/2017
• Published: 05/03/2018
• Est. Priority Date: 04/22/2007
• Status: Active Grant

• Current Assignee: iLOOKabout, Inc.
• Original Assignee: iLOOKabout, Inc.
• Inventors: Hack, Jeffrey
• Granted Patent: US 10,139,225 B2
• Time in Patent Office: Days
• CPC Class Codes: G01C 11/00 Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
• CPC Class Codes: G01C 21/28 with correlation of data from several navigational instruments
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 22/02 by conversion into electric waveforms and subsequent integration, e.g. using tachometer generator G01C22/002, G01C22/004, G01C22/006 take precedence

Abstract

The method employs a computer interconnected with a GPS transceiver and a distance measurement means and operatively interconnected with a digital camera, all provided on a moving vehicle, in order to acquire a plurality of geographic location related images. A first geographic position is obtained from the GPS transceiver and a plurality of distance measurements are then received before a second geographic position is taken. A photo request is generated after a pre-determined distance has been traveled, as determined by the distance measurement means, and transmitted to the digital camera. The camera takes a photo based on the request and the photos, photo requests, first and second positions and distance measurements are stored for post-processing. The post-processing determines a path traveled by the vehicle using the positions and distance measurements in order to determine an accurate geographic location and orientation for each photo. The method is particularly suitable for use in building a database of geographically related images.

Claims

1. A method of obtaining digital images related to geographic locations, the method comprising:

providing a moving vehicle having thereon a computer having a computer clock interconnected with a GPS transceiver and distance measurement structure configured to measure a distance traveled by the vehicle from a first geographic position, the computer operatively interconnected with a digital camera having a camera clock mounted on the vehicle;

receiving into the computer the first geographic position from the GPS transceiver;

receiving into the computer a measurement of the distance traveled by the vehicle relative to the first geographic position from the distance measurement structure;

selecting a pre-determined distance based on a distance between a subject of a photo to be acquired and the camera;

determining when the pre-determined distance has been traveled by the vehicle based on the measurement of distance;

generating a photo request using the computer on the vehicle for the digital camera on the vehicle at the pre-determined distance, the photo request having an associated photo request time comprising a computer time value obtained from the computer clock, the photo request resulting in a shutter release by the digital camera;

taking a digital photo using the camera on the vehicle based on the shutter release, the digital photo having an associated photo time comprising a camera time value obtained from the camera clock;

repeating the steps of receiving into the computer the measurement of distance traveled by the vehicle, determining when the pre-determined distance has been traveled, generating a photo request using the computer resulting in a shutter release by the digital camera and taking a digital photo using the camera on the vehicle based on the shutter release;

receiving into the computer a second geographic position from the GPS transceiver;

storing the photos, associated photo times, photo requests, associated photo request times, first and second geographic positions and distance measurements;

conducting a processing step comprising;

associating each photo with the photo request used to generate that photo by comparing camera time values of a plurality of photos with computer time values of a plurality of photo requests;

determining a computer time value associated with each photo based on the computer time value of the photo request; and

,

obtaining a location of each photo based on the computer time value of the photo.

2. The method of claim 1, wherein the vehicle is land-based.

3. The method of claim 1, wherein the vehicle comprises an automobile and wherein the distance measurement structure comprises a wheel speed sensor connected to each of the automobile'"'"'s rear wheels.

4. The method of claim 3, wherein the processing step further comprises calculating a difference in the distance measurements from the two wheels.

5. The method of claim 4, wherein the processing step further comprises calculating a change in vehicle orientation based on the difference;

6. The method of claim 5, wherein the processing step further comprises iteratively fitting a plurality of path segments using the change in orientation and distance traveled by the vehicle, each path segment having a fixed length corresponding to the pre-determined distance and having an associated vehicle orientation comprising the direction in which the vehicle has turned and the number of degrees in the turn, to a path traveled by the vehicle between the first and second geographic positions.

7. The method of claim 6, wherein the path is iteratively fit in three dimensional Cartesian space by an error minimization solver uses at least i) the diameter of each wheel or the ratio of the diameters of the two wheels, ii) the wheel speed of each wheel, iii) the track width, iv) the three components of an initial position in the Cartesian space corresponding to the first geographic position, and v) an initial heading of the vehicle.

8. The method of claim 6, wherein the processing step further comprises correcting at least one photo to a rectilinear perspective based on the associated vehicle orientation of the path segment corresponding to the photo.

9. The method of claim 8, wherein the correcting of each photo to a rectilinear perspective is further based on a field of view of a lens of the digital camera to provide a centered perpendicular image orientation for the photo.

10. The method of claim 1, wherein the digital camera is a still-image camera with a resolution of at least 6 megapixels.

11. The method of claim 1, wherein the digital camera is equipped with a lens having a field of view of at least 160°

.

12. The method of claim 1, wherein the digital photos are adjacent to one another and share overlapping visual elements.

13. The method of claim 1, wherein the vehicle travels at a speed of at least 35 km/h while photos are being taken.

14. The method of claim 1, wherein the vehicle is equipped with at least two digital cameras oriented in opposite directions to one another and wherein each photo request is directed to all cameras.

15. The method of claim 1, wherein the error minimization solver comprises a Levinburg-Marquardt algorithm.

16. The method of claim 1, wherein the distance measurement structure comprises a pair of laterally spaced apart independently rotating wheels, the wheels spaced apart by a track width, the distance measurement structure simultaneously providing wheel speed measurements from each wheel, the wheel speed measurements and a diameter of each wheel being used to calculate a distance traveled by each wheel.

17. The method of claim 1, wherein determining the computer time value associated with each photo is further based on a lag value that accounts for time differences between the generation of the photo request and the taking of the photo, the lag value quantified by comparing camera time values of a plurality of photos with computer time values of a plurality of photo requests.