Methods and apparatus for performing angular measurements

• US 8,818,044 B2
• Filed: 01/18/2013
• Issued: 08/26/2014
• Est. Priority Date: 01/08/2009
• Status: Active Grant

• Current Assignee: Trimble Inc.
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Sharp, Kevin
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): Harandi, Siamak
• Application Number:
  US13/745,358
• Publication Number:
  US 20140036066A1
• Time in Patent Office: 585 Days
• Field of Search: None
• US Class Current: 382/106
• CPC Class Codes: G01B 11/26 for measuring angles or tapers; for testing the alignment of axes
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

A method of determining an azimuth and elevation of a point in an image is provided. The method comprises positioning an imaging device at a first position and acquiring a first image. The method also comprises rotating the imaging device and acquiring a second image at the first position. The first image includes the point, and a portion of the first image overlaps a portion of the second image. The method also includes determining correspondences between features in overlapping portions of the images, determining a first transformation between coordinates of the first image and coordinates of the second image based on the correspondences, and determining a second transformation between the coordinates of the second image and a local coordinate frame. The method also includes computing the azimuth and elevation of the point based on the first transformation and the second transformation.

Claims

1. A method of determining an azimuth and an elevation of a point in a real world coordinate system, the method comprising:

positioning an imaging device at a first position, the imaging device calibrated to provide a relationship between a coordinate frame associated with the imaging device and a coordinate frame associated with images acquired by the imaging device;

acquiring a first image at the first position, the first image including the point;

performing a first rotation of the imaging device without substantially changing an optical center of the imaging device;

acquiring a second image at the first position, where a portion of the first image overlaps a portion of the second image;

determining correspondences between features in overlapping portions of the first image and the second image;

determining a first transformation between coordinates of the first image and coordinates of the second image based on the correspondences;

determining a second transformation between the coordinates of the first image or the coordinates of the second image and the real world coordinate system using the relationship between the coordinate frame associated with the imaging device and the coordinate frame associated with images acquired by the imaging device; and

computing the azimuth and the elevation of the point in the real world coordinate system based on the first transformation and the second transformation.

2. The method of claim 1 further comprising determining the azimuth and the elevation of each of a plurality of points in the real world coordinate system, at least some of the plurality of points visible in only the first image and at least some of the plurality of points visible in only the second image, the method comprising:

computing the azimuth and the elevation of each of the plurality of points visible in only the first image and the azimuth and the elevation of each of the plurality of points visible in only the second image based on the first transformation and the second transformation.

3. The method of claim 1 further comprising determining the azimuth and the elevation of a third point in the real world coordinate system, the method comprising:

performing a second rotation of the imaging device without substantially changing the optical center of the imaging device;

after performing the second rotation, acquiring the third image at the first position, the third image including the third point, where a second portion of the second image overlaps a portion of the third image;

determining correspondences between features in overlapping portions of the second image and the third image;

determining a third transformation between coordinates of the second image and coordinates of the third image based on the correspondences between overlapping portions of the second image and the third image; and

computing the azimuth and the elevation of the third point in the real world coordinate system based on the second transformation and the third transformation.

4. The method of claim 1 wherein determining correspondences between features in the portion of the first image and the portion of the second image comprises:

determining pixel coordinates of each of the features in the first image and each of the features in the second image; and

thereafter

determining sub-pixel coordinates of each of the features in the first image and each of the features in the second image, wherein determining the sub-pixel coordinates comprises determining sub-pixel intensity gradients in an area surrounding each of the features and correcting for an image distortion associated with each of the features.

5. The method of claim 1 wherein coordinates of the first position in the real world coordinate system are known and coordinates of a second point in the real world coordinate system are known, the second point being visible in at least one of the first image or the second image, and wherein determining the second transformation comprises determining a vector from the first position in a direction of the second point.

6. The method of claim 1 further comprising aligning the imaging device with a gravity vector prior to acquiring the first image and the second image.

7. The method of claim 1 wherein coordinates of a second point in the real world coordinate system are known, the second point being visible in at least one of the first image or the second image, and wherein determining the second transformation comprises determining a vector between the coordinates of the second point in the real world coordinate system and coordinates of the second point in an image coordinate frame.

8. The method of claim 1 further comprising:

positioning the imaging device at a second position different from the first position;

acquiring a third image at the second position, the third image including the point;

determining a third transformation between the coordinates of the third image and the real world coordinate system using the relationship between the coordinate frame associated with the imaging device and the coordinate frame associated with images acquired by the imaging device;

computing the azimuth and the elevation of the point relative to the second position using the third transformation; and

computing coordinates of the point in the real world coordinate system.

9. The method of claim 1 wherein determining correspondences between features in the overlapping portions of the first image and the second image comprises:

determining descriptors for each of the features in the first image and each of the features in the second image; and

determining that at least a portion of the descriptors in the first image correspond to at least a portion of the descriptors in the second image.

10. The method of claim 9 wherein the descriptors are invariant to rotation of the imaging device.

11. The method of claim 9 wherein determining that at least a portion of the descriptors of the features in the first image correspond to at least a portion of the descriptors of the features in the second image comprises comparing an angular separation between a pair of features in the first image to an angular separation between a corresponding pair of features in the second image.

12. A method of determining a horizontal angle and a vertical angle between a first point visible in a first image and a second point visible in a second image, the method comprising:

obtaining a series of images including the first image and the second image using an imaging device, wherein a portion of each image in the series overlaps a portion of another image in the series and wherein each image in the series is obtained from a first position by rotating the imaging device without substantially changing an optical center of the imaging device, the imaging device calibrated to provide a relationship between a coordinate frame associated with the imaging device and a coordinate frame associated with images acquired by the imaging device;

determining correspondences between features in overlapping portions of images in the series of images;

determining first transformations between coordinates of overlapping images in the series of images based on the correspondences; and

computing the horizontal angle and the vertical angle between the first point and the second point based on the first transformations.

13. The method of claim 12 further comprising:

determining a second transformation between coordinates of an image in the series and a real world coordinate system using the relationship between the coordinate frame associated with the imaging device and the coordinate frame associated with images acquired by the imaging device, wherein computing the horizontal angle and the vertical angle between the first point and the second point further comprises computing an azimuth and an elevation of the first point and of the second point in the real world coordinate system based on the first transformations and the second transformation.

14. The method of claim 12 wherein determining the first transformations comprises applying a closure constraint.

15. A surveying apparatus comprising:

a support structure;

a rotatable member mechanically coupled to the support structure;

an imaging device mechanically coupled to the rotatable member, the imaging device calibrated to provide relationships between a coordinate frame associated with the imaging device and coordinate frames associated with images acquired by the imaging device, wherein the rotatable member is configured to rotate the imaging device without substantially changing a position of an optical center of the imaging device;

an image sensor disposed in the imaging device, the image sensor configured to acquire the images;

a memory in electrical communication with the image sensor, the memory configured to store the images; and

a processor in electrical communication with the image sensor and the memory, the processor configured to;

determine correspondences between features in overlapping portions of the images;

determine first transformations between coordinates of overlapping images based on the correspondences;

determine a second transformation between coordinates of one of the images and a real world coordinate system using the relationship between the coordinate frame associated with the imaging device and the coordinate frame associated with images acquired by the imaging device; and

compute an azimuth and an elevation of each of a plurality of points visible in the images, the azimuth and the elevation computed in the real world coordinate system based on the first transformations and the second transformation.

16. The surveying apparatus of claim 15 wherein the imaging device is a digital camera.

17. The surveying apparatus of claim 15 further comprising a digital display in electrical communication with the image sensor and the memory, the digital display configured to display the images acquired by the image sensor and the images stored in the memory.

18. The surveying apparatus of claim 15 further comprising:

a tilt sensor mechanically coupled to the surveying apparatus, the tilt sensor configured to determine alignment of the imaging device relative to a gravity vector.

19. The surveying apparatus of claim 18 wherein the processor is configured to determine the second transformation based at least in part on the gravity vector.

20. A method of registering a series of overlapping images acquired using an imaging device positioned at a first position in a real world coordinate system, the method comprising:

determining correspondences between features in overlapping portions of images in the series;

determining first transformations between coordinates of overlapping images in the series, the first transformations determined based on the correspondences; and

determining a second transformation between coordinates of an image in the series and the real world coordinate system using a relationship between a coordinate frame associated with the imaging device and a coordinate frame associated with images acquired by the imaging device.