Calculating an object size using images

• US 8,675,953 B1
• Filed: 02/02/2011
• Issued: 03/18/2014
• Est. Priority Date: 02/02/2011
• Status: Active Grant

• Current Assignee: Intuit, Inc.
• Original Assignee: Intuit, Inc.
• Inventors: Elwell, Joseph P., Buhler, Alan F., Lu, Marianne
• Primary Examiner(s): Desire, Gregory M
• Application Number:
  US13/019,436
• Time in Patent Office: 1,140 Days
• Field of Search: 348/159, 348/169, 348/187, 348/222.1, 348/333.05, 382/103, 382/154, 382/218
• US Class Current: 382/154
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes

Abstract

An electronic device that determines a geometric scale of an object using two or more images of the object is described. During operation, the electronic device calculates the size of the object along a direction using multiple images of the object that were taken from different perspectives (such as different locations and/or orientations in an environment) along with associated imaging-device characteristics. For example, the size of the object may be calculated using the images, the associated focal lengths of a digital camera that acquired the images, and the law of cosines. Using the scale of the object, an image of the object may be appropriately scaled so that it can be combined with another image.

Claims

1. An electronic-device-implemented method for calculating a geometric scale of an object, comprising:

accessing two or more images of the object, wherein the two or more images are associated with different perspectives of the object in an environment, and wherein a given image has an associated imaging-device characteristic;

calculating the geometric scale of the object based on the two or more images, the different perspectives, and the imaging-device characteristics associated with the two or more images;

scaling an image of the object based on the calculated geometric scale; and

providing a combined image, wherein the combined image is generated by combining the scaled image of the object with another image.

2. The method of claim 1, wherein accessing the two or more images involves receiving the two or more images from another electronic device.

3. The method of claim 1, wherein, prior to accessing the two or more images, the method further includes acquiring the two or more images using the electronic device.

4. The method of claim 1, wherein a given perspective of the object includes a location in the environment relative to the object.

5. The method of claim 1, wherein a given perspective of the object includes an orientation in the environment relative to the object.

6. The method of claim 1, wherein the imaging-device characteristic includes a distance between an imaging device that acquired the given image and the object.

7. The method of claim 1, wherein the imaging-device characteristic includes a focal length of an imaging device that acquired the given image.

8. The method of claim 1, wherein the geometric scale is calculated using the law of cosines.

9. The method of claim 1, wherein the two or more images include a sequence of images of the object along a circumference around the object in a plane;

and

wherein the method further includes;

calculating geometric scales of the object for multiple directions in the plane around the circumference of the object; and

determining a two-dimensional surface of the object in the plane based on the calculated geometric scales in the plane.

10. The method of claim 9, wherein the geometric scales are calculated based on a difference between locations associated with the two or more images and predefined reference markers in the environment.

11. The method of claim 9, wherein the method further includes calculating the geometric scales for different planes, thereby determining a three-dimensional surface of the object.

12. The method of claim 11, wherein the geometric scales are calculated based on a difference between locations associated with the two or more images and predefined reference markers in the environment.

13. The method of claim 1, wherein the scaling is based on another geometric scale associated with the other image.

14. The method of claim 1, wherein the geometric scale is calculated based on a predefined geometric scale associated with the object.

15. A non-transitory computer-program product for use in conjunction with a computer system, the computer-program product comprising a computer-readable storage medium and a computer-program mechanism embedded therein, to calculate a geometric scale of an object, the computer-program mechanism including:

instructions for accessing two or more images of the object, wherein the two or more images are associated with different perspectives of the object in an environment, and wherein a given image has an associated imaging-device characteristic;

instructions for calculating the geometric scale of the object based on the two or more images, the different perspectives, and the imaging-device characteristics associated with the two or more images;

instructions for scaling an image of the object based on the calculated geometric scale;

instructions for generating a combined image by combining the scaled image of the object with another image; and

instructions for providing the combined image.

16. The computer-program product of claim 15, wherein a given perspective of the object includes a location in the environment relative to the object.

17. The computer-program product of claim 15, wherein a given perspective of the object includes an orientation in the environment relative to the object.

18. The computer-program product of claim 15, wherein the imaging-device characteristic includes a distance between an imaging device that acquired the given image and the object.

19. The computer-program product of claim 15, wherein the two or more images include a sequence of images of the object along a circumference around the object in a plane;

and

wherein the computer-program mechanism further includes;

instructions for calculating geometric scales of the object for multiple directions in the plane around the circumference of the object; and

instructions for determining a two-dimensional surface of the object in the plane based on the calculated geometric scales in the plane.

20. A computer system, comprising:

a processor;

memory; and

a program module, wherein the program module is stored in the memory and configurable to be executed by the processor to calculate a geometric scale of an object, the program module including;

instructions for accessing two or more images of the object, wherein the two or more images are associated with different perspectives of the object in an environment, and wherein a given image has an associated imaging-device characteristic;

instructions for calculating the geometric scale of the object based on the two or more images, the different perspectives, and the imaging-device characteristics associated with the two or more images;

instructions for scaling an image of the object based on the calculated geometric scale;

instructions for generating a combined image by combining the scaled image of the object with another image; and

instructions for providing the combined image.