Stereoscopic measurement system and method

• US 9,286,506 B2
• Filed: 08/20/2012
• Issued: 03/15/2016
• Est. Priority Date: 05/22/2008
• Status: Active Grant

• Current Assignee: Matrix Electronic Measuring Properties, LLC
• Original Assignee: Matrix Electronic Measuring Properties, LLC
• Inventors: Stevens, George B., Clendening, Grady A., Waters, Windflower, Weintraub, Steven, Redden, Warren, Redden, Carl, Srack, Robert W., Srack, Janet M.
• Primary Examiner(s): Tucker, Wesley
• Application Number:
  US13/589,959
• Publication Number:
  US 20130108150A1
• Time in Patent Office: 1,303 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/20101 Interactive definition of point of interest, landmark or seed
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06V 20/64 Three-dimensional objects

Abstract

A stereoscopic measurement system captures stereo images and determines measurement information for user-designated points within stereo images. The system comprises an image capture device for capturing stereo images of an object. A processing system communicates with the capture device to receive stereo images. The processing system communicates with the capture device to receive stereo images. The processing system displays the stereo images and allows a user to select one or more points within the stereo image. The processing system processes the designated points within the stereo images to determine measurement information for the designated points.

Claims

1. A system for obtaining measurements of an object, the system comprising at least one processor, wherein the processor is configured to:

store a plurality of stereo images each comprising first and second images of the object;

combine at least two stereo images into a composite stereo image, wherein the composite stereo image comprises a composite first image and a composite second image, the composite first image comprises a composite of the first images of each of the at least two stereo images, and the composite second image comprises a composite of the second images of each of the at least two stereo images;

designate composite points in the first and second images of each of the at least two stereo images;

designate a first measurement point and a second measurement point in the composite first image;

designate the first measurement point and a second measurement point in the composite second image;

define a first stereo point that corresponds to the first measurement point designated in the composite first and second images and to define a second stereo point that corresponds to the second measurement point designated in the composite first and second images; and

calculate the distance between the first stereo point and the second stereo point.

2. The system of claim 1 wherein the processor is further configured to:

generate the first image and the second image of each of the at least two stereo images for display;

generate a list of stereo images for display;

select the at least two stereo images from the list of stereo images; and

generate the composite first and second images for display based on the designated composite points.

3. The system of claim 1 further comprising a memory, wherein the processor is further configured to store the plurality of stereo images in the memory.

4. The system of claim 1 wherein the plurality of stereo images are received from an image capture device.

5. The system of claim 4 wherein the image capture device comprises a first camera and a second camera.

6. The system of claim 5 wherein the memory is configured to store download history data for each of the first and second images.

7. The system of claim 6 wherein the download history data comprises metadata and intrinsic calibration data for the first and second cameras and a time and date that the first and second images included in each stereo image were received from the image capture device.

8. The system of claim 5 wherein the processor is further configured to:

process each of the plurality of stereo images to determine if a particular first image and a particular second image of a particular stereo image include images of a calibration pattern;

determine stereo calibration data for the image capture device when the particular first and second images of the particular stereo image are of the calibration pattern, the stereo calibration data comprising location information for the first camera relative to the second camera in a coordinate system of the image capture device; and

store the stereo calibration data.

9. The system of claim 8 wherein the processor is further configured to associate the stereo calibration data with another particular stereo image of the plurality of stereo images based on the download history for that other particular stereo image when the first and second images of that other particular stereo image are not of the calibration pattern.

10. The system of claim 1 further comprising a calibration pattern, wherein a particular first image and a particular second image of a particular stereo image each includes an image of the calibration pattern.

11. The system of claim 1 wherein the processor is further configured to create a customized report comprising the calculated distance between the first stereo point and the second stereo point.

12. The system of claim 11 further comprising reference stereo point data, and a measurement database, wherein the measurement database is configured to store the reference stereo point data;

and

wherein the reference stereo point data correspond to at least one reference stereo point on each of the plurality of objects; and

wherein the processor is further configured to;

create the customized report comprising calculated distances selected from a group consisting of a first distance between the first stereo point and the second stereo point, a second distance between the first stereo point and the reference stereo point, and a third distance between the second stereo point and the reference stereo point.

13. The system of claim 1 wherein the composite points comprise at least three corresponding reference points in each of the first and second images of the at least two stereo images, and wherein the processor is further configured to:

overlay each of the first images included in the at least two stereo images such that the three corresponding reference points match to create the composite first image; and

overlay each of the second images included in the at least two stereo images such that the three corresponding reference points match to create the composite second image.

14. The system of claim 1 wherein the composite points comprise at least three corresponding reference points in each of the first and second images of the at least two stereo images, wherein the processor is further configured to:

overlay each of the first images included in the at least two stereo images such that the three corresponding reference points match to create the composite first image; and

overlay each of the second images included in the at least two stereo images such that the three corresponding reference points match to create the composite second image.

15. A method for obtaining measurements of an object using at least one processor, the method comprising:

combining at least two stereo images into a composite stereo image, wherein the composite stereo image comprises a composite first image and a composite second image, the composite first image comprises a composite of the first images of each of the at least two stereo images, and the composite second image comprises a composite of the second images of each of the at least two stereo images;

designating composite points in the first and second images of each of the at least two stereo images;

designating a first measurement point and a second measurement point in the composite first image;

designating the first measurement point and a second measurement point in the composite second image;

defining a first stereo point that corresponds to the first measurement point designated in the composite first and second images and to define a second stereo point that corresponds to the second measurement point designated in the composite first and second images; and

calculating the distance between the first stereo point and the second stereo point.

16. The method of claim 15, wherein the designated composite points comprise at least three corresponding reference points in each of the first and second images of the at least two stereo images, the method further comprising;

overlaying each of the first images included in the at least two stereo images such that the three corresponding reference points match to create the composite first image; and

overlaying each of the second images included in the at least two stereo images such that the three corresponding reference points match to create the composite second image.

17. A method for obtaining measurements of an object for retrieval, wherein the object has an identification, the method comprising:

providing a stereo image of an object, the stereo image comprising a first image and a second image of an object;

defining a stereo point in the stereo image;

creating an association between the defined stereo point with the identification of the object;

storing data comprising the identification of the object, the defined stereo point, and the association in a memory;

creating an association between the stereo image and the identification of the object;

storing data comprising the stereo image and the association in the memory;

retrieving the stored data from a data repository, the stored data comprising the identification of the object, the stereo image, the defined stereo point, the association between the defined stereo point with the identification of the object, and the association between the stereo image pair with the identification of the object;

retrieving stereo data so that at least two stereo images are retrieved;

combining the at least two stereo images into a composite stereo image, wherein the composite stereo image comprises a composite first image and a composite second image, the composite first image comprises a composite of the first images of each of the at least two stereo images, and the composite second image comprises a composite of the second images of each of the at least two stereo images;

designating composite points in the first and second images of each of the at least two stereo images including;

designating a first measurement point and a second measurement point in the composite first image and designating the first measurement point and the second measurement point in the composite second image;

defining a second stereo point, the second stereo point corresponding to the first measurement point designated in the composite first and second images

defining a third stereo point, the third stereo point corresponding to the second measurement point designated in the composite first and second images; and

calculating a distance between the second stereo point and the third stereo point.

18. The method of claim 17 further comprising a data repository, and wherein the memory is part of the data repository.

19. The method of claim 17 further comprising a data repository, and wherein the stored data is transferred from the memory to the data repository.

20. The method of claim 17 further comprising a database, and wherein the memory is part of the database.

21. The method of claim 17 further comprising a database, and wherein the stored data is transferred from the memory to the database.

22. The method of claim 17 wherein:

the object is a vehicle; and

the identification comprises the year, make, model, and trim line of the vehicle.

23. The method of claim 17 wherein:

the object is a part of a vehicle; and

the identification comprises the year, make, model, and trim line of the vehicle, and a part description of the part of the vehicle.

24. The method of claim 23 wherein the identification further comprises a part number of the part of the vehicle.

25. The method of claim 17 further comprising retrieving the stored data from the memory, the stored data comprising the identification of the object, the defined stereo point, and the association.

26. A system for obtaining measurements of an object for retrieval, wherein the object has an identification, the system comprising:

a stereo image of an object, the stereo image comprising a first image and a second image of an object;

a memory;

a processor configured to;

define a stereo point in the stereo image;

create an association between the defined stereo point with the identification of the object;

to store data comprising the identification of the object, the defined stereo point, and the association in the memory;

create an association between the stereo image with the identification of the object;

store data comprising the stereo image and the association in the memory;

retrieve the stored data from a data repository, the stored data comprising the identification of the object, the stereo image pair, the defined stereo point, the association between the defined stereo point with the identification of the object, and the association between the stereo image with the identification of the object;

retrieve stored data so that at least two stereo images are retrieved;

combine at least two stereo image into a composite stereo image, wherein the composite stereo image comprises a composite first image and a composite second image, the composite first image comprises a composite of the first images of each of the at least two stereo image pairs, and the composite second image comprises a composite of the second images of each of the at least two stereo image pairs;

designate composite points in the first and second images of each of the at least two stereo image pairs, including designation of a first measurement point and a second measurement point in the composite first image, and designation of the first measurement point and a second measurement point in the composite second image;

define a second stereo point, the second stereo point corresponding to the first measurement point designated in the composite first and second images and to define a third stereo point, the third stereo point corresponding to the second measurement point designated in the composite first and second images; and

calculate the distance between the second stereo point and the third stereo point.

27. The system of claim 26 further comprising a data repository, and wherein the memory is part of the data repository.

28. The system of claim 26 further comprising a data repository, and wherein the processor is further configured to transfer the stored data from the memory to the data repository.

29. The system of claim 26 further comprising a database, and wherein the memory is part of the database.

30. The system of claim 26 further comprising a database, and wherein the processor is further configured to transfer the stored data from the memory to the data repository.

31. The system of claim 26 wherein:

the object is a vehicle; and

the identification is the year, make, model, and trim line of the vehicle.

32. The system of claim 26 wherein:

the object is a part of a vehicle; and

the identification comprises the year, make, model, and trim line of the vehicle, and a part description of the part of the vehicle.

33. The system of claim 32 wherein the identification further comprises a part number of the part of the vehicle.

34. The system of claim 26 wherein the processor is further configured to:

creating an association between the stereo image with the identification of the object; and

storing data comprising the stereo image and the association in the memory.

35. The system of claim 34 wherein the processor is further configured to retrieve the stored data from the memory, the stored data comprising the identification of the object, the stereo image pair, the defined stereo point, the association between the defined stereo point with the identification of the object, and the association between the stereo image with the identification of the object.

36. The system of claim 26 wherein the processor is further configured to retrieve the stored data from the memory, the stored data comprising the identification of the object, the defined stereo point, and the association.