Image based measurement system

• US 10,083,522 B2
• Filed: 06/19/2015
• Issued: 09/25/2018
• Est. Priority Date: 06/19/2015
• Status: Active Grant

• Current Assignee: Smart Picture Technologies Inc.
• Original Assignee: Smart Picture Technologies Inc.
• Inventors: Jovanovic, Dejan, Beardmore, Keith, Myllykoski, Kari, Freeman, Mark O
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): Haghani, Shadan E
• Application Number:
  US14/745,325
• Publication Number:
  US 20160371855A1
• Time in Patent Office: 1,194 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 10/32 Normalisation of the pattern dimensions
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

A Quantified Image Measurement System that creates accurate physical measurement data from digital pictures is disclosed. The system can use any image format and enhances the image file with measurement data and data transformation information that enables the creation of any type of geometrical or dimensional measurement from the stored photograph. This file containing the original digital image along with the supplemental data is referred to as a Quantified Image File or QIF. The QIF can be shared with other systems via email, cloud syncing or other types of sharing technology. Once shared, existing systems such as CAD applications or web/cloud servers can use the QIF and the associated QIF processing software routines to extract physical measurement data and use the data for subsequent processing or building geometrically accurate models of the objects or scene in the image. Additionally smart phones and other portable devices can use the QIF to make measurements on the spot or share between portable devices. In addition, the quantified image measurement system of this invention eliminates the need for capturing the image from any particular viewpoint by using multiple reference points and software algorithms to correct for any off-angle distortions.

Claims

1. A system and apparatus for making accurate dimensional or geometrical measurements of features in a two-dimensional (2D) scene from a digital image of the 2D scene taken from a non-orthogonal perspective comprising:

a. a digital scanner configured to capture the digital image of the 2D scene from the non-orthogonal perspective;

b. a reference object comprising at least four co-planar reference fiducials located proximate to a surface of the 2D scene, wherein the surface of the 2D scene comprises the features to be measured, wherein the at least four co-planar reference fiducials further comprise a circle with an outer circumference, a center point, an area, and a plurality of lines that intersect the center point of the circle and divide the circle into pie piece wedges, at least one of the pie piece wedges comprising a gradient having a density which increases in an inward direction from the outer circumference of the circle toward the center point of the circle;

c. a unique identifier (UID) located proximate to the surface of the 2D scene, wherein the UID is configured to provide the system and apparatus with information regarding a size or a type of the reference object;

d. a data processing system configured to;

i. receive the information regarding the size or the type of the reference object from the UID;

ii. store information regarding a geometry of the reference object;

iii. determine locations of the at least four co-planar reference fiducials within the digital image using the information regarding the geometry of the reference object by;

1. recognizing and locating the reference object as a whole within the digital image of the 2D scene with a pattern recognition procedure;

2. finding the circle of each of the at least four reference fiducials using Hough Circle detection;

3. avoiding false recognition of a plurality of corners by locating a corner within the circle of each of the at least four reference fiducials using corner detection; and

4. refining location of the center of the fiducial with sub-pixel precision using the gradient;

iv. determine non-orthogonal distortions of the reference object;

v. determine corrections for the non-orthogonal distortions of the reference object, wherein the corrections comprise correction data; and

vi. apply the correction data to compute the accurate dimensional or geometrical measurements of the features in the 2D scene, wherein the dimensional or geometrical measurements of the features in the 2D scene comprise measurement data; and

e. a user interface configured to display the accurate dimensional or geometrical measurements of the features in the 2D scene.

2. The system and apparatus of claim 1, wherein the dimensional or geometrical measurements of the features are automatically selected by the system and apparatus.

3. The system and apparatus of claim 1, wherein the user interface is further configured to allow the user to manually select features within the 2D scene to be measured.

4. The system and apparatus of claim 3, wherein the data processing system is further configured to create a digital image file comprising the digital image of the 2D scene and the correction data of the digital image.

5. The system and apparatus of claim 4, wherein the digital image file further comprises automatically generated measurement data or measurement data of parameters which were manually identified by the user.

6. The system and apparatus of claim 1, wherein the reference object comprises a printed pattern.

7. The system and apparatus of claim 6, wherein the printed pattern is on a sticker which can be affixed to the surface of the 2D scene to be measured.

8. The system and apparatus of claim 6, wherein the printed pattern comprises color.

9. The system and apparatus of claim 1, wherein the reference object comprises a pattern of electromagnetic emitting elements.

10. The system and apparatus of claim 9, wherein the electromagnetic emitting elements are configured to emit wavelengths that enable expedited determination of the locations of the at least four reference fiducials by the data processing system.

11. The system and apparatus of claim 1, wherein the digital scanner is comprises a camera.

12. The system and apparatus of claim 1, wherein the data processing system is further configured to create a digital image file comprising the digital image of the 2D scene and the correction data of the digital image.

13. The system and apparatus of claim 1, wherein the data processing system is local.

14. The system and apparatus of claim 1, wherein the data processing system is remote and data is transmitted via Cloud processing.

15. The system and apparatus of claim 1, wherein the UID comprises a barcode.

16. The system and apparatus of claim 1, wherein the UID is further configured to:

a. provide the user with information about the digital scanner, wherein the information relates to pantone colors, a weight, a manufacturer, or a model number;

b. provide the user with information about where the image measurement system can be downloaded to an electronic device;

c. provide the user with marketing information comprising special promotions related to the features in the 2D scene;

or d. serve as one of the at least four reference fiducials of the reference object;

or any combination thereof.