System and method of measuring distances related to an object utilizing ancillary objects

• US 10,346,999 B2
• Filed: 06/21/2017
• Issued: 07/09/2019
• Est. Priority Date: 01/07/2013
• Status: Active Grant

• Current Assignee: WexEnergy Innovations LLC
• Original Assignee: WexEnergy Innovations LLC
• Inventors: Wexler, Ronald M., Spence, John P.
• Primary Examiner(s): Couso, Yon J
• Application Number:
  US15/629,093
• Publication Number:
  US 20170284799A1
• Time in Patent Office: 748 Days
• CPC Class Codes: G01C 11/04 Interpretation of pictures
• CPC Class Codes: G01C 3/00 Measuring distances in line of sight; Optical rangefinders tapes, chains or wheels for measuring length G01B3/00; active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves, G01S17/48
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume

Abstract

A system and method for measuring distances related to a target object depicted in an image and the construction and delivery of supplemental window materials for fenestration. A captured digital image is obtained containing a scene with a target object whose dimension is to be measured. The digital image may contain a target object dimension identified by one or more ancillary objects and a reference object in the same or different planes. Image processing is performed to find the reference object using known fiducial patterns printed on the reference object, metadata supplied by a user and/or by the detection of colored papers in the scene of the captured image. Adhering objects aid in keeping the reference object applied to an item in the scene such as a wall, while contrast objects aid the image processing to locate the reference object in low contrast reference object/background situations. Once located and measured, the reference object is used to calculate a pixel scale factor used to measure the target object dimensions. Target object dimensions are provided to an automated or semi-automated measurement process, design and manufacturing system such that customized parts are provided to end users.

Claims

1. A method of determining a dimension of a target object in a digital image implemented by a system comprising one or more computing devices, the method comprising:

obtaining a digital image having the target object and one or more ancillary objects located therein from an image capture device, the one or more ancillary objects located in a scene of the digital image to define target object measurement points of the target object;

determining a distance from a plurality of objects in the scene of the digital image to the image capture device;

creating a three-dimensional model of the plurality of objects in the scene of the digital image based on the determined distance;

locating the target object measurement points in the three-dimensional model;

calculating a distance between the target object measurement points; and

determining the dimension of the target object based on the calculated distance between the target object measurement points.

2. The method according to claim 1, wherein the digital image scene contains a transparent object and the transparent object is an element of the target object or is associated with the target object.

3. The method according to claim 2, wherein the transparent object is a window and the target object is a window element or associated with the window.

4. The method according to claim 1, wherein the locating is performed using a distinctive feature of the ancillary object.

5. The method according to claim 4, wherein the distinctive feature of the ancillary object is one of a color or a fiducial pattern.

6. The method according to claim 1, wherein the locating is performed using metadata.

7. The method according to claim 6, wherein the metadata is obtained from user input.

8. The method according to claim 6, wherein the metadata is obtained from a digital application.

9. The method according to claim 3, wherein the window element is a sash, stile, frame, sill, jamb, jamb liner or pane of the window.

10. The method according to claim 2, wherein the transparent object is reflective.

11. The method according to claim 2, wherein the transparent object appears dark in the digital image.

12. The method according to claim 2, wherein the transparent object is captured under conditions of predominantly back lighting.

13. The method according to claim 1, wherein the digital image comprises at least a visible image and an infrared image images.

14. The method according to claim 1, wherein the distance between the target object measurement points is calculated using the three-dimensional model.

15. The method according to claim 1, wherein the distance between the target object measurement points is calculated using a pixel scale factor.

16. The method according to claim 2, wherein the ancillary objects are placed on the transparent object.