SYSTEM AND METHOD FOR AUTOMATICALLY IDENTIFYING AND MATCHING A COLOR OF A STRUCTURE'S EXTERNAL SURFACE

• US 20150228086A1
• Filed: 02/10/2014
• Published: 08/13/2015
• Est. Priority Date: 02/10/2014
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Maurer, Jonathan D., Christopulos, Nicholas U., Drinan, Lee C.
• Granted Patent: US 9,183,641 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01J 2003/466 Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
• CPC Class Codes: G01J 3/0264 Electrical interface; User interface
• CPC Class Codes: G01J 3/463 Colour matching
• CPC Class Codes: G01J 3/52 using colour charts
• CPC Class Codes: G01J 3/524 Calibration of colorimeters
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/6086 by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

The method and system may be used to provide an indication of a color value for a particular siding sample and to color match a specific siding product to the color value of the siding sample. The system receives a digital image of a siding sample and a desired color value to be matched. A color query module plots this desired color value as a desired color point in a multidimensional color space together with a plurality of color reference points. Each color reference point represents the color value of an existing siding product. The system determines a “distance” between the desired color point and each plotted color reference point within the color space and identifies the siding product associated with the color reference point that is located the shortest distance to the desired color point within the color space.

Claims

1. A computer-implemented method for matching the color of siding, the method comprising:

receiving, via one or more processors from a digital image of a siding sample, (i) a region of interest, and (ii) a region of reference color corresponding to a color reference card positioned within the digital image, the color reference card having a predetermined color value, the region of interest indicating a portion of the siding sample having a desired color value to be matched;

adjusting, by one or more processors, a color balance of the digital image based upon the predetermined color value to provide an adjusted desired color value to be matched within the region of interest;

determining, via one or more processors, a desired color point in a color space, the desired color point corresponding to the adjusted desired color value;

determining, via one or more processors, a plurality of spatial distances between the desired color point and a plurality of reference color points within the color space, each of the plurality of reference color points representing a quantified color estimate of a respective replacement siding product from among a plurality of replacement siding products;

identifying, via one or more processors, one of the plurality of replacement siding products having a respective desired color point associated with the shortest spatial distance from among the plurality of spatial distances as the replacement siding product having the closest matching color to the siding sample; and

calculating, via one or more processors, a confidence level indicative of how similar the quantified color estimate for the replacement siding product having the closest matching color to the siding sample is to the adjusted desired color value based upon the shortest spatial distance.

3. The method of claim 1, wherein receiving the region of reference color includes automatically determining the region of reference color based on at least a shape and/or a size of the region of reference color.

4. The method of claim 1, wherein the color space is a three dimensional (3D) color space.

5. The method of claim 4, wherein the 3D color space includes at least one of a red-green-blue (RGB) color space, a cyan-magenta-yellow-black (CMYK) color space, a hue-saturation-value (HSV) color space, a hue-saturation-light (HSL) color space, or a Lab color space (CIELab).

6. The method of claim 1, further comprising:

identifying, via one or more processors, at least one of a product name, a product number, or a manufacturer associated with the replacement siding product having the closest matching color to the siding sample.

7. The method of claim 1, wherein calculating the confidence level further comprises:

calculating the confidence level based upon whether the length of the shortest spatial distance is less than one or more spatial length thresholds, and

wherein a shorter spatial length threshold is indicative of a greater similarity between a quantified color estimate for the replacement siding product having the closest matching color to the siding sample and the adjusted desired color value.

8. The method of claim 1, wherein the confidence level is a numeric score.

20. The method of claim 1, further comprising:

generating, via one or more processors, a positional overlay within the digital image including a first and a second predetermined area, and

wherein the region of interest and the color reference card are aligned within the first and the second predetermined area within the digital image, respectively, provided by the positional overlay.

2. (canceled)

9. (canceled)

10. A non-transitory computer-readable medium having stored thereon a set of instructions, executable by a processor, for matching the color of siding, the instructions comprising:

instructions for receiving, from a digital image of a siding sample, (i) a region of interest, and (ii) a region of reference color corresponding to a color reference card positioned within the digital image, the color reference card having a predetermined color value, the region of interest indicating a portion of the siding sample having a desired color value to be matched;

adjusting, by one or more processors, a color balance of the digital image based upon the predetermined color value to provide an adjusted desired color value to be matched within the region of interest;

instructions for causing one or more processors to determine a desired color point in a color space, the desired color point corresponding to the adjusted desired color value;

instructions for causing one or more processors to determine a plurality of spatial distances between the desired color point and a plurality of reference color points within the color space, each of the plurality of reference color points representing a quantified color estimate of a respective replacement siding product from among a plurality of replacement siding products;

instructions for causing one or more processors to identify one of the plurality of replacement siding products having a respective desired color point associated with the shortest spatial distance from among the plurality of spatial distances as the replacement siding product having the closest matching color to the siding sample; and

instructions for causing one or more processors to calculate a confidence level indicative of how similar the quantified color estimate for the replacement siding product having the closest matching color to the siding sample is to the adjusted desired color value based upon the shortest spatial distance.

12. The non-transitory computer-readable medium of claim 10, wherein the instructions for receiving the region of reference color includes instructions for automatically determining the region of reference color based on at least a shape and/or a size of the region of reference color.

13. The non-transitory computer-readable medium of claim 10, wherein the color space is a three dimensional (3D) color space.

14. The non-transitory computer-readable medium of claim 13, wherein the 3D color space includes at least one of a red-green-blue (RGB) color space, a cyan-magenta-yellow-black (CMYK) color space, a hue-saturation-value (HSV) color space, a hue-saturation-light (HSL) color space, or a Lab color space (CIELab).

15. The non-transitory computer-readable medium of claim 10, further comprising:

instructions for causing one or more processors to identify at least one of a product name, a product number, or a manufacturer associated with the replacement siding product having the closest matching color to the siding sample.

16. The non-transitory computer-readable medium of claim 10, wherein the instruction to calculate the confidence level further include instructions comprising:

instructions for calculating the confidence level based upon whether the length of the shortest spatial distance is less than one or more spatial length thresholds, and

wherein a shorter spatial length threshold is indicative of a greater similarity between quantified color estimate for the replacement siding product having the closest matching color to the siding sample and the adjusted desired color value.

17. The non-transitory computer-readable medium of claim 10, wherein the confidence level is a numeric score.

21. The non-transitory computer-readable medium of claim 10, the instructions further comprising:

instructions to generate a positional overlay within the digital image including a first and a second predetermined area, and

wherein the region of interest and the color reference card are aligned within first and the second predetermined area within the digital image, respectively, provided by the positional overlay.

11. (canceled)

18. (canceled)

19. A computer-implemented method for matching the color of siding, the method comprising:

receiving a location of a desired color point in a color space, the desired color point corresponding to a desired color value of an identified region of interest within a digital image of a siding sample to be matched, the desired color value being the result of an adjustment to the color balance of the digital image and being based upon a predetermined color value associated with a region of reference color, the predetermine color value corresponding to a color reference card positioned within the digital image of the siding sample;

determining, via one or more processors, a plurality of spatial distances between the received desired color point and a plurality of reference color points within the color space, each of the plurality of reference color points representing a quantified color estimate of a respective replacement siding product from among a plurality of replacement siding products;

identifying, via one or more processors, one of the plurality of replacement siding products having a respective desired color point associated with the shortest spatial distance from among the plurality of spatial distances as the replacement siding product having the closest matching color to the siding sample; and

calculating, via one or more processors, a confidence level indicative of how similar the quantified color estimate for the replacement siding product having the closest matching color to the siding sample is to the adjusted desired color value based upon the shortest spatial distance.

22. The method of claim 19, further comprising:

generating, via one or more processors, a positional overlay within the digital image including a first and a second predetermined area, and

wherein the region of interest and the color reference card are aligned within the first and a second predetermined area within the digital image, respectively, provided by the positional overlay.