Image analysis system for property damage assessment and verification

• US 10,511,676 B2
• Filed: 03/17/2016
• Issued: 12/17/2019
• Est. Priority Date: 03/17/2016
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Inventors: Howe, Richard L., Raburn, Valerie J., Bernal, Edgar A., Shreve, Matthew Adam, Paul, Peter, Kompalli, Pramod Sankar
• Primary Examiner(s): Niquette, Robert R
• Assistant Examiner(s): Nguyen, Liz P
• Application Number:
  US15/072,652
• Publication Number:
  US 20170270650A1
• Time in Patent Office: 1,370 Days
• Field of Search: 705 4
• CPC Class Codes: G06F 18/24133 Distances to prototypes
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G06Q 50/163 Real estate management
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

A system for assessing a property damage claim uses an imaging device to capture images of a property that has reportedly been damaged by an incident. The system receives a property damage incident type, along with image processing criteria for processing images that are associated with the incident type. The system automatically processes the images according to the image processing criteria to identify one or more characteristics in the images and, based on the identified characteristics, determines whether certain claim processing criteria are satisfied. The claim processing criteria may help the system determine whether the property actually was damaged by the reported incident. The system will generate a command to process the property damage claim only if the system determines that one or more images show that the claim processing criteria are satisfied.

Claims

1. A system for assessing a property damage claim, the system comprising:

a data storage facility containing a knowledge base of property damage data associated with a plurality of property damage incident types;

an imaging device;

a processing device having one or more communications components configured to communicate with the data storage facility and the imaging device; and

a computer-readable medium containing programming instructions that are configured to, when executed, cause the processing device to;

receive an incident type for a property damage claim of a property related to an incident,

access the knowledge base and retrieve one or more image acquisition parameters that correspond to the incident type,

cause the imaging device to adjust one or more configurable camera settings based on the one or more image acquisition parameters and capture one or more images of the property,

retrieve, from the data storage facility, image processing criteria and claim processing criteria that are associated with the incident type,

automatically process the one or more images according to the image processing criteria to identify one or more characteristics in the images and, based on the identified one or more characteristics, determine whether the claim processing criteria are satisfied, and

generate a command to process the property damage claim only if the one or more images satisfy the claim processing criteria, otherwise generate a command to take an action other than process the property damage claim.

2. The system of claim 1, wherein:

the instructions to process the one or more images according to the image processing criteria comprise instructions that are configured to cause the processing device to;

receive corroborating criteria that are associated with the incident type,

extract, from the one or more images, one or more measured parameters, and

determine whether the one or more measured parameters satisfy the corroborating criteria; and

the system further comprises instructions to generate the command to process the property damage claim only if the one or more measured parameters also satisfy the corroborating criteria.

3. The system of claim 1, wherein:

the instructions to process the one or more images according to the image processing criteria comprise instructions that are configured to cause the processing device to;

analyze an image of a segment of the property captured before the incident,

compare the analyzed image with one or more of the images of the property that contains the segment and that was captured for the claim, and

determine whether a result of the comparing satisfies a difference criterion; and

the system further comprises instructions to generate the command to process the property damage claim only if the result of the comparing satisfies the difference criterion.

4. The system of claim 1, further comprising additional instructions that are configured to cause the processing device to:

when processing the one or more images according to the image processing criteria;

segment the one or more images into a plurality of segmented images,

extract one or more features from the segmented images, and

apply a classifier to determine if any of the one or more segmented images is a candidate damage image; and

when processing the one or more images to determine whether the claim processing criteria are satisfied, only process those images that are determined to be a candidate damage image.

5. The system of claim 1, wherein the instructions to process the one or more images according to the image processing criteria and determine whether the claim processing criteria are satisfied comprise instructions to:

convert each of the one or more images of the property into a density image based on one or more color channels of each image;

threshold each density image into a blob of foreground pixels and a blob of background pixels based on light reflectance of each pixel in the image;

for each image;

analyze blobs of foreground pixels to determine if each of the blobs of foreground pixels is consistent with criteria associated with the incident,

determine that the image is a candidate damage image if at least a portion of analyzed blobs of foreground pixels satisfy the criteria associated with the incident, and

determine that the image is not a candidate damage image if none of the analyzed blobs of foreground pixels satisfies the criteria associated with the incident; and

only determine that the claim processing image criteria are satisfied if at least a threshold number of the one or more images are determined to be a candidate damage image.

6. The system of claim 1, further comprising:

a corpus containing one or more images, each associated with metadata, wherein the metadata for each image comprises at least one of the following;

image data format, damage location labeling resolution, damage severity, damage cause, property characteristics, or conditions when the image was captured and camera parameters;

wherein the corpus further comprises a label confidence estimate value associated with each of the metadata in the corpus; and

the system further comprises additional instructions that are configured to cause the processing device to;

identify one or more images that are each associated with labeled metadata, and

update the corpus with the identified one or more images and associated metadata.

7. The system of claim 1, wherein the programming instructions to generate a command to take action other than process the property damage claim comprise instructions to generate a command to manually inspect the property.

8. The system of claim 1, wherein the programming instructions to generate a command to take action other than process the property damage claim comprise instructions to:

generate a command to require the imaging device to take a plurality of additional images of the property;

upon receipt of the additional images, automatically process the additional images according to the image processing criteria to identify one or more characteristics in the additional images; and

based on the identified one or more characteristics in the additional images, determine whether the one or more claim processing criteria are satisfied.

21. The system of claim 1, wherein the instructions to cause the imaging device to use the one or more image acquisition parameters to capture the one or more images comprise instructions to:

adjust a configurable camera setting, wherein the configurable camera setting comprises one or more of the following;

focus, ISO, shutter speed, aperture size, flash on/off, resolution, focal length, field of view, depth of field, or still/video mode.

9. A method of assessing a property damage claim, the method comprising, by a processing device, executing programming instructions that are configured to cause the processing device to:

receive an incident type for a property damage claim of a property related to an incident;

retrieve one or more image acquisition parameters that correspond to the incident type,

cause the imaging device to adjust one or more configurable camera settings based on the one or more image acquisition parameters and capture one or more images of the property;

retrieve, from a data storage facility containing a knowledge base of property damage data associated with a plurality of property damage incident types, image processing criteria and claim processing criteria that are associated with the incident type;

automatically process the one or more images according to the image processing criteria to identify one or more characteristics in the images and, based on the identified one or more characteristics, determine whether the claim processing criteria are satisfied; and

generate a command to process the property damage claim only if the one or more images satisfy the claim processing criteria, otherwise generate a command to take an action other than process the property damage claim.

10. The method of claim 9, further comprising, by the imaging device:

capturing the one or more images of the property; and

saving each of the one or more images to a memory device as a digital file.

11. The method of claim 9, wherein:

the processing of the one or more images according to the image processing criteria comprises;

receiving corroborating criteria that are associated with the incident type,

extracting, from the one or more images, one or more measured parameters, and

determining whether the one or more measured parameters satisfy the corroborating criteria; and

the method further comprises generating the command to process the property damage claim only if the one or more measured parameters also satisfy the corroborating criteria.

12. The method of claim 9, wherein:

the processing of the one or more images according to the image processing criteria comprises;

analyzing an image of a segment of the property captured before the incident,

comparing the analyzed image with one or more of the images of the property that contains the segment and that was captured for the claim, and

determining whether a result of the comparing satisfies a difference criterion; and

the method further comprises generating the command to process the property damage claim only if the result of the comparing satisfies the difference criterion.

13. The method of claim 9, further comprising, by the processing device:

when processing the one or more images according to the image processing criteria;

segmenting the one or more images into a plurality of segmented images,

extracting one or more features from the segmented images, and

applying a classifier to determine if any of the one or more segmented images is a candidate damage image; and

when processing the one or more images to determine whether the claim processing criteria are satisfied, only processing those images that are determined to be a candidate damage image.

14. The method of claim 9, wherein the processing of the one or more images according to the image processing criteria and the determining whether the claim processing criteria are satisfied comprise:

converting each of the one or more images into a density image based on one or more color channels of each image;

thresholding each density image into a blob of foreground pixels and a blob of background pixels based on light reflectance of each pixel in the image;

for each image;

analyzing blobs of foreground pixels to determine if each of the blobs of foreground pixels is consistent with one or more criteria associated with the incident,

determining that the image is a candidate damage image if at least a portion of analyzed blobs of foreground pixels satisfy the one or more criteria associated with the incident, and

determining that the image is not a candidate damage image if none of the analyzed blobs of foreground pixels satisfies the one or more criteria associated with the incident; and

only determining that the claim processing criteria are satisfied if at least a threshold number of the one or more images are determined to be a candidate damage image.

15. The method of claim 9, further comprising:

maintaining, on a computer-readable medium, a corpus containing one or more images, each associated with metadata, wherein;

the metadata for each image comprises at least one of the following;

image data format, damage location labeling resolution, damage severity, damage cause, property characteristics, or conditions when the image was captured and camera parameters, and

the corpus further comprises a label confidence estimate value associated with each of the metadata in the corpus;

identifying one or more images that are each associated with labeled metadata; and

updating the corpus with the identified one or more images and associated metadata.

16. The method of claim 9, wherein the command to take action other than process the property damage claim comprises a command to manually inspect the property.

17. The method of claim 9, wherein, when the processing device determines that the claim processing criteria are not satisfied, the instructions to generate the command to take an action other than process the property damage claim comprise instructions to:

require the imaging device to take a plurality of additional images of the property; and

upon receipt of the additional images, automatically process the additional images according to the image processing criteria to identify one or more characteristics in the additional images and, based on the identified one or more characteristics in the additional images, determine whether the claim processing criteria are satisfied.

22. The method of claim 9, wherein causing the imaging device to use the one or more image acquisition parameters to capture the one or more images comprises:

adjusting a configurable camera setting, wherein the configurable camera setting comprises one or more of the following;

focus, ISO, shutter speed, aperture size, flash on/off, resolution, focal length, field of view, depth of field, or still/video mode.

18. A system for assessing a property damage claim, the system comprising:

an imaging device;

a data storage facility;

a processing device having one or more communications components configured to communicate with the data storage facility and the imaging device; and

a computer-readable medium containing programming instructions that are configured to, when executed, cause the processing device to;

receive an incident type for a property damage claim of a property related to an incident,

access a knowledge base in the data storage facility to retrieve one or more image acquisition parameters that correspond to the incident type,

cause the imaging device to adjust one or more configurable camera settings based on the one or more image acquisition parameters and capture one or more images of the property,

receive image processing criteria, claim processing criteria and corroborating criteria that are associated with the incident type,

automatically process the one or more images according to the image processing criteria to identify one or more characteristics in the images and, based on the identified one or more characteristics, determine whether the claim processing criteria are satisfied,

automatically determine whether the corroborating criteria are satisfied; and

generate a command to process the property damage claim only if the one or more images satisfy the claim processing criteria and the corroborating criteria are also satisfied, otherwise generate a command to take an action other than process the property damage claim.

19. The system of claim 18, wherein the instructions to determine whether the claim processing criteria are satisfied comprise instructions to:

analyze an image of a segment of the property captured before the incident;

compare the analyzed image with one or more of the images of the property that contains the segment and that was captured for the claim; and

determine whether a result of the comparing satisfies a difference criterion; and

determine that the claim processing criteria are satisfied if the result of the comparing satisfies the difference criterion, otherwise determine that the claim processing criteria are not satisfied.

20. The system of claim 18, wherein the instructions to automatically determine whether the corroborating criteria are satisfied comprise instructions to:

receive location data for the property;

receive, from a third party service, location data for the incident;

determine that the corroborating criteria are satisfied if the location data for the property correspond to the location data for the incident, otherwise determine that the corroborating criteria are not satisfied.

23. The system of claim 18, wherein the instructions to cause the imaging device to use the one or more image acquisition parameters to capture the one or more images comprise instructions to:

adjust a configurable camera setting, wherein the configurable camera setting comprises one or more of the following;

focus, ISO, shutter speed, aperture size, flash on/off, resolution, focal length, field of view, depth of field, or still/video mode.