Three dimensional image scan for vehicle

• US 10,573,012 B1
• Filed: 09/21/2017
• Issued: 02/25/2020
• Est. Priority Date: 10/14/2015
• Status: Active Grant

• Current Assignee: Allstate Insurance Company (Allstate Corporation)
• Original Assignee: Allstate Insurance Company (Allstate Corporation)
• Inventors: Collins, Stephen M., Kwan, Randolph
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US15/711,523
• Time in Patent Office: 887 Days
• Field of Search: 382141, 382152, 382154, 382170, 382190, 382209, 382278, 382286, 382307, 345419, 345653, 345664, 345679
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30248 Vehicle exterior or interior
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/133 Equalising the characteristics of different image components, e.g. their average brightness or colour balance
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals

Abstract

Systems and methods provide for an automated system for generating one or more three dimensional (3D) images of a vehicle and/or a baseline image for that vehicle. The system may receive 3D images of a plurality of vehicles of a same type (e.g., same make, model, year, etc.) and generate a 3D image of a baseline vehicle for vehicles of that same type based on 3D images of the plurality of vehicles of the particular type. The system may use a 3D image of the baseline vehicle to determine a characteristic of another vehicle, such as a modification made to the vehicle, damage to the vehicle, cost to repair the vehicle or replace parts of the vehicle, a value of the vehicle, an insurance quote for the vehicle, etc. In some aspects, the 3D images may optionally comprise 3D point clouds, and 3D laser scanners may be used to capture 3D images of vehicles.

Claims

1. A method comprising:

receiving, by a computing device, a plurality of three-dimensional (3D) images, wherein each image of the plurality of 3D images depicts a vehicle of a particular type;

calculating, by the computing device, a plurality of median points from the plurality of 3D images, wherein each point of the plurality of median points is a median of corresponding 3D coordinates from each of the plurality of 3D images;

generating, by the computing device and based on the plurality of median points, a 3D image of an example vehicle; and

responsive to determining that a vehicle is of the particular type, using the 3D image of the example vehicle to determine a characteristic of the vehicle.

2. The method of claim 1, further comprising:

receiving, by the computing device, a 3D image of the vehicle from a mobile device that comprises a 3D imaging device,

wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises comparing the 3D image of the vehicle to the 3D image of the example vehicle.

3. The method of claim 2, wherein the 3D imaging device comprises a 3D laser scanner.

4. The method of claim 1, wherein the particular type of the vehicle comprises a make, a model, and a year of the vehicle, and wherein determining that the vehicle is of the particular type comprises determining that the vehicle is the same make, model, and year as the example vehicle.

5. The method of claim 1, wherein generating the 3D image of the example vehicle comprises:

for one or more of the plurality of 3D images;

determining, by the computing device, one or more outlier point in one or more of the plurality of 3D images; and

removing, by the computing device, the one or more outlier point; and

generating the 3D image of the example vehicle based on one or more of the plurality of 3D images from which the one or more outlier point was removed.

6. The method of claim 1, wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises determining a modification made to the vehicle relative to the example vehicle.

7. The method of claim 1, wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises determining damage to the vehicle relative to the example vehicle.

8. The method of claim 7, further comprising:

based on the damage to the vehicle, determining a part of the vehicle needing repair or replacement and a cost to repair or replace the part.

9. The method of claim 1, wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises determining a value of the vehicle based on a value of the example vehicle.

10. The method of claim 1, wherein the 3D image of the example vehicle comprises a point cloud image of the example vehicle.

11. The method of claim 1, wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises determining differences between a plurality of points in the 3D image of the example vehicle to a plurality of points in a 3D image of the vehicle.

12. A system comprising:

a mobile device;

a three-dimensional (3D) imaging device associated with the mobile device; and

a server comprising;

a processor; and

memory storing computer-executable instructions that, when executed by the processor, cause the server to;

receive a plurality of 3D images, wherein each image of the plurality of 3D images depicts a vehicle of a particular type;

calculate a plurality of median points from the plurality of 3D images, wherein each point of the plurality of median points is a median of corresponding 3D coordinates from each of the plurality of 3D images;

generate, based on the plurality of median points, a 3D image of an example vehicle; and

responsive to determining that a vehicle is of the particular type, use the 3D image of the example vehicle to determine a characteristic of the vehicle.

13. The system of claim 12, wherein the 3D imaging device is configured to capture a 3D image of the vehicle, wherein the mobile device is configured to transmit, to the server, the 3D image of the vehicle, and wherein the memory stores computer-executable instructions that, when executed by the processor, cause the server to:

receive, from the mobile device, the 3D image of the vehicle,

wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises comparing the 3D image of the vehicle to the 3D image of the example vehicle.

14. The system of claim 13, wherein the 3D imaging device comprises a 3D laser scanner.

15. The system of claim 12, wherein the particular type of the vehicle comprises a make, a model, and a year of the vehicle, and wherein determining that the vehicle is of the particular type comprises determining that the vehicle is the same make, model, and year as the example vehicle.

16. The system of claim 12, wherein generating the 3D image of the example vehicle comprises:

for one or more of the plurality of 3D images;

determining one or more outlier point in one or more of the plurality of 3D images; and

removing the one or more outlier point; and

generating the 3D image of the example vehicle based on one or more of the plurality of 3D images from which the one or more outlier point was removed.

17. A non-transitory computer-readable media storing computer-readable instructions that, when executed by a computing device, cause the computing device to:

receive a plurality of three-dimensional (3D) images, wherein each image of the plurality of 3D images depicts a vehicle of a particular type;

calculate a plurality of mode points from the plurality of 3D images, wherein each point of the plurality of mode points is a mode of corresponding 3D coordinates from each of the plurality of 3D images;

generate, based on the plurality of mode points, a 3D image of an example vehicle; and

responsive to determining that a vehicle is of the particular type, use the 3D image of the example vehicle to determine a characteristic of the vehicle.

18. The non-transitory computer-readable media of claim 17, wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises determining a value of the vehicle based on a value of the example vehicle.

19. The non-transitory computer-readable media of claim 17, wherein the 3D image of the example vehicle comprises a point cloud image of the example vehicle.

20. The non-transitory computer-readable media of claim 17, wherein using the 3D image of the example vehicle to determine the characteristic of the vehicle comprises determining differences between a plurality of points in the 3D image of the example vehicle to a plurality of points in a 3D image of the vehicle.