Multiple Camera System for Automated Surface Distress Measurement

• US 20110221906A1
• Filed: 03/11/2011
• Published: 09/15/2011
• Est. Priority Date: 03/12/2010
• Status: Abandoned Application

• Current Assignee: Board of Regents of the University of Texas System (University of Texas System)
• Original Assignee: Board of Regents of the University of Texas System (University of Texas System)
• Inventors: Yao, Xun, Xu, Bugao, Yao, Ming
• Application Number:
  US13/046,407
• Publication Number:
  US 20110221906A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: G01N 21/8806 Specially adapted optical and illumination features
• CPC Class Codes: G01N 21/95 characterised by the material or shape of the object to be examined G01N21/89 - G01N21/91, G01N21/94 take precedence
• CPC Class Codes: G06T 2207/10144 Varying exposure
• CPC Class Codes: G06T 2207/20016 Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/0004 Industrial image inspection

Abstract

The present invention provides a system for imaging a surface in real time. The system includes two or more real time digital imaging devices positioned to capture two or more images of a surface, wherein the two or more real time digital imaging devices are set in different exposure modes; and an image processing device that processes the two or more images, wherein the two or more images are complementary and together form a complete shadow-free image of the surface. The two or more real time digital imaging devices are line-scan cameras or other types of digital cameras, wherein each of the two or more real time digital imaging devices is independently set at an under-exposure mode, an over-exposure mode or an intermediate exposure mode. Multi-exposed images are fused together through a multi-scale decomposition and reconstruction method for crack detection.

Claims

1. A real time surface defect imaging device comprising:

a support shaft mountable to a vehicle to extend above a surface;

a first digital imaging device with a first exposure mode positioned on the support shaft to capture a first set of images of the surface;

one or more second digital imaging devices each with a second exposure mode positioned on the support shaft to capture one or more second sets of images of the surface;

an image processing device in communication with the a first digital imaging device and each of the one or more second digital imaging devices to receive the first set of images of the surface and the one or more second sets of images of the surface and compile a complete shadow-free image of the surface to determine surface defects.

2. The system of claim 1, wherein the image processing device

3. The device of claim 1, further comprising an external illumination source to illuminate the surface to capture images of the surface at nighttime.

4. A system for imaging a surface in real time comprising:

two or more real time digital imaging devices positioned to capture two or more images of a surface, wherein the two or more real time digital imaging devices are set in different exposure modes; and

an image processing device that processes the two or more images, wherein the two or more images are complementary and together form a complete shadow-free image of the surface.

5. The system of claim 4, wherein the two or more real time digital imaging devices are line-scan cameras or other types of digital cameras.

6. The system of claim 4, wherein each of the two or more real time digital imaging devices are independently set at an under-exposure mode, an over-exposure mode or an intermediate exposure mode.

7. The system of claim 4, wherein the first line-scan camera captures an image of one or more shadowed regions of the surface.

8. The system of claim 4, wherein the second line-scan camera captures an image of one or more sunlit regions of the surface.

9. The system of claim 4, wherein the real time digital imaging device is positioned about a vehicle selected from the group consisting of a car, a truck, a van, a bus, an SUV, an ATV, a four wheeler, a trailer, a sled, a wagon, a cart, and a combination thereof

10. The system of claim 4, wherein the exposure of the line-scan cameras is adjusted dynamically according to one or more conditions selected from lighting situations, pavement conditions, vehicle speeds or a combination thereof.

11. The system of claim 4, further comprising an external illumination source to enable the devices to image pavement surface at nighttime.

12. A method of measuring the condition of a surface comprising the steps of:

acquiring two or more images of the surface from two or more real time digital imaging devices positioned to capture one or more images of a surface, wherein the two or more real time digital imaging devices are set in different exposure modes, wherein the one or more images are complementary and compensate each other; and

processing the image to identify defects in the surface, wherein the processing comprises determining the intensity of one or more regions of the one or more images, comparing the intensity of one of the one or more regions to the intensity of another of the one or more regions, and designating the region as defective.

13. The method of claim 12, further comprise a multi-scale decomposition and reconstruction (MSDR) method to merge multi-exposure images into one surface image.

14. The method of claim 12, further comprise a multi-scale decomposition and reconstruction (MSDR) method for image fusion includes Laplacian pyramid transform and wavelet transform.