Pavement inspection apparatus

• US 4,958,306 A
• Filed: 01/06/1988
• Issued: 09/18/1990
• Est. Priority Date: 01/06/1988
• Status: Expired due to Fees

• Current Assignee: Pacific Northwest Research & Development Incorporated
• Original Assignee: Pacific Northwest Research & Development Incorporated
• Inventors: Khattak, Anwar S., Purnell, Larry W., Bender, Donald L., Powell, Joseph P., Saunders, Sam C.
• Primary Examiner(s): Lall, Parshotam S.
• Assistant Examiner(s): MELNICK, STEVEN A
• Application Number:
  US07/141,248
• Time in Patent Office: 986 Days
• Field of Search: 364/550, 358/108, 358/107, 73/146, 382/10, 382/1
• US Class Current: 702/40
• CPC Class Codes: G01C 7/04 involving a vehicle which moves along the profile to be traced

Abstract

A pavement inspection apparatus 10 is described for inspecting the condition of a full lane of pavement using a vehicle capable of traveling along the lane at normal traffic speeds, such as 55 miles per hour. The apparatus is capable of determing the elevational profile of the pavement and the size and shapes of surface distress features such as longitudinal cracks, transverse cracks, aligator cracks, design cracks, potholes and rutting. The apparatus 10 has two video array cameras 36 and 40 that project downward onto the pavement with overlapping fields of view for generating X-Y pixel data representing the intensities of reflected light from a full lane width of pavement as the vehicle moves over the pavement. The cameras 36 and 40 are mounted at acute angles with respect to each other to enable an elevational profile to be developed for the pavement from correlated pixel data from the two cameras. The apparatus 10 includes distress feature analysis electronics for determining the size, shape and location of surface distress features and evaluates such features against preset values to determine the severity of the determined features. Additionally, the apparatus 10 has video array cameras 192 and 196 for determining the deflection of the pavement in response to the movement of a known wheel weight over the pavement.

Claims

1. Pavement inspection apparatus for inspecting and determining the surface condition of a length of pavement, comprising:

a surface vehicle for moving over the length of the pavement being inspected;

a pair of electromagnetic beam generators mounted on the vehicle for directing two spaced high intensity electromagnetic reference beams onto the pavement surface forming two horizontally spaced reference marks on the pavement surface that move over the surface as the vehicle is moved over the length of the pavement;

a first video camera mounted on the surface vehicle projecting toward the pavement surface having a first field of view of a segment of the pavement surface containing the two reference marks for optically inspecting the pavement for surface defects;

a second video camera mounted on the surface vehicle spaced from the first video camera and projecting onto the pavement surface at an acute angle with respect to the first video camera having a second field of view that has at least a portion in common with the first field of view containing the two reference marks for optically inspecting the pavement for surface defects; and

video signal processing means operatively connected to the first and second video camera for determining the surface condition of the length of pavement travelled by the surface vehicle.

2. The pavement inspection apparatus as defined in claim 1 further comprising:

velocity means for determining the speed that the vehicle travels over the length of pavement;

recording means operative connected to the velocity means and the video processing means for recording the location of any surface distress features.

3. The pavement inspection apparatus as defined in claim 1 wherein:

the first video camera generates a first set of frames of electrical pixel video output data representing reflected light intensities from longitudinally spaced surface locations as the vehicle moves over the length of the pavement;

the second video camera generates a second set of frames of electrical pixel video output data representing reflected light intensities from the longitudinally spaced array of surface locations, but from a different angle, as the surface vehicle moves over the length of the pavement; and

wherein the apparatus further comprises;

electronic frame comparing means for comparing the electrical pixel output data of the first and second sets of frames to determine the vertical elevation of at least a portion of the surface locations; and

electronic profile generating means operatively connected to the electronic frame comparing means for generating an electronic elevational profile of the length of the pavement.

4. The pavement inspection apparatus as defined in claim 3 further comprising:

vertical movement detection means responsive to vertical movement of the cameras with respect to the pavement surface as the vehicle travels over the length of the pavement for adjusting the electrical pixel video output data to eliminate error caused by vertical movement of the cameras.

5. The pavement inspection apparatus as defined in claim 3 wherein the electronic profile means includes longitudinal profile means for generating a electronic longitudinal profile along the longitudinal length of pavement.

6. The pavement inspection apparatus as defined in claim 3 wherein the electronic profile means includes a rut profile means for generating electronic transverse profiles of the pavement surface at selected intervals along the length of the pavements to determine the degree of pavement rutting.

7. The pavement inspection apparatus as defined in claim 3 further comprising a recording means for recording an electronic profile of the length of pavement.

8. The pavement inspection apparatus as defined in claim 3 wherein the electronic frame comparing means includes (1) X-Y reference means for determining the same surface locations in the first and second set of frames, (2) spatial comparing means for determining spatial pixel distances between the same surface locations in the first and second set of frames and (3) elevational calculating means responsive to the determined spatial pixel distances and the acute angle between the first and second video camera means for calculating the vertical elevations of the surface location.

9. The pavement inspection apparatus as defined in claim 1 wherein the vehicle has a width of 8 feet or less and wherein the first and second cameras each have a lateral field of view greater than 12 feet.

10. The pavement inspection apparatus as defined in claim 1 wherein the vehicle has a width of less than 8 feet and is capable of travelling along a paved road at normal traffic speeds and wherein the video camera are capable of generating frames of unblurred electrical pixel video output data when the vehicle is moving at normal traffic speeds.

11. In a pavement inspection apparatus for inspecting and determining the surface condition of a length of pavement, comprising:

a surface vehicle for moving over the length of pavement being inspected;

a pair of electromagnetic beam generators mounted on the surface vehicle for directing two spaced electromagnetic reference beams toward the pavement surface forming two spaced horizontal reference marks on the pavement surface as the surface vehicle moves over the length of pavement;

a first video camera means mounted on the surface vehicle and directed toward the pavement surface having a first field of view of the pavement containing the two reference marks for progressively generating electrical pixel video output data containing information of the condition of the pavement as the surface vehicle moves over the length of pavement;

surface to pixel calibration means operatively connected to the output of the first video camera for electrically monitoring the apparent horizontal distance between the two reference marks as observed by the camera as the vehicle moves over the length of pavement to calibrate the pixel data with surface distances and for determining any vertical movement of the camera with respect to the horizontal data reference plane and to modify the electrical pixel video output data in response to such vertical movement of the camera to substantially eliminate data errors caused by vertical movement of the camera with respect to the pavement surface, such as vehicle bounce; and

video signal processing operatively connected to the first video camera for electronically processing the electrical pixel video output data containing information of the condition of the length of pavement travelled by the surface vehicle.

12. In the pavement inspection apparatus as defined in claim 11 wherein the first video camera means includes video frame control means for repeatedly generating frames of electrical pixel output data corresponding to progressive fields of view of the camera of the pavement surface;

and wherein the apparatus further comprises;

velocity means associated with the vehicle for determining vehicle velocity; and

data overlap removal means operatively connected to the output of the first video camera means and the velocity means for removing any redundant electrical pixel video output data that may appear in adjacent frames should the fields of view of the adjacent frames overlap.

13. In the pavement inspection apparatus as defined in claim 11 wherein the video signal processing means includes:

video digitizing means operatively connected to the output of the first video camera and responsive to the electrical pixel output data for generating corresponding digital signal pixel data containing information of the condition of the length of pavement travelled by the surface vehicle;

random access memopry means for storing the digital signal pixel data;

distress detection means operatively connected to the memory means and responsive to the digital signal pixel data for detecting the presence of pavement surface distress features.

14. In the pavement inspection apparatus as defined in claim 13 further comprising:

distress feature classification means responsive to the detection of a defect for comparing the detected surface distress features with preset defect thresholds to determine the type and severity of the distress features and to classify the distress features in relationship to their type and severity for segments of the length of pavement containing distress features;

segment index means responsive to the classification of distress features for comparing the number of each type of distress feature and their severity with a selected number thresholds and for generating a pavement condition index representative of the general condition of each of the pavement segments;

recording means for recording the pavement condition index for each pavement segment over the length of the pavement travelled by the vehicle.

15. Pavement inspection apparatus for inspecting and determining the surface condition of a length of pavement, comprising:

a surface vehicle for moving over the length of the pavement in a longitudinal direction;

a first video camera mounted on the surface vehicle projecting toward the pavement surface having a first field of view of surface locations for generating a first set of frames of electrical pixel video output data representing reflected light intensities from longitudinally spaced surface locations as the vehicle moves over the length of the pavement;

a second video camera mounted on the surface vehicle and projecting toward the pavement surface at an acute angle with respect to the first video camera and having a second field of view of the same surface locations for generating a second set of frames of electrical pixel video output data representing reflected light intensities from the same longitudinally spaced array of surface locations, but from a different angle, as the surface vehicle moves over the length of the pavement;

electronic frame comparing means for comparing the electrical pixel output data of the first and second sets of frames to determine the vertical elevation of at least a portion of the surface locations; and

electronic profile generating means operatively connected to the electronic frame comparing means for generating an electronic elevational profile of the length of the pavement.

16. The pavement inspection apparatus as defined in claim 15 further comprising:

vertical movement detection means responsive to vertical movement of the video cameras with respect to the pavement surface as the vehicle travels over the length of the pavement for adjusting the electrical pixel video output data to eliminate error caused by vertical movement of the video, cameras.

17. The pavement inspection apparatus as defined in claim 15 wherein the electronic profile means includes longitudinal profile means for generating a electronic longitudinal profile along the longitudinal length of pavement.

18. The pavement inspection apparatus as defined in claim 15 wherein the electronic profile means includes a rut profile means for generating electronic transverse profiles of the pavement surface at selected intervals along the length of the pavements to determine the degree of pavement rutting.

19. The pavement inspection apparatus as defined in claim 15 further comprising a recording means for recording electronic profile of the length of pavement.

20. The pavement inspection apparatus as defined in claim 15 wherein the electronic frame comparing means including (1) X-Y reference means for determining the same surface locations in the first and second set of frames, (2) spatial comparing means for determining spatial pixel distances between the same surface locations in the first and second set of frames and (3) elevational calculating means responsive to the determined spatial pixel distances and the acute angle between the first and second video cameras for calculating the vertical elevations of the surface locations.

21. The pavement inspection apparatus as defined in claim 15 wherein the vehicle has a width of 8 feet or less and wherein the first and second cameras each have a lateral field of view greater than 12 feet.

22. The pavement inspection apparatus as defined in claim 15 wherein the vehicle has a width of less than 8 feet and is capable of travelling along a paved road at normal traffic speeds and wherein the video cameras are capable of generating framese of unblurred electrical pixel video output data when the vehicle is moving at normal traffic speeds.

23. Pavement inspection apparatus for inspecting and determining distress features in a length of pavement comprising:

a surface vehicle for moving over the length of pavement in a longitudinal direction;

a first array video camera mounted on the surface vehicle projecting toward the pavement surface having a first field of view of a longitudinal and transverse X-Y array of surface locations for sequentially generating a first set of frames of electrical pixel video output data representing reflected light intensities from longitudinally spaced X-Y arrays of surface locations as the surface vehicle moves over the length of the pavement;

a second array video camera mounted on the surface vehicle projecting toward the pavement surface at an acute angle with respect to the first video camera and having a second field of view of the same longitudinal and transverse X-Y surface locations for sequentially generating a second set of frames of electrical pixel video output data representing reflected light intensities from the same longitudinally spaced X-Y arrays of surface locations, but from a different angle, as the surface vehicle moves over the length of the pavement;

electronic frame comparing means for comparing the electrical output data of the first and second set of frames of electrical output data to determine the vertical elevation of the surface locations;

electronic profile generating means operatively connected to the electronic frame comparing means for generating an electronic elevational profile of the length of the pavement; and

surface distress means responsive to the electrical pixel video output data for determining the location and severity of surface distress features along the length of pavement.

24. The pavement inpsection apparatus as defined in claim 23 further comprising camera control means operatively connected to the first and second array video cameras for operating the cameras at camera shutter speeds and at frame frequencies sufficient to generate unblurred electrical pixel video output data when the vehicle is moving at normal traffic speeds such as 55 miles per hour.

25. The pavement inspection apparatus as defined in claim 23, further comprising:

vertical movement detection means responsive to vertical movement of the cameras with respect to the pavement surface as the vehicle travels over the length of pavement for adjusting electrical pixel video output data to eliminate error caused by vertical movement of the cameras.

26. The pavement inspection apparatus as defined in claim 25 wherein the vertical movement detection means includes:

a pair of electromagnetic beam generators mounted on the vehicle for directing two spaced electromagnetic reference beams on to the pavement surface within the fields of view of the cameras or forming two horizontally spaced reference marks;

measuring means responsive to the electrical pixel video output data for determining the location of the marks within the frames and for measuring the changes in apparent pixel distances between the two reference marks as the vehicle moves over the length of pavement to determine vertical movement of the cameras; and

data correcting means responsive to the determined movement of the cameras for correcting the electrical pixel video output data to remove error caused by vertical movement of the cameras.

27. A pavement inspection apparatus as defined in claim 23 wherein the surface distress means include:

defect detection means responsive to the electrical pixel video output data for detecting the presence of electrical pixel video output data that exceeds a preset gray-scale value to determine the existence and location of surface distress features;

boundary detection means responsive to the surface distress feature data for determining the size and shape of the surface distress feature;

severity classification means responsive to the size and shape of the surface distress features for comparing the size and shape of the distress features with preset values to determine the severity of the detected surface distress feature.

28. The pavement inspection apparatus as defined in claim 23 wherein the surface distress means includes condition index means responsive to the severity means for determining the condition of the length of the pavement.

29. The pavement inspection apparatus as defined in claim 23 wherein the boundary means include means for determining the length and width and orientation of the surface distress features;

and

wherein the severity classification means is responsive to the length, width and orientation of the surface distress features to determine if the surface distress features are longitudinal cracks or transverse cracks.

30. The pavement inspection apparatus as defined in claim 23 wherein the surface distress means is responsive to the electronic frame comparing means and further includes distress feature elevation mean for determining the elevation of the surface distress feature to determine whether the surface distress features is a pothole.

31. Pavement inspection apparatus for determining the condition of a length of pavement, comprising:

a wheeled vehicle for moving over a length of the pavement in a longitudinal direction;

means on the wheeled vehicle for applying a preset vertical force through a wheel against the pavement to form a depression in the pavement beneath and extending rearward the wheel in a path travelled by the wheel as the vehicle is moved over the length of the pavement;

reference means on the vehicle for determining the undeflected elevation of the pavement along the wheel path;

a first wheel path video camera mounted on the vehicle having an X-Y field of view of the depression and extending rearward of the wheel for generating electrical video output data containing information of the deflected elevation of the depression at multiple sampling points in the X-Y field of view; and

deflection determining means operatively connected to the reference means and the first wheel path video camera and responsive to the electrical video output data for determining the deflection of the pavement in the X-Y field of view along wheel path as the vehicle moves over the pavement.

32. The pavement inspection apparatus as defined in claim 31 wherein the reference means includes:

a second wheel path video camera mounted on the wheeled vehicle having a field of view of an undeflected portion of the pavement in the wheel path for generating electrical video data containing information of the elevation of the undeflected pavement in the wheel path.

33. The pavement inspection apparatus as defined in claim 31 wherein the deflection determining means has means for calculating the inclination of the depression at each multiple sampling point and means for calculating the deflection of the pavement in the depression based upon the magnitudes of the inclinations at the multiple sampling points.

34. The pavement inspection apparatus as defined in claim 31, comprising:

means on the vehicle for determining the distance travelled by the vehicle; and

wherein the deflection determining means determines the deflection of the pavement in the wheel path at selected intervals and wherein the apparatus further comprises;

pavement condition means operatively connected to the deflection calculating means for accumulating the values of the deflection of the pavement at the selected intervals and determining the rate of change of the deflection of the pavement with respect to distance.

35. The pavement inspection apparatus as defined in claim 31 further comprising:

a first full view video camera mounted on the vehicle projecting toward the pavement having a lane width field of view of the pavement for sequentially generating a first set of frames of lane width electrical pixel data as the vehicle moves over the length of pavement, in which the lane width electrical pixel data contains information relating to surface distress features to the length of pavement; and

surface distress means responsive to the lane width electrical pixel data for determining the location and severity of the surface distress features along the length of pavement.

36. The pavement inspection apparatus as defined in claim 35 further comprising:

a second full-width video camera mounted on the vehicle projecting toward the pavement at an acute angle with respect to the first full-width camera and having the same field of view for sequentially generating a second set of frames of lane width electrical pixel data as the vehicle moves over the length of the pavement, in which the second set of frames contain information concerning the elevational profile of the length of pavement; and

electronic frame comparing means for comparing electrical pixel data of the first and second set of frames to determine the vertical elevation of the pavement; and

electronic profile generating means operatively connected to electronic frame comparing means for generating an electronic representation of the elevational profile of the length of the pavement.

37. The pavement inspection apparatus as defined in claim 35 further comprising:

profile means operatively connected to the first full-width video camera for determining the elevational profile of the length of pavement as the vehicle moves over the pavement.

38. In a pavement inspection apparatus for inspecting and determining the presence and severity of surface distress features of a lane of pavement of a prescribed lane width, comprising:

a surface vehicle for moving over the lane of pavement in a longitudinal direction, in which the vehicle has a width less than the width of the lane;

distance means for measuring the lane distance travelled by the vehicle for generating location data;

a first video array camera means mounted on the surface vehicle projecting toward the pavement surface having a X-Y field of view of a full lane width of a longitudinal lane segment of the pavement for sequentially generating a first set of video frames of electrical pixel data representing a magnitude of reflected light from the lane surface as the surface vehicle moves in the lane over the length of pavement, in which the electrical pixel data contains information concerning the presence and severity of surface distress features; and

surface distress detection means responsive to the electrical pixel data and the distance means for determining the presence, location and severity of the surface distress features in the lane along the length of the pavement.

39. In the pavement inspection apparatus as defined in claim 38 wherein the first set of video frames contains redundant electrical pixel data between adjacent frames in the longitudinal direction, and wherein the apparatus further comprises:

overlap means operatively connected to the distance means and responsive to the first set of frames for determining the degree of data overlap between adjacent frames.

40. In the pavement inspection apparatus as defined in claim 38 further comprising camera control means operatively connected to the first video array camera for operating the camera at a camera shutter speed and at a frame frequency sufficient to generating unblurred electrical pixel data when the data is moving at normal highway traffic speeds, such as 55 miles per hour.

41. In the pavement inspection apparatus as defined in claim 38 wherein the surface distress detection means includes:

defect detection means responsive to the electrical pixel data and the location data for comparing the electrical pixel data with a preset threshold gray-scale value and generating distress feature electrical pixel data containing information concerning the size, shape and location of the surface distress features;

boundary detection means responsive to the distress feature electrical pixel data for determining the size and shape of the surface distress features;

severity classification means operatively connected to the boundary detection means for determining the size and shape of the distress features with respect to preset values to determine the severity of the surface defect features and to classify the features into categories according to the degree of severity of the distress feature.

42. In the pavement inspection apparatus as defined in claim 41 wherein the boundary detection means includes means for determining the length and width and orientation of the feature;

and

wherein the severity classification means is responsive to the length, width and orientation of the feature for determining if the distress feature is a longitudinal crack or a transverse crack.

43. In the pavement inspection apparatus as defined in claim 41 further comprising:

elevation detection means mounted on the vehicle for determining the elevation of one or more of the detected distress features to determine if the feature is a pothole.

44. In the pavement inspection apparatus as defined in claim 41 further comprising:

elevation detection means mounted on the vehicle for determining the elevation of selected surface locations of the lane at selected intervals along the length of the pavement;

electronic profile generating means operatively connected to the elevation detection means for generating an electrical elevational profile of the lane along the length of the pavement.

45. In a pavement inspection apparatus for determining the condition of a length of pavement and its subgrade, comprising:

a wheeled vehicle for moving over the length of pavement and thereby generating a depression in the pavement beneath a wheel the depth of which is indicative of the condition of the pavement subgrade;

a video array camera mounted on the surface vehicle projecting toward the pavement surface having a X-Y field of view of a segment of the pavement for sequentially generating a set of video frames of electrical pixel data representing a magnitude of reflected light from the pavement surface as the surface vehicle moves over the length of pavement, in which the electrical pixel data contains information of the presence and severity of surface distress features;

velocity means for determining the velocity of the vehicle as the vehicle moves over the length of pavement;

depth sensing means for sensing the depth of the wheel depression as the vehicle moves over the length of the pavement;

surface distress detection means responsive to the velocity means and the electrical pixel data for determining the presence, location and severity of the surface distress features along the length of the pavement; and

profile detection means responsive to the velocity means and the electrical pixel data for determining the elevation profile of the pavement along its length.

46. The pavement inspection apparatus as defined in claim 45 further comprising:

vertical movement detection means responsive to the electrical pixel data for determining vertical movement of the video camera means relative to the pavement.

47. In the pavement inspection apparatus as defined in claim 45 further comprising:

surface to pixel calibration means responsive to the vehicle velocity and to the electrical pixel data for determining in real time a surface to pixel relationship.