Enhanced roadway mark locator, inspection apparatus, and marker

• US 9,784,843 B2
• Filed: 03/28/2016
• Issued: 10/10/2017
• Est. Priority Date: 01/17/2012
• Status: Active Grant

• Current Assignee: Limn Tech LLC
• Original Assignee: Limn Tech LLC
• Inventors: Dolinar, Douglas D., Haller, William R., Smith, Matthew W., Stahl, Charles C.
• Primary Examiner(s): PATEL, SHARDUL D
• Application Number:
  US15/082,365
• Publication Number:
  US 20160209511A1
• Time in Patent Office: 561 Days
• Field of Search: 701 49, 701 46, 701 23, 701 28, 701117, 701468, 701469, 34235709, 404 93, 427136, 427137, 4274272
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B62D 5/0463 calculating assisting torque from the motor based on driver input
• CPC Class Codes: E01C 23/01 Devices or auxiliary means for setting-out or checking the configuration of new surfacing, e.g. templates, screed or reference line supports form rails E01C19/50; Applications of apparatus for measuring, indicating, or recording the surface configuration of existing surfacing, e.g. profilographs E01C23/07 takes precedence; measuring roughness or irregularity in general G01B
• CPC Class Codes: E01C 23/163 for marking-out the location of the markings; Guiding or steering devices for marking apparatus, e.g. sights
• CPC Class Codes: E01H 5/06 dislodging essentially by non-driven elements, e.g. scraper blades , snow-plough blades, scoop blades
• CPC Class Codes: F16M 11/10 around a horizontal axis F16M11/12 takes precedence
• CPC Class Codes: F16M 11/2071 for panning and rolling F16M11/2078 takes precedence
• CPC Class Codes: F16M 13/02 for supporting on, or attaching to, an object, e.g. tree, gate, window-frame, cycle
• CPC Class Codes: F16M 13/022 repositionable
• CPC Class Codes: F16M 2200/022 by friction
• CPC Class Codes: G01C 15/02 Means for marking measuring points
• CPC Class Codes: G01S 19/14 specially adapted for specific applications
• CPC Class Codes: G06F 18/24155 Bayesian classification
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G07C 5/08 Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time

Abstract

An apparatus for locating, inspecting, or placing marks on a roadway. The apparatus includes a GPS-based machine vision locator for sampling discrete geographical location data of a pre-existing roadway mark evident on the roadway. A computer may determine a continuous smooth geographical location function fitted to the sampled geographical location data. A marker is responsive to the GPS-based locator and geographical location function for replicating automatically the pre-existing roadway mark onto the roadway. The apparatus is typically part of a moving vehicle. A related method is disclosed for locating, inspecting, and placing marks on a resurfaced roadway. A similar apparatus can be used to guide a vehicle having a snow plow along a snow-covered roadway, or a paving machine along an unpaved roadway surface. The apparatus provides for accurate determination of roadway mark locations, roadway mark inspection apparatus and roadway markers using Bayesian model-based filtered enhanced GPS geographical location data.

Claims

1. An apparatus for determining a geographical location of a roadway mark from a moving vehicle, the apparatus comprising:

a GPS antenna mounted to a vehicle;

a GPS receiver responsive to the GPS antenna and configured to determine a raw geographical location of the GPS antenna;

a first imager mounted to the vehicle, wherein the first imager is (a) synchronously responsive to the GPS receiver and (b) configured to image a first roadway mark to provide a first roadway mark image;

a plurality of sensors configured to collect data about the conditions of the vehicle; and

a computer (a) responsive to the GPS receiver, the first imager, and the plurality of sensors and (b) configured to determine a GPS location of the first roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors.

2. The apparatus according to claim 1 wherein:

the GPS antenna is configured to receive GPS radio wave signals originating from a GPS satellite system or a GPS-pseudolite array, and

the GPS receiver is configured to receive the GPS radio wave signals from the GPS antenna and decode the GPS signals to determine the raw geographical location of the GPS antenna.

3. The apparatus according to claim 2, wherein the GPS radio wave signals comprise a real time kinematic correction signal.

4. The apparatus of claim 1, wherein the computer is further configured to (i) calculate roadway mark characteristics from the first roadway mark image and (ii) compares the calculated roadway mark characteristics against a standard set of roadway mark characteristics.

5. The apparatus according to claim 4, wherein the roadway mark characteristics are at least one of a width of the roadway mark, a length of the roadway mark, a grayscale reflectivity, retroreflectivity, and a fill percentage.

6. The apparatus according to claim 1, wherein the first imager is mounted to the vehicle using an adjustable mount including a fixably adjustable axis of rotation parallel to a roadway surface including the first roadway mark for aligning the first imager so that the first imager can focus on the roadway mark.

7. The apparatus according to claim 1, wherein the first roadway mark is located to the left of a direction of travel of the vehicle, the apparatus further comprising a second imager mounted on the vehicle and aligned to image a second roadway mark to the right of the direction of travel of the vehicle,

wherein the second imager is (a) synchronously responsive to the GPS receiver and (b) configured to image a second roadway mark to provide a second roadway mark image;

and, and

the computer is (a) further responsive to the second imager and (b) configured to determine a GPS location of the second roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors.

8. The apparatus according to claim 1, wherein the Bayesian model-based filter is a Kalman filter.

9. The apparatus according to claim 1, wherein the plurality of sensors include one or more sensors selected from the group consisting of an accelerometer, a gyroscope, a magnetometer, an air pressure sensor, a temperature sensor, steering wheel angle sensor and a speed detector.

10. The apparatus according to claim 1, wherein the Bayesian model-based filter further accounts for a kinematic model of the vehicle.

11. The apparatus according to claim 1, wherein the Bayesian model-based filter converts the raw geographical location of the GPS antenna to a filter-enhanced geographical location of the GPS antenna by adjusting the raw geographical location of the GPS antenna based on the data collected from the plurality of sensors and a kinematic model of the vehicle.

12. The apparatus according to claim 1, wherein the first imager is a calibrated imager.

13. The apparatus according to claim 12 wherein the first imager is a GPS calibrated imager.

14. The apparatus according to claim 1, wherein the first imager is a charge coupled device camera.

15. A method for determining a geographical location of a roadway mark from a moving vehicle, comprising:

determining with a GPS receiver a raw geographical location of a GPS antenna mounted to a vehicle;

collecting data about the conditions of the vehicle using a plurality of sensors;

imaging a first roadway mark using a first imager mounted to the vehicle to produce a first roadway mark image, wherein the first imager is synchronously responsive to the GPS receiver; and

using a computer which is responsive to the GPS receiver, the first imager, and the plurality of sensors to determine a GPS location of the first roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors.

16. The method according to claim 15, wherein the first imager is a GPS calibrated imager.

17. The method according to claim 15, further comprising using the computer to:

calculate roadway mark characteristics from the first roadway mark image; and

compare the calculated roadway mark characteristics against a standard set of roadway mark characteristics.

18. The method according to claim 16, wherein the roadway mark characteristics include at least one of a width of the first roadway mark, a length of the first roadway mark, a grayscale reflectivity, retroreflectivity, and a fill percentage.

19. The method according to claim 15, further comprising the GPS antenna receiving GPS radio-wave signals originating from a GPS satellite system or a GPS-pseudolite array, wherein determining the raw geographical location of the GPS antenna comprises the GPS receiver receiving the GPS radio-wave signals from the GPS antenna and decoding the GPS radio-wave signals.

20. The apparatus according to claim 19, wherein the GPS radio-wave signals comprise a real time kinematic correction signal.

21. The method according to claim 15, wherein the first imager is mounted to the vehicle using an adjustable mount including a fixably adjustable axis of rotation parallel to the roadway surface for aligning the first imager so that the first imager can focus on the roadway mark.

22. The method according to claim 15, wherein the first roadway mark is located to the left of a direction of travel of the vehicle, further comprising:

imaging a second roadway mark located to the right of the direction of travel of the vehicle using a second imager mounted to the vehicle to produce a second roadway mark image, wherein the second imager is synchronously responsive to the GPS receiver; and

using a computer to determine a GPS location of the second roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors.

23. The method according to claim 15, wherein the Bayesian model-based filter is a Kalman filter.

24. The method according to claim 15 wherein the plurality of sensors include one or more sensors selected from the group consisting of an accelerometer, a gyroscope, a magnetometer, an air pressure sensor, a temperature sensor, steering wheel angle sensor and a speed detector.

25. The method according to claim 15, wherein the Bayesian model-based filter further accounts for a kinematic model of the vehicle.

26. The method according to claim 15, further comprising the Bayesian model-based filter converting the raw geographical location of the GPS antenna to a filter-enhanced geographical location of the GPS antenna by adjusting the raw geographical location of the GPS antenna based on the data collected from the plurality of sensors.

27. The method according to claim 15, wherein the first imager is a calibrated imager.

28. The method according to claim 15, wherein the first imager is a charge coupled device camera.

29. An apparatus for locating and placing marks on a roadway, the apparatus comprising:

a GPS antenna mounted to a vehicle;

a GPS receiver responsive to the GPS antenna and configured to determine a raw geographical location of the GPS antenna;

a first imager mounted to the vehicle, wherein the first imager is (a) synchronously responsive to the GPS receiver and (b) configured to image a roadway mark to provide a roadway mark image;

a plurality of sensors configured to collect data about the conditions of the vehicle;

a computer (a) responsive to the GPS receiver, the first imager, and the plurality of sensors, and (b) configured to;

(1) determine a GPS location of the first roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors, and

(2) determine a continuous smooth geographical location function best-fitted to the GPS location of the roadway mark; and

a marker responsive to the computer for replicating automatically the roadway mark onto the roadway based on the continuous smooth geographical location function.

30. The apparatus according to claim 29, wherein:

the GPS antenna is configured to receive GPS radio wave signals originating from a GPS satellite system or a GPS-pseudolite array, and

the GPS receiver is configured to receive the GPS radio wave signals from the GPS antenna and decode the GPS signals to determine the raw geographical location of the GPS antenna.

31. The apparatus according to claim 30, wherein the GPS receiver is further configured to receive real time kinematic (RTK) signals to determine the raw geographical location of the GPS antenna.

32. The apparatus according to claim 29 further comprising a second imager which images the roadway in front of the vehicle.

33. The apparatus according to claim 29 further comprising a speed detector and a nozzle array and control system, the speed detector informing the nozzle array and control system and enabling the nozzle array and control system to adjust the rate at which it places marking material onto the roadway.

34. The apparatus according to claim 29, wherein the computer generates an additional roadway mark function by offsetting the continuous function by an amount consistent with the desired position of a second roadway mark relative to the replicated roadway mark.

35. An apparatus for guiding a vehicle having a snow plow along a roadway, the apparatus comprising:

a GPS antenna mounted to a vehicle;

a GPS receiver responsive to the GPS antenna and configured to determine a raw geographical location of the GPS antenna;

a first imager mounted to the vehicle, wherein the first imager is (a) synchronously responsive to the GPS receiver and (b) configured to image a first roadway mark to provide a first roadway mark image;

a plurality of sensors configured to collect data about the conditions of the vehicle;

a computer (a) responsive to the GPS receiver, the first imager, and the plurality of sensors and (b) configured to;

(1) determine a GPS location of the roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors, and

(2) determine a continuous smooth geographical location function best-fitted to the GPS location of the roadway mark; and

a system responsive to the computer for positioning the snow plow based on the continuous smooth geographical location function.

36. An apparatus for locating and placing marks on a roadway, the apparatus comprising:

a GPS antenna mounted to a vehicle;

a GPS receiver responsive to the GPS antenna and configured to determine a raw geographical location of the GPS antenna;

an imager mounted to the vehicle, wherein the imager is (a) synchronously responsive to the GPS receiver and (b) configured to image a roadway mark to provide a roadway mark image;

a plurality of sensors configured to collect data about the conditions of the vehicle; and

a computer (a) responsive to the GPS receiver, the imager, and the plurality of sensors, and (b) configured to;

(1) determine a GPS location of the roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors, and

(2) determine a continuous smooth geographical location function best-fitted to the GPS location of the roadway mark; and

a nozzle array and control system responsive to the computer for replicating automatically the roadway mark at a location defined by the continuous smooth geographical location function by placing a marking material on the roadway.

37. An apparatus for determining a continuous smooth geographical location function of a roadway mark comprising:

a GPS antenna mounted to a vehicle;

a GPS receiver responsive to the GPS antenna and configured to determine a raw geographical location of the GPS antenna;

an imager mounted to the vehicle, wherein the imager is (a) synchronously responsive to the GPS receiver and (b) configured to image a roadway mark to provide a roadway mark image;

a plurality of sensors configured to collect data about the conditions of the vehicle; and

a computer (a) responsive to the GPS receiver, the imager, and the plurality of sensors, and (b) configured to;

(1) determine a GPS location of the roadway mark using a Bayesian model-based filter which accounts for the raw geographical location of the GPS antenna and the data collected by the plurality of sensors, and

(b) calculate a smooth continuous geographical location function from the GPS location of the roadway mark.

38. The apparatus according to claim 37, wherein the smooth continuous geographical location function is a best-fitted continuous geographical location function.