Method and system for recognizing space of shoulder of road

• US 8,907,839 B2
• Filed: 12/10/2012
• Issued: 12/09/2014
• Est. Priority Date: 10/19/2012
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Oh, Young Chul, Kwon, Surim
• Primary Examiner(s): Sotomayor, John B
• Application Number:
  US13/710,196
• Publication Number:
  US 20140111369A1
• Time in Patent Office: 729 Days
• Field of Search: 342/52, 342 54- 55, 342 70- 72, 342/85, 340435-437
• US Class Current: 342/52
• CPC Class Codes: B60Q 2300/335 Number or size of road lanes
• CPC Class Codes: B60Q 9/006 using a distance sensor
• CPC Class Codes: G01S 13/345 using triangular modulation
• CPC Class Codes: G01S 13/536 using transmission of continuous unmodulated waves, amplitude-, frequency-, or phase-modulated waves
• CPC Class Codes: G01S 13/862 Combination of radar systems with sonar systems
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 15/931 of land vehicles
• CPC Class Codes: G01S 2013/93272 in the back of the vehicles
• CPC Class Codes: G01S 2015/937 sensor installation details constructional features of transducers G01S7/521 and B06B; casing of transducers, e.g. housing, cover or filler details, G10K9/22; mounting of transducers, i.e. fixture, fitting or holder details, G10K11/004
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06V 10/811 the classifiers operating on different input data, e.g. multi-modal recognition
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

Disclosed herein are a method and a system for recognizing a space of a road shoulder using an ultrasonic wave sensor, a radar and an imaging device. The method includes: controlling the radar to transmit a radar beam within a preset range based on the vehicle location; detecting a fixed object located within the preset range using a reflective wave of the radar beam received by the radar; calculating a distance between the fixed object and the vehicle using the radar when the fixed object is located within the preset range; detecting a solid line lane marking in a front image of a travel lane obtained from the imaging device; and recognizing the calculated distance between the fixed object and the vehicle as a space width of the road shoulder when the solid line lane is in the front image of the travel lane.

Claims

1. A method of recognizing a space of a road shoulder using a distance measuring module, a radar, and an imaging device disposed on a vehicle, the method comprising:

controlling, by a controller, the radar to transmit a radar beam within a preset range based on the vehicle location;

detecting, by the controller, a fixed object located within the preset range using a reflective wave of the radar beam received by the radar;

calculating, by the controller, a distance between the fixed object and the vehicle using the radar when the fixed object is located within the preset range;

detecting, by the controller, a solid line lane marking in a front image of a travel lane obtained from the imaging device; and

recognizing, by the controller, the calculated distance between the fixed object and the vehicle as a space width of the road shoulder when the solid line lane marking is in the front image of the travel lane.

2. The method of claim 1, further comprising calculating the distance to the fixed object using an ultrasonic sensor configured to transmit an ultrasonic wave signal and receive a reflective wave reflected from an external object.

3. The method of claim 2, further comprising:

controlling, by the controller the radar and the ultrasonic wave sensor to reflect and receive the radar beam and the ultrasonic wave signal from the fixed object when the fixed object is located within the preset range; and

calculating, by the controller, the distance between the fixed object and the vehicle based on the radar beam and the ultrasonic wave signal reflected and received from the fixed object.

4. The method of claim 1, further comprising:

determining, by the controller, when the calculated distance between the fixed object and the vehicle remains constant for a preset time or greater;

determining, by the controller, the fixed object as a guard rail when the calculated distance between the fixed object and the vehicle remains constant for the preset time or greater; and

determining, by the controller, the fixed object as an obstacle located within the space of the road shoulder when the calculated distance between the fixed object and the vehicle does not remain constant for the preset time or greater.

5. The method of claim 1, further comprising

determining, by the controller, when a width of the recognized space of the road shoulder is a space available to the vehicle based on width data of the vehicle;

and

notifying, by the controller, a driver with information indicating that the width of the recognized space of the road shoulder is the space available to the vehicle, in response to the width of the recognized space of the road shoulder as the space available to the vehicle.

6. The method of claim 5, further comprising:

notifying, by the controller, the driver with information indicating that the recognized space of the road shoulder is not the space available to the vehicle when the width of the recognized space of the road shoulder is not the space available by the vehicle.

7. The method of claim 2, wherein a transceiving area of the radar beam is wider than a transceiving area of the ultrasonic wave signal.

8. The method of claim 1, further comprising:

notifying, by the controller, the driver to trigger a lane change to a right lane when the solid lane marking is not in the lane image.

9. A system for recognizing a space of a road shoulder, the system comprising:

a radar disposed on a vehicle configured to transceive a signal;

an ultrasonic sensor disposed on the vehicle configured to transceive the signal;

an imaging device disposed on the vehicle configured to photograph a surface image of the road; and

a controller configured to;

control the radar to transmit a radar beam within a preset range based on the vehicle location;

detect a fixed object located within the preset range using a reflective wave of the radar beam received by the radar;

calculate a distance between the fixed object and the vehicle using the radar and the ultrasonic sensor when the fixed object is located within the preset range;

detect a solid line lane marking in a front image of a travel lane obtained from the imaging device; and

recognize the calculated distance between the fixed object and the vehicle as a space width of the road shoulder when the solid line lane marking is in the front image of the travel lane.

10. The system of claim 9, wherein the ultrasonic sensor is configured to transmit an ultrasonic wave signal and receive a reflective wave reflected from an external object to measure a distance to the external object.

11. The system of claim 9, wherein the controller is further configured to notify a driver with information of the recognition of the space of the shoulder of the road.

12. The system of claim 10, wherein:

the ultrasonic wave sensor is installed on a side of the vehicle to transceive the ultrasonic wave signal from the side of the vehicle;

the imaging device is installed on a front direction of the vehicle to photograph a surface image of the front direction of the vehicle; and

the radar is installed on a front direction or a rear direction of the vehicle to identify the fixed object and the movable object using a Doppler effect during travel of the vehicle, and to calculate the distance with the fixed object.

13. The system of claim 9, further comprising an infrared sensor configured to transmit an infrared signal, and receive a reflective wave reflected from an external object to measure a distance to the external object.

14. A non-transitory computer readable medium containing program instructions executed by a processor or controller, the computer readable medium comprising:

program instructions that control a radar to transceive a signal;

program instructions that control an ultrasonic sensor to transceive the signal;

program instructions that control an imaging device to photograph a surface image of the road;

program instructions that control the radar to transmit a radar beam within a preset range based on the vehicle location;

program instructions that detect a fixed object located within the preset range using a reflective wave of the radar beam received by the radar;

program instructions that calculate a distance between the fixed object and the vehicle using the radar and the ultrasonic sensor when the fixed object is located within the preset range;

program instructions that detect a solid line lane marking in a front image of a travel lane obtained from the imaging device; and

program instructions that recognize the calculated distance between the fixed object and the vehicle as a space width of the road shoulder when the solid line lane marking is in the front image of the travel lane.

15. The computer readable medium of claim 14, further comprising program instructions to transmit an ultrasonic wave signal and receive a reflective wave reflected from an external object to measure a distance to the external object.

16. The computer readable medium of claim 14, further comprising:

program instructions that notify a driver with information of the recognition of the space of the shoulder of the road.

17. The computer readable medium of claim 15, further comprising:

program instructions that control the ultrasonic sensor to transceive the ultrasonic wave signal from a side of the vehicle;

program instructions that control the imaging device to photograph a surface image of a front direction of the vehicle the;

program instructions that control the radar to identify the fixed object and the movable object using a Doppler effect during travel of the vehicle, and to calculate the distance with the fixed object.

18. The computer readable medium of claim 14, further comprising:

program instructions that control an infrared sensor to transmit an infrared signal, and receive a reflective wave reflected from an external object to measure a distance to the external object.