Method and device for assisting a driver in lane guidance of a vehicle on a roadway

• US 9,605,971 B2
• Filed: 06/15/2012
• Issued: 03/28/2017
• Est. Priority Date: 06/17/2011
• Status: Expired due to Fees

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Niehsen, Wolfgang, Simon, Stephan
• Primary Examiner(s): Lim, Steven
• Assistant Examiner(s): Littlejohn, Jr., Mancil
• Application Number:
  US14/126,230
• Publication Number:
  US 20140176350A1
• Time in Patent Office: 1,747 Days
• Field of Search: 340/988
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/179 Distances to obstacles or vehicles
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/215 Selection or confirmation of options
• CPC Class Codes: B60W 2554/802 Longitudinal distance
• CPC Class Codes: B60W 2554/804 Relative longitudinal speed
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B60W 30/16 Control of distance between vehicles, e.g. keeping a distance to preceding vehicle
• CPC Class Codes: B60W 50/085 Changing the parameters of the control units, e.g. changing limit values, working points by control input
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B62D 15/025 Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation B62D1/28 takes precedence
• CPC Class Codes: G01C 21/3658 Lane guidance
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

A method for assisting a driver in lane guidance of a vehicle on a roadway includes: displaying a recorded image to the driver on a display unit, which image represents the vehicle surroundings; reading in an operating signal input on a user interface by the driver; selecting an object contained in the image, using the operating signal; displaying a mark on the display unit, the mark being displayed in an area of the image which represents the object; using the object for determining at least one longitudinal control parameter for a driving route to be traveled by the vehicle in order to assist the driver in lane guidance.

Claims

1. A method for assisting a driver in lane guidance of a host vehicle on a roadway, comprising:

displaying on a display unit a recorded image to the driver, the image having been recorded by a camera and representing the vehicle surroundings;

reading in an operating signal which is input on a user interface by the driver;

selecting, using the operating signal, an object contained in the image;

displaying at least one marking object on the display unit, wherein the at least one marking object (i) is displayed by superimposing the at least one marking object on an area of the image which represents the object and (ii) includes information representing a time to collision with the object; and

using the object to determine at least one longitudinal control parameter for a driving route to be traveled by the vehicle in order to assist the driver in lane guidance of the vehicle on the roadway;

wherein in the display step, information concerning a distance between the host vehicle and the object is additionally displayed on the display unit, the information being displayed in an area of the image which contains the object,

wherein the information is displayed as a symbol or a special graphic together with the at least one marking object in the area of the image which represents the object,

wherein a premarking on the object is touch selectable by the driver to provide a selected object to start at least one of a longitudinal guidance and a transverse guidance with respect to the object, and

wherein the premarking is removed when the object is selected and is replaced by a confirming marking, which confirms that guidance is being provided with respect to the selected object.

2. The method as recited in claim 1, wherein an early recognition of multiple objects in the image is carried out in the step of displaying the recorded image, and wherein one of the multiple objects recognized in the early recognition process is selected in the selection step using the operating signal.

3. The method as recited in claim 2, wherein the recorded image is displayed on a touch-sensitive display of the display unit in the display step, and the operating signal is generated in the reading-in step in response to a recognized pressing on the touch-sensitive display.

4. The method as recited in claim 2, wherein the operating signal is generated in the reading-in step in response to a recognized finger gesture of the driver.

5. The method as recited in claim 3, wherein in the selection step an object which is recognized in the early recognition process in the image is selected which is closest to a position in the image corresponding to a recognized pressing on the touch-sensitive display.

6. The method as recited in claim 2, wherein in the reading-in step a user interface is used which generates the operating signal by evaluating a voice command by the driver of the vehicle.

7. The method as recited in claim 2, wherein in the selecting step, an object is selected which represents another vehicle situated on the roadway one of ahead or to the side of the host vehicle.

8. The method as recited in claim 2, wherein in the display step, the at least one marking object is displayed by a representation which varies over time.

9. The method as recited in claim 2, wherein in the display step, information concerning a distance between the host vehicle and the object is additionally displayed on the display unit, the information being displayed in an area of the image which contains the object.

10. The method as recited in claim 1, wherein the use of the object to determine the longitudinal control parameter is stopped when at least one of:

(i) a comparison of the driving route of the object to a desired route of the vehicle indicates that the object has moved away from the desired route by more than a predefined distance;

(ii) an ascertained speed of the object is greater than a predetermined allowed speed at the position of the vehicle; and

(iii) an ascertained distance of the object from the vehicle is greater than a predefined threshold distance.

11. A device for assisting a driver in lane guidance of a host vehicle on a roadway, comprising:

a display unit for displaying a recorded image to the driver, the image having been recorded by a camera and representing the vehicle surroundings;

a user interface for reading in an operating signal which is input by the driver;

a selecting arrangement to select, using the operating signal, an object contained in the image;

a displaying arrangement to display at least one marking object on the display unit, wherein the at least one marking object (i) is displayed by superimposing the at least one marking object on an area of the image which represents the object and (ii) includes information representing a time to collision with the object; and

a determining arrangement, using the object, to determine at least one longitudinal control parameter for a driving route to be traveled by the vehicle to assist the driver in lane guidance of the vehicle on the roadway;

wherein in the display step, information concerning a distance between the host vehicle and the object is additionally displayed on the display unit, the information being displayed in an area of the image which contains the object,

wherein the information is displayed as a symbol or a special graphic together with the at least one marking object in the area of the image which represents the object,

wherein a premarking on the object is touch selectable by the driver to provide a selected object to start at least one of a longitudinal guidance and a transverse guidance with respect to the object, and

wherein the premarking is removed when the object is selected and is replaced by a confirming marking, which confirms that guidance is being provided with respect to the selected object.

12. A non-transitory computer-readable data storage medium storing a computer program, which is executable by a processor, comprising:

a program code arrangement having program code for assisting a driver in lane guidance of a host vehicle on a roadway, by performing the following;

displaying on a display unit a recorded image to the driver, the image having been recorded by a camera and representing the vehicle surroundings;

reading in an operating signal which is input on a user interface by the driver;

selecting, using the operating signal, an object contained in the image;

displaying at least one marking object on the display unit, wherein the at least one marking object (i) is displayed by superimposing the at least one marking object on an area of the image which represents the object and (ii) includes information representing a time to collision with the object; and

using the object to determine at least one longitudinal control parameter for a driving route to be traveled by the vehicle to assist the driver in lane guidance of the vehicle on the roadway;

wherein in the display step, information concerning a distance between the host vehicle and the object is additionally displayed on the display unit, the information being displayed in an area of the image which contains the object,

wherein the information is displayed as a symbol or a special graphic together with the at least one marking object in the area of the image which represents the object,

wherein a premarking on the object is touch selectable by the driver to provide a selected object to start at least one of a longitudinal guidance and a transverse guidance with respect to the object, and

wherein the premarking is removed when the object is selected and is replaced by a confirming marking, which confirms that guidance is being provided with respect to the selected object.