Action planning device having a trajectory generation and determination unit

• US 10,761,536 B2
• Filed: 06/17/2015
• Issued: 09/01/2020
• Est. Priority Date: 08/07/2014
• Status: Active Grant

• Current Assignee: Hitachi Astemo Ltd. (Hitachi, Ltd.)
• Original Assignee: Hitachi Automotive Systems Limited (Hitachi, Ltd.)
• Inventors: Otsuka, Satoshi, Matsumoto, Noritaka, Sakurai, Kouhei, Tanimichi, Taisetsu
• Primary Examiner(s): Goldman, Richard A
• Application Number:
  US15/325,805
• Publication Number:
  US 20170153644A1
• Time in Patent Office: 1,903 Days
• Field of Search: 701 25, 701 23, 701 314, 701 70, 701 2, 701 36, 701 41, 701 96, 701 292, 701 93
• CPC Class Codes: B60Q 1/26 the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
• CPC Class Codes: B60Q 1/5035 electronic displays
• CPC Class Codes: B60Q 5/005 automatically actuated
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60R 16/0231 Circuits relating to the driving or the functioning of the vehicle monitoring tyres B60C23/00; indicating overspeed B60K31/00; for dash boards B60K37/00, B60Q3/10; for indicating emergencies B60Q1/52; brake control systems B60T; registering or indicating the working of vehicles G07C5/00; measuring distance G01C, e.g. combinations of speed and distance G01C23/00; engine indicators G01L; measuring speed or acceleration G01P
• CPC Class Codes: B60R 21/00 Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks safety belts or body harnesses in vehicles B60R22/00; devices, apparatus or methods for life-saving in general A62B; safety devices for propulsion unit control specially adapted for, or arranged in, vehicles B60K28/00; seats constructed to protect the occupant from the effect of abnormal g-forces, e.g. crash or safety seats, B60N2/42; energy-absorbing arrangements for hand wheels for steering vehicles B62D1/11; energy-absorbing arrangements for vehicle steering columns B62D1/19; harnessing in aircraft B64D25/00
• CPC Class Codes: B60W 30/10 Path keeping cruise control for automatically following a preceding vehicle B60W30/165
• CPC Class Codes: B60W 30/18163 Lane change; Overtaking manoeuvres
• CPC Class Codes: B60W 40/06 Road conditions
• CPC Class Codes: B60W 50/02 Ensuring safety in case of control system failures, e.g. by diagnosing, circumventing or fixing failures
• CPC Class Codes: B60W 50/023 Avoiding failures by using redundant parts
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G05D 1/0214 in accordance with safety or protection criteria, e.g. avoiding hazardous areas monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

Vehicle systems that implement action planning for a vehicle have had difficulty in maintaining safety in the event of a failure in a recognition device since these systems generate trajectories and control the vehicle on the basis of outside-world information recognized by recognition devices. The present invention was conceived in light of the aforementioned situation and addresses the problem of maintaining safety even in the event of a failure in a recognition device of a vehicle system. This problem can be solved by an action planning device having a failure detection unit for detecting a failure in an outside-world recognition unit and a trajectory generation/determination unit for executing an action on the occurrence of a failure on the basis of outside-world information outputted by the outside-world recognition unit, wherein the trajectory generation/determination unit takes an action for coping with the failure on the basis of failure information from the failure detection unit.

Claims

1. An action planning device, comprising:

a failure detection unit that is configured to;

i) detect an occurrence of a failure in outside-world recognition units, and ii) issue a notification;

an integration recognition unit that is configured to;

i) integrate outside-world recognition information output from the outside-world recognition units, and ii) output integration recognition information; and

a trajectory generation/determination unit that is configured to send, to a drive unit, a control instruction to execute an action on the occurrence of the failure, on the basis of the integration recognition information output by the integration recognition unit, wherein

the trajectory generation/determination unit is configured to send an instruction to take an action that addresses the failure, on the basis of the notification of the failure detection unit,

the trajectory generation/determination unit is configured to generate a vehicular trajectory that addresses the failure to enter a safe state, based on past outside-world recognition information of moving objects and of stationary objects, and

the past outside-world recognition information, in which the failure occurs, and a recognition result of a recognition device, in which no failure occurs, are configured to be displayed in such a manner that they are superimposed one over the other.

2. The action planning device according to claim 1, wherein the trajectory generation/determination unit is configured to determine a failure occurrence time, and is configured to discard outside-world recognition information after the failure occurrence time.

3. The action planning device according to claim 1, further comprising:

a notification unit that is configured to notify of the occurrence of the failure.

4. The action planning device according to claim 1, wherein the integration recognition unit is configured to predict an approach of a dynamic object based on a physical limit value or a road traffic law.

5. The action planning device according to claim 1, wherein the trajectory generation/determination unit is configured to generate the vehicular trajectory.

6. The action planning device according to claim 1, wherein the trajectory generation/operation unit is configured to maintain a middle state of a traffic lane as a safe state.

7. The action planning device according to claim 1, further comprising:

an output unit which notifies a user of a failure occurrence state, wherein the output unit is configured to notify the user of the occurrence of the failure.

8. An action planning device, comprising:

a failure detection unit that is configured to;

i) detect an occurrence of a failure in outside-world recognition units, and ii) issue a notification;

an integration recognition unit which that is configured to;

i) integrate outside-world recognition information output from the outside-world recognition units, and ii) output integration recognition information; and

a trajectory generation/determination unit that is configured to send, to a drive unit, a control instruction to execute an action on the occurrence of the failure, on the basis of the integration recognition information output by the integration recognition unit, wherein

the trajectory generation/determination unit is configured to send an instruction to take an action that addresses the failure, on the basis of the notification of the failure detection unit,

the trajectory generation/determination unit is configured to generate a trajectory to avoid a dynamic object from entering a given area, and

past outside-world recognition information, in which the failure occurs, and a recognition result of a recognition device, in which the failure does not occur, are configured to be displayed in such a manner that they are superimposed one over the other.

9. The action planning device according to claim 8, wherein the trajectory generation/determination unit is configured to determine a failure occurrence time, and is configured to discard outside-world recognition information after the failure occurrence time.

10. The action planning device according to claim 8, further comprising:

a notification unit that is configured to notify of the occurrence of the failure.

11. The action planning device according to claim 8, wherein the integration recognition unit is configured to predict an approach of a dynamic object based on a physical limit value or a road traffic law.

12. The action planning device according to claim 8, wherein the trajectory generation/operation unit is configured to maintain a middle state of a traffic lane as a safe state.

13. The action planning device according to claim 8, further comprising:

an output unit which notifies a user of a failure occurrence state, wherein the output unit is configured to notify the user of the occurrence of the failure.