METHOD AND ARRANGEMENT FOR ALLOWING SECONDARY TASKS DURING SEMI-AUTOMATED DRIVING

• US 20160375911A1
• Filed: 05/27/2016
• Published: 12/29/2016
• Est. Priority Date: 06/23/2015
• Status: Abandoned Application

• Current Assignee: Volvo Car Corporation (AB Volvo)
• Original Assignee: Volvo Car Corporation (AB Volvo)
• Inventors: COELINGH, Erik, EKMARK, Jonas
• Application Number:
  US15/166,417
• Publication Number:
  US 20160375911A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/164 Infotainment
• CPC Class Codes: B60K 28/066 actuating a signalling device B60K28/063 takes precedence
• CPC Class Codes: B60K 28/10 responsive to conditions relating to the vehicle
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/00 Input parameters relating to occupants
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 2540/221 Physiology, e.g. weight, heartbeat, health or special needs
• CPC Class Codes: B60W 2540/225 Direction of gaze
• CPC Class Codes: B60W 2552/00 Input parameters relating to infrastructure
• CPC Class Codes: B60W 50/0205 Diagnosing or detecting failures; Failure detection models
• CPC Class Codes: B60W 50/082 Selecting or switching between different modes of propelling
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60W 60/0018 by employing degraded modes, e.g. reducing speed, in response to suboptimal conditions
• CPC Class Codes: B60W 60/0053 from vehicle to occupant
• CPC Class Codes: B60W 60/0059 Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa

Abstract

A method and arrangement are disclosed for allowing secondary tasks during semi-automated driving of a road vehicle having an infotainment system including one or more display units, and a semi-automated driver assist system having one or more sensors for acquiring data of a road ahead. A confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously is determined from at least acquired data of the road ahead. A viewing direction of a driver of the road vehicle is determined using a driver monitoring camera. Autonomous control is allowed if the viewing direction of the driver is determined to be towards the road ahead or towards a display unit of the infotainment system and the confidence is determined to be above a confidence threshold, otherwise any ongoing autonomous control is cancelled and the driver urged to assume control of the road vehicle.

Claims

1. A method for allowing secondary tasks during semi-automated driving of a road vehicle having an infotainment system which comprises one or more infotainment display units arranged in a passenger compartment thereof, and a semi-automated driver assist system including one or more sensors for acquiring data of a road ahead, the method comprising:

determining, from at least the acquired data of the road ahead, a confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously;

determining a viewing direction of a driver of the road vehicle using a driver monitoring camera;

if the viewing direction of the driver of the road vehicle is determined to be towards the road ahead or towards an infotainment display unit of the infotainment system of the road vehicle and the confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously is determined to be above a confidence threshold, allowing autonomous control of the road vehicle by the semi-automated driver assist system; and

if, during ongoing autonomous control by the semi-automated driver assist system, the viewing direction of the driver of the road vehicle is determined not to be towards the road ahead or towards an infotainment display unit of the infotainment system of the road vehicle or the confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously is determined to be below a confidence threshold, cancelling the ongoing autonomous control by the semi-automated driver assist system and urging the driver of the road vehicle to assume control of the road vehicle.

2. The method according to claim 1 further comprising discontinuing or fading-out any ongoing presentation on the infotainment display unit of the infotainment system of the road vehicle viewed by the driver upon urging the driver of the road vehicle to assume control of the road vehicle.

3. The method according to claim 1 wherein, if the viewing direction of the driver of the road vehicle is determined to not be towards the road ahead or towards an infotainment display unit of the infotainment system of the road vehicle, but on a nomadic device or item, then cancelling any ongoing autonomous control by the semi-automated driver assist system and urging the driver to assume control of the road vehicle.

4. The method according to claim 1 further comprising determining a fault status of the semi-automated driver assist system and if determined faulty, discontinuing or fading-out any ongoing presentation on the infotainment display unit of the infotainment system of the road vehicle viewed by the driver and urging the driver of the road vehicle to assume control of the road vehicle.

5. The method according to claim 1 further comprising determining a delay in the driver of the road vehicle to assuming control of the road vehicle following the driver of the road vehicle being urged to assume control of the road vehicle, and if the determined delay exceeds a predetermined delay threshold, causing the semi-automated driver assist system to go to a degraded mode and slow down the road vehicle autonomously.

6. The method according to claim 5 wherein the delay in the driver of the road vehicle assuming control of the road vehicle is determined from a delay in the viewing direction of the driver of the road vehicle being determined to be towards the road ahead following the driver of the road vehicle being urged to assume control of the road vehicle.

7. The method according to claim 1 wherein urging the driver of the road vehicle to assume control of the road vehicle comprises at least one of:

presenting a takeover request to the infotainment display unit of the infotainment system of the road vehicle viewed by the driver;

presenting a blackout screen to the infotainment display unit of the infotainment system of the road vehicle viewed by the driver;

presenting an acoustic takeover request to an acoustic presentation unit of the road vehicle;

presenting a haptic takeover request warning to a road vehicle driver contact surface of the road vehicle.

8. An arrangement for allowing secondary tasks during semi-automated driving of a road vehicle having an infotainment system including one or more infotainment display units arranged in a passenger compartment thereof, and a semi-automated driver assist system having one or more sensors for acquiring data of a road ahead, the arrangement comprising:

a control unit configured to determine, from at least the acquired data of the road ahead, a confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously; and

a driver monitoring camera for determining a viewing direction of a driver of the road vehicle;

the control unit further configured to

allow autonomous control of the road vehicle by the semi-automated driver assist system if the viewing direction of the driver of the road vehicle is determined to be towards the road ahead or towards an infotainment display unit of the infotainment system of the road vehicle and the confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously is determined to be above a confidence threshold, and

during ongoing autonomous control by the semi-automated driver assist system, cancel the ongoing autonomous control by the semi-automated driver assist system and urge the driver of the road vehicle to assume control of the road vehicle if the viewing direction of the driver of the road vehicle is determined not to be towards the road ahead or towards an infotainment display unit of the infotainment system of the road vehicle or the confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously is determined to be below a confidence threshold.

9. The arrangement according to claim 8 wherein the control unit further is configured to discontinue or fade-out any ongoing presentation on the infotainment display unit of the infotainment system of the road vehicle viewed by the driver upon urging the driver of the road vehicle to assume control of the road vehicle.

10. The arrangement according to claim 8 wherein the control unit further is configured to cancel any ongoing autonomous control by the semi-automated driver assist system and urge the driver to assume control of the road vehicle if the viewing direction of the driver of the road vehicle is determined to not be towards the road ahead or towards an infotainment display unit of the infotainment system of the road vehicle, but on a nomadic device or item.

11. The arrangement according to claim 8 wherein the control unit further is configured to determine a fault status of the semi-automated driver assist system, and if determined faulty discontinue or fade-out any ongoing presentation on the infotainment display unit of the infotainment system of the road vehicle viewed by the driver and urge the driver of the road vehicle to assume control of the road vehicle.

12. The arrangement according to claim 8 wherein the control unit further is configured to determine a delay in the driver of the road vehicle assuming control of the road vehicle following the driver of the road vehicle being urged to assume control of the road vehicle, and if the determined delay exceeds a predetermined delay threshold, cause the semi-automated driver assist system to go to a degraded mode and slow down the road vehicle autonomously.

13. The arrangement according to claim 12 wherein the control unit further is configured to determine the delay in the driver of the road vehicle assuming control of the road vehicle from a delay in the viewing direction of the driver of the road vehicle being determined to be towards the road ahead following the driver of the road vehicle being urged to assume control of the road vehicle.

14. An arrangement according to claim 8 wherein the control unit further is configured to urge the driver of the road vehicle to assume control of the road vehicle by at least one of:

presenting a takeover request to the infotainment display unit of the infotainment system of the road vehicle viewed by the driver;

presenting a blackout screen to the infotainment display unit of the infotainment system of the road vehicle viewed by the driver;

presenting an acoustic takeover request to an acoustic presentation unit of the road vehicle;

presenting a haptic takeover request warning to a road vehicle driver contact surface of the road vehicle.

15. A road vehicle comprising an arrangement according to claim 8.