Method and system for adapting augmented switching warning

• US 10,406,978 B2
• Filed: 12/19/2017
• Issued: 09/10/2019
• Est. Priority Date: 12/19/2017
• Status: Active Grant

• Current Assignee: PlusAI, Inc.
• Original Assignee: PlusAI Corp.
• Inventors: Zheng, Hao, Daly, Jr., Timothy Patrick, Liu, David Wanqian
• Primary Examiner(s): Bolourchi, Nader
• Application Number:
  US15/846,998
• Publication Number:
  US 20190184897A1
• Time in Patent Office: 630 Days
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60W 2040/0872 Driver physiology
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2540/045 Occupant permissions
• CPC Class Codes: B60W 2540/221 Physiology, e.g. weight, heartbeat, health or special needs
• CPC Class Codes: B60W 2540/223 Posture, e.g. hand, foot, or seat position, turned or inclined
• CPC Class Codes: B60W 2540/225 Direction of gaze
• CPC Class Codes: B60W 50/00 Details of control systems for road vehicle drive control not related to the control of a particular sub-unit , e.g. process diagnostic or vehicle driver interfaces
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60W 60/0057 Estimation of the time available or required for the handover
• CPC Class Codes: B60W 60/0059 Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa

Abstract

The present teaching relates to method, system, and medium, for presenting a warning to a driver. An instruction indicating an upcoming change in an operating mode of the vehicle is obtained, wherein the instruction specifies a set of tasks to be completed by the driver and a task duration associated with each task. Information of a current state of the driver is obtained and used to determine a warning to be used to alert the driver to perform the change, wherein the warning includes warning content and indication of at least one media to be used to deliver the warning content. A warning schedule is generated to comprise a set of warnings, each warning corresponding to one task, and arranged in an order based on an order of the tasks. The warning schedule is transmitted so that each warning of the set of warnings is executed.

Claims

1. A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for presenting a warning to a driver of a vehicle, the method comprising:

obtaining an instruction indicating an upcoming change in an operating mode of the vehicle, the instruction specifying a set of tasks to be completed by the driver in the vehicle and a task duration associated with each task by which the task is to be completed;

obtaining information indicative of a current state of the driver;

determining, for each task, a warning to be used to alert the driver to perform the task, wherein the warning includes at least a warning content and at least one media to be used to deliver the warning content to the driver;

generating a warning schedule comprising a set of warnings, each warning corresponding to one task of the set of tasks and arranged in an order based on an order of the set of tasks; and

transmitting the warning schedule so that each warning in the warning schedule is to be executed with respect to the driver via the at least one media.

2. The method of claim 1, wherein the warning content and the at least one media used to deliver the warning are determined based on the current state of the driver.

3. The method of claim 2, wherein the at least one media used to deliver the warning to the driver is determined based on a driver profile, the driver profile including characteristic information relevant to the driver.

4. The method of claim 1, wherein the warning further includes a starting time and a duration, the duration of the warning being less than the task duration and being determined based on the current state of the driver.

5. The method of claim 4, wherein the warning further includes a warning intensity associated with the warning content, the warning intensity being determined based on the current state of the driver.

6. The method of claim 1, wherein the at least one media includes a selectable sound source, a vibration source, a light source, a visual source, and an audio source.

7. A non-transitory computer readable medium having information stored thereon for presenting a warning to a driver of a vehicle, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining an instruction indicating an upcoming change in an operating mode of the vehicle, the instruction specifying a set of tasks to be completed by the driver in the vehicle and a task duration associated with each task by which the task is to be completed;

obtaining information indicative of a current state of the driver;

determining, for each task, a warning to be used to alert the driver to perform the task, wherein the warning includes at least a warning content and at least one media to be used to deliver the warning content to the driver;

generating a warning schedule comprising a set of warnings, each warning corresponding to one task of the set of tasks and arranged in an order based on an order of the set of tasks; and

transmitting the warning schedule so that each warning in the warning schedule is to be executed with respect to the driver via the at least one media.

8. The medium of claim 7, wherein the warning content and the at least one media used to deliver the warning are determined based on the current state of the driver.

9. The medium of claim 8, wherein the at least one media used to deliver the warning to the driver is determined based on a driver profile, the driver profile including characteristic information relevant to the driver.

10. The medium of claim 7, wherein the warning further includes a starting time and a duration, the duration of the warning being less than the task duration and being determined based on the current state of the driver.

11. The medium of claim 10, wherein the warning further includes a warning intensity associated with the warning content, the warning intensity being determined based on the current state of the driver.

12. The medium of claim 7, wherein the at least one media includes a selectable sound source, a vibration source, a light source, a visual source, and an audio source.

13. A system presenting a warning to a driver of a vehicle, the system comprising:

a warning instruction analyzer implemented by a processor and configured to obtain an instruction indicating an upcoming change in an operating mode of the vehicle, the instruction specifying a set of tasks to be completed by the driver in the vehicle and a task duration associated with each task by which the task is to be completed;

a warning determiner implemented by the processor and configured to;

obtain information indicative of a current state of the driver; and

determine, for each task, a warning to be used to alert the driver to perform the task, wherein the warning includes at least a warning content and at least one media to be used to deliver the warning content to the driver; and

a warning instruction generator implemented by the processor and configured to;

generate a warning schedule comprising a set of warnings, each warning corresponding to one task of the set of tasks and arranged in an order based on an order of the set of tasks; and

transmit the warning schedule so that each warning in the warning schedule is to be executed with respect to the driver via the at least one media.

14. The system of claim 13, wherein the warning content and the at least one media used to deliver the warning are determined based on the current state of the driver.

15. The system of claim 14, wherein the at least one media used to deliver the warning to the driver is determined based on a driver profile, the driver profile including characteristic information relevant to the driver.

16. The system of claim 13, wherein the warning further includes a starting time and a duration, the duration of the warning being less than the task duration and being determined based on the current state of the driver.

17. The system of claim 16, wherein the warning further includes a warning intensity associated with the warning content, the warning intensity being determined based on the current state of the driver.

18. The system of claim 13, wherein the at least one media includes a selectable sound source, a vibration source, a light source, a visual source, and an audio source.