Cognitive workload awareness

• US 10,319,253 B2
• Filed: 01/06/2017
• Issued: 06/11/2019
• Est. Priority Date: 01/06/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hwang, Inseok, Liu, Su, Rozner, Eric J., Sze, Chin Ngai
• Primary Examiner(s): Coburn, Corbett B
• Application Number:
  US15/400,644
• Publication Number:
  US 20180197429A1
• Time in Patent Office: 886 Days
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G09B 19/162 Control of ships, boats, or other waterborne vehicles
• CPC Class Codes: G09B 19/165 Control of aircraft
• CPC Class Codes: G09B 19/167 Control of land vehicles
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

For determining cognitive workload awareness in driving context, an apparatus is disclosed. In some embodiments, the apparatus includes an activity monitor module that monitors driving activities of a driver. The apparatus includes a workload analysis module that determines a cognitive workload of the driver associated with the driving activities of the driver. Further, the apparatus includes a question-and-answer (QnA) dispatch module that determines an available QnA cognitive workload of the driver for performing QnA tasks based on the cognitive workload while ensuring a safe cognitive workload boundary associated with the driving activities of the driver.

Claims

1. An apparatus, comprising:

an activity monitor module that electronically retrieves data from a vehicle diagnostic interface and at least one other electronic interface that is accessible from onboard a moving vehicle to monitor driving activities of a driver;

a workload analysis module that determines a cognitive workload of the driver associated with the driving activities of the driver the retrieved data;

a question-and-answer (QnA) dispatch module that determines an available QnA cognitive workload of the driver for performing QnA tasks communicated over a network to the driver based on the cognitive workload while ensuring a safe cognitive workload boundary associated with the driving activities of the driver;

wherein said modules comprise one or more of hardware circuits, a programmable hardware device, and a processor executing code stored in memory.

2. The apparatus of claim 1, wherein the at least one other electronic interface is selected from a group consisting of an external interface configured to communicate traffic-related data, an external interface configured to communication weather-related data, an external interface configured to communicate location-related data, an external interface configured to communicate information from external environmental sensors, an external interface configured to communicate information from one or more cloud service providers, a speech interface configured to communicate voice input data, an auditory interface configured to communicate audible output data, and a user device interface configured to communicate information related to user settings from one or more mobile devices.

3. The apparatus of claim 1, wherein the workload analysis module further determines a safe cognitive workload of the driver associated with the driving activities of the driver.

4. The apparatus of claim 3, wherein:

in response to a summation of the cognitive workload and an additional cognitive workload that the fetched QnA task adds to the cognitive workload being less than the safe cognitive workload, the QnA dispatch module fetches a QnA task for driver response, and

in response to the summation of the cognitive workload and the additional cognitive workload that the fetched QnA task adds to the cognitive workload being equal to or greater than the safe cognitive workload, the QnA dispatch module does not fetch a QnA task for driver response.

5. The apparatus of claim 4, wherein the fetched QnA task for driver response comprises a corresponding cognitive workload of less than a difference between the safe cognitive workload and the cognitive workload.

6. The apparatus of claim 1, wherein the driving activities of the driver include talking with one or more passengers while the driver is operating a vehicle.

7. The apparatus of claim 1, wherein the cognitive workload of the driver includes a baseline cognitive workload of the driver and one or more variable cognitive workloads of the driver associated with the driving activities of the driver.

8. The apparatus of claim 7, wherein the baseline cognitive workload is associated with default driving activities of the driver including driving a vehicle under routine mental, physical, and temporal operating conditions.

9. The apparatus of claim 7, wherein the one or more variable cognitive workloads include one or more intensive task workloads associated with metropolitan driving activities, congested driving activities, extreme weather driving activities, and night driving activities.

10. The apparatus of claim 7, wherein the one or more variable cognitive workloads include one or more of listening to music, controlling car audio, and conducting hands-free communication via a wireless network.

11. The apparatus of claim 1, wherein the workload analysis module determines an interface modality of the driver including hands-free communication between the apparatus and the driver.

12. The apparatus of claim 11, wherein the hands-free communication between the apparatus and the driver includes audible speech from the driver and voice recognition by the apparatus via one or more user interface components and a microphone.

13. The apparatus of claim 11, wherein the hands-free communication between the apparatus and the driver includes audible listening by the driver and computerized speech from the apparatus via one or more user interface components and a speaker.

14. The apparatus of claim 1, wherein the QnA tasks include dynamically fetched QnA tasks associated with one or more of surveys, polls, and context aware questions.

15. The apparatus of claim 1, wherein the QnA tasks include customer satisfaction surveys.

16. The apparatus of claim 1, wherein the QnA tasks include public polling interviews.

17. The apparatus of claim 1, wherein the QnA tasks include crowd-source questions including one or more of single-sentence interpretation, ground-truth tagging to auditory data, and unknown music classification associated with genre and/or mood.

18. The apparatus of claim 1, wherein the QnA tasks include context aware questions including one or more of traffic status questions, accident report questions, and point-of-view questions associated with location and/or time.

19. A method, comprising:

electronically retrieving data from a vehicle diagnostic interface and at least one other electronic interface that is accessible from onboard a moving vehicle to monitor driving activities of a driver while the driver is operating a vehicle;

determining a cognitive workload and a safe cognitive workload of the driver associated with the driving activities of the driver;

determining an available QnA cognitive workload of the driver for performing QnA tasks communicated over a network to the driver based on the cognitive workload while ensuring a safe cognitive workload boundary associated with the safe cognitive workload of the driver; and

fetching a QnA task over the network for driver response if a summation of the cognitive workload and an additional cognitive workload that the fetched QnA task adds to the cognitive workload is less than the safe cognitive workload so as to ensure the safe cognitive workload boundary,

wherein the fetched QnA task for driver response has a corresponding cognitive workload of less than a difference between the safe cognitive workload and the cognitive workload.

20. A non-transitory computer-readable medium having stored thereon a plurality of computer-executable instructions that, when executed by a computer, cause the computer to:

electronically retrieve data from a vehicle diagnostic interface and at least one other electronic interface that is accessible from onboard a moving vehicle to monitor driving activities of a driver while the driver is operating a vehicle;

determine a cognitive workload and a safe cognitive workload of the driver associated with the driving activities of the driver;

determine an available QnA cognitive workload of the driver for performing QnA tasks communicated over a network to the driver based on the cognitive workload while ensuring a safe cognitive workload boundary associated with the safe cognitive workload of the driver; and

fetch a QnA task for driver response if a summation of the cognitive workload and an additional cognitive workload that the fetched QnA task adds to the cognitive workload is less than the safe cognitive workload so as to ensure the safe cognitive workload boundary,

wherein the fetched QnA task for driver response has a corresponding cognitive workload of less than a difference between the safe cognitive workload and the cognitive workload.