Co-pilot and conversational companion
First Claim
Patent Images
1. A vehicle companion system for vehicle-to-user interaction, comprising:
- one or more processors; and
a memory communicably coupled to the one or more processors and storing;
a cognitive monitoring module including instructions that when executed by the one or more processors cause the one or more processors to receive, using one or more internal sensors, state information about an operator, to receive, using one or more external sensors, environmental information about a vehicular environment, to determine a cognitive load of the operator using the state information, the cognitive load being a measure of the mental effort being exerted by the operator, to determine a cognitive requirement of the vehicular environment using the environmental information, the cognitive requirement being a measure of the attention, alertness, or awareness desired from the operator for vehicle operation within an environment, to compare the cognitive load and the cognitive requirement to determine if an intervention indicator exists, and to determine whether there is an anticipated intervention indicator, for the operator, using the environmental information; and
a conversation module including instructions that when executed by the one or more processors cause the one or more processors to emit natural language speech via an audio output device in response to the intervention indicator or the anticipated intervention indicator, the natural language speech prompting a conversation with the operator, the conversation including a topic selected based on stored personality profile information.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for communicating with a vehicle companion are disclosed. The vehicle companion can include receiving state information about an operator and environmental information about a vehicular environment. A cognitive load and a cognitive requirement can be determined using the state information and the environmental information, respectively. The cognitive load and the cognitive requirement are then compared to determine if an intervention indicator exists. The vehicle companion can then enter into conversation with the operator in response to the intervention indicator, including topics selected based on the operator'"'"'s personality.
-
Citations
14 Claims
-
1. A vehicle companion system for vehicle-to-user interaction, comprising:
-
one or more processors; and a memory communicably coupled to the one or more processors and storing; a cognitive monitoring module including instructions that when executed by the one or more processors cause the one or more processors to receive, using one or more internal sensors, state information about an operator, to receive, using one or more external sensors, environmental information about a vehicular environment, to determine a cognitive load of the operator using the state information, the cognitive load being a measure of the mental effort being exerted by the operator, to determine a cognitive requirement of the vehicular environment using the environmental information, the cognitive requirement being a measure of the attention, alertness, or awareness desired from the operator for vehicle operation within an environment, to compare the cognitive load and the cognitive requirement to determine if an intervention indicator exists, and to determine whether there is an anticipated intervention indicator, for the operator, using the environmental information; and a conversation module including instructions that when executed by the one or more processors cause the one or more processors to emit natural language speech via an audio output device in response to the intervention indicator or the anticipated intervention indicator, the natural language speech prompting a conversation with the operator, the conversation including a topic selected based on stored personality profile information. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A non-transitory computer-readable medium for vehicle-to-user interaction and storing instructions that when executed by one or more processors cause the one or more processors to:
-
receive, using one or more internal sensors, state information about an operator; receive, using one or more external sensors, environmental information about a vehicular environment; determine a cognitive load of the operator using the state information, the cognitive load being a measure of the mental effort being exerted by the operator; determine a cognitive requirement of the vehicular environment using the environmental information, the cognitive requirement being a measure of the attention, alertness, or awareness desired from the operator for vehicle operation within an environment; compare the cognitive load and the cognitive requirement to determine if an intervention indicator exists; determine whether there is an anticipated intervention indicator, for the operator, using the environmental information; and emit natural language speech via an audio output device in response to the intervention indicator or the anticipated intervention indicator, the natural language speech prompting a conversation with the operator, the conversation including a topic selected based on stored personality profile information. - View Dependent Claims (8, 9, 10)
-
-
11. A method for vehicle-to-user interaction, comprising:
-
receiving, using one or more internal sensors, state information about an operator; receiving, using one or more external sensors, environmental information about a vehicular environment; determining a cognitive load of the operator using the state information, the cognitive load being a measure of the mental effort being exerted by the operator; determining a cognitive requirement of the vehicular environment using the environmental information, the cognitive requirement being a measure of the attention, alertness, or awareness desired from the operator for vehicle operation within an environment; comparing the cognitive load and the cognitive requirement to determine if an intervention indicator exists; determining whether there is an anticipated intervention indicator, for the operator, using the environmental information; and emitting natural language speech via an audio output device in response to the intervention indicator or the anticipated intervention indicator, the natural language speech prompting a conversation with the operator, the conversation including a topic selected based on stored personality profile information. - View Dependent Claims (12, 13, 14)
-
Specification