Vehicle personal assistant that interprets spoken natural language input based upon vehicle context
First Claim
1. A computer-implemented method, comprising:
- receiving, by a vehicle computing system, natural language input interpreted from audio input, wherein the natural language input is associated with a vehicle, and wherein the natural language input is received after an interval of time has passed since a previous input was received;
receiving visual input, wherein the visual input is associated with the vehicle, and wherein the visual input includes an image of a person when the person is in proximity to the vehicle;
determining a current context of the vehicle, wherein determining includes using vehicle-related inputs;
determining that the natural language input is associated with a previous dialog, wherein the previous dialog includes the previous input, wherein determining includes using a vehicle-specific conversation model, wherein the vehicle-specific conversation model includes one or more rules for determining when a conversation has started or ended, and wherein the vehicle-specific conversation model associates the interval of time with a pause that is associated with an operation related to the vehicle;
determining a query, wherein the query is determined using the natural language input, the visual input, the previous dialog, and the current context of the vehicle;
using the query to determine information about the vehicle, wherein the information is determined using a vehicle user guide; and
presenting the information using a component of the vehicle.
1 Assignment
0 Petitions
Accused Products
Abstract
A vehicle personal assistant to engage a user in a conversational dialog about vehicle-related topics, such as those commonly found in a vehicle owner'"'"'s manual, includes modules to interpret spoken natural language input, search a vehicle knowledge base and/or other data sources for pertinent information, and respond to the user'"'"'s input in a conversational fashion. The dialog may be initiated by the user or more proactively by the vehicle personal assistant based on events that may be currently happening in relation to the vehicle. The vehicle personal assistant may use real-time inputs obtained from the vehicle and/or non-verbal inputs from the user to enhance its understanding of the dialog and assist the user in a variety of ways.
-
Citations
36 Claims
-
1. A computer-implemented method, comprising:
-
receiving, by a vehicle computing system, natural language input interpreted from audio input, wherein the natural language input is associated with a vehicle, and wherein the natural language input is received after an interval of time has passed since a previous input was received; receiving visual input, wherein the visual input is associated with the vehicle, and wherein the visual input includes an image of a person when the person is in proximity to the vehicle; determining a current context of the vehicle, wherein determining includes using vehicle-related inputs; determining that the natural language input is associated with a previous dialog, wherein the previous dialog includes the previous input, wherein determining includes using a vehicle-specific conversation model, wherein the vehicle-specific conversation model includes one or more rules for determining when a conversation has started or ended, and wherein the vehicle-specific conversation model associates the interval of time with a pause that is associated with an operation related to the vehicle; determining a query, wherein the query is determined using the natural language input, the visual input, the previous dialog, and the current context of the vehicle; using the query to determine information about the vehicle, wherein the information is determined using a vehicle user guide; and presenting the information using a component of the vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A vehicle computing system, comprising:
-
one or more processors; and a non-transitory computer-readable medium including instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including; receiving natural language input interpreted from audio input, wherein the natural language input is associated with a vehicle, and wherein the natural language input is received after an interval of time has passed since a previous input was received; receiving visual input, wherein the visual input is associated with the vehicle, and wherein the visual input includes an image of a person when the person is in proximity to the vehicle; determining a current context of the vehicle, wherein determining includes using vehicle-related inputs; determining that the natural language input is associated with a previous dialog, wherein the previous dialog includes the previous input, wherein determining includes using a vehicle-specific conversation model, wherein the vehicle-specific conversation model includes one or more rules for determining when a conversation has started or ended, and wherein the vehicle-specific conversation model associates the interval of time with a pause that is associated with an operation related to the vehicle; determining a query, wherein the query is determined using the natural language input, the visual input, the previous dialog, and the current context of the vehicle; using the query to determine information about the vehicle, wherein the information is determined using a vehicle user guide; and presenting the information using a component of the vehicle. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions that, when executed by one or more processors, cause the one or more processors to:
-
receive natural language input interpreted from audio input, wherein the natural language input is associated with a vehicle, and wherein the natural language input is received after an interval of time has passed since a previous input was received; receive visual input, wherein the visual input is associated with the vehicle, and wherein the visual input includes an image of a person when the person is in proximity to the vehicle; determine a current context of the vehicle, wherein determining includes using vehicle-related inputs; determine that the natural language input is associated with a previous dialog, wherein the previous dialog includes the previous input, wherein determining includes using a vehicle-specific conversation model, wherein the vehicle-specific conversation model includes one or more rules for determining when a conversation has started or ended, and wherein the vehicle-specific conversation model associates the interval of time with a pause that is associated with an operation related to the vehicle; determine a query, wherein the query is determined using the natural language input, the visual input, the previous dialog, and the current context of the vehicle; use the query to determine information about the vehicle, wherein the information is determined using a vehicle user guide; and present the information using a component of the vehicle. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
Specification