System and method of conversational assistance in an interactive information system

• US 9,667,742 B2
• Filed: 07/12/2013
• Issued: 05/30/2017
• Est. Priority Date: 07/12/2012
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Xu, Kui, Weng, Fuliang, Shen, Zhongnan, Feng, Zhe
• Primary Examiner(s): BAROT, BHARAT
• Application Number:
  US13/940,934
• Publication Number:
  US 20140019522A1
• Time in Patent Office: 1,418 Days
• Field of Search: 709202-203, 709217-219
• CPC Class Codes: G06F 16/903 Querying for retrieval from the web G06F16/953
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G06N 5/043 Distributed expert systems; Blackboards
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

A method of providing information assistance services includes generating a plurality of service requests for a plurality of request elements that are generated from a single client request received by a processor. The service requests are sent to both software application service providers that are executed by the processor and remote service providers that are connected to the local processor through a data network. The processor receives a plurality of service responses from the service providers, generating at least one output message element corresponding to the service responses, and sending the output message data to at least one output device that is operatively connected to the processor to produce a response to the client request.

Claims

1. A method of providing information assistance services comprising:

receiving a single client request with a processor;

generating a plurality of request elements with reference to the single client request and at least one ontology stored in a memory operatively connected to the processor;

generating a plurality of service requests with the processor, the plurality of service requests corresponding to the plurality of request elements;

sending at least one generated service request in the plurality of service requests to at least one data service provider in a first plurality of data service providers that are software programs executed by the processor;

sending at least one other generated service request in the plurality of service requests to at least one data service provider in a second plurality of data service providers that are external data service providers communicatively coupled to the processor through a data network;

receiving a plurality of service responses including a service response from each data service provider in the first plurality of data service providers and the second plurality of data service providers that received a generated service request;

generating at least one output message element corresponding to the service responses received from the service providers;

generating output message data with reference to the at least one output message element, the generating of the output message data further comprising;

associating a first service response in the plurality of service responses to a first output message element in the plurality of output message elements with the processor;

associating a second service response in the plurality of service responses to the first output message element with the processor, the second service response being different than the first service response;

generating a ranking of the first service response and the second service response with reference to the at least one ontology stored in the memory; and

associating only one of the first service response or the second service response with the first output message element with reference to the ranking; and

sending the output message data to at least one output device that is operatively connected to the processor to produce a response to the client request.

2. The method of claim 1, the sending of the data service requests further comprising:

generating a classification for one request element in the plurality of request elements with the at least one ontology stored in the memory;

identifying a data service provider in the first plurality of data service providers corresponding to the one request element with reference to a predetermined association between the classification and the plurality of data services providers; and

sending a service request corresponding to the one request element to the identified data service provider.

3. The method of claim 1, the generation of the output further comprising:

generating the output including at least one of text or graphics with a visual display device.

4. The method of claim 1, the generation of the output further comprising:

generating the output including audio with an audio output device.

5. The method of claim 1 further comprising:

receiving data corresponding to an environment in which the processor operates from a sensor operatively connected to the processor;

selecting the at least one output device from a plurality of output devices with reference to the data from the sensor; and

generating the output with the selected at least one output device.

6. The method of claim 5 further comprising:

receiving data from a speed sensor corresponding to a speed of motion of a device that includes the processor; and

generating the output with an audio output device in response to the data from the speedometer indicating that the speed of motion is greater than a predetermined threshold.

7. The method of claim 5 further comprising:

receiving data from a speed sensor corresponding to a speed of motion of a device that includes the processor; and

generating the output with a video output device in response to the data from the speedometer indicating that the speed of motion is less than a predetermined threshold.

8. The method of claim 1 further comprising:

generating another output with the at least one output device to request input corresponding to an additional request element corresponding to the client request;

receiving the input with a user input device;

identifying the additional request element in the input; and

generating the plurality of service requests corresponding to the plurality of request elements in the client request and the additional request element with the processor.

9. An information assistance system comprising:

at least one input device;

at least one output device;

a network device;

a memory configured to store;

at least one ontology include domain data corresponding to request elements in a client request and service requests corresponding to the request elements; and

stored program instructions for a plurality of software programs that are executed by the information assistance system; and

a processor operatively connected to the at least one input device, at least one output device, network device, and memory, the processor being configured to execute programmed instructions to;

receive a client request from the at least one input device;

generate a plurality of request elements with reference to the single client request and the at least one ontology;

generate a plurality of service requests corresponding to the plurality of request elements;

send at least one generated service request in the plurality of service requests to at least one software program in the plurality of software programs executed by the processor;

send at least one other generated service request in the plurality of service requests through a data network with the network device to at least one external data service provider in a plurality of data external data service providers;

receive a plurality of service responses including a service response from each software program in the plurality of software programs and each data service provider in the plurality of data service providers that received a generated service request;

generate at least one output message element corresponding to the service responses;

generate output message data with reference to the at least one output message element, the processor being further configured to;

associate a first service response in the plurality of service responses to a first output message element in the plurality of output message elements with the processor;

associate a second service response in the plurality of service responses to the first output message element with the processor, the second service response being different than the first service response;

generate a ranking of the first service response and the second service response with reference to the at least one ontology stored in the memory; and

associate only one of the first service response or the second service response with the first output message element with reference to the ranking; and

send the output message data to the at least one output device to produce a response to the client request.

10. The system of claim 9, the processor being further configured to:

generate a classification for one request element in the plurality of request elements with the at least one ontology stored in the memory;

identify a data service provider in the first plurality of data service providers corresponding to the one request element with reference to a predetermined association between the classification and the plurality of data services providers; and

send a service request corresponding to the one request element to the identified data service provider.

11. The system of claim 9 further comprising:

at least one sensor configured to generate data corresponding to an environment in which the processor operates; and

the processor being operatively connected to the at least one sensor and further configured to;

receive sensor data corresponding to the environment from the sensor;

select the at least one output device from a plurality of output devices with reference to the sensor data; and

generate the output with the selected at least one output device.

12. The system of claim 9 further comprising:

a first sensor integrated with a vehicle and configured to generate first sensor data corresponding to actions of a human driver of the vehicle;

a second integrated with the vehicle and configured to generate second sensor data corresponding to an operating state of the vehicle; and

the processor being integrated with the vehicle and operatively connected to the first sensor and the second sensor, the processor being further configured to;

receive the first sensor data and the second sensor data;

identify a state of the driver in response to the first sensor data, the second sensor data, and the at least one ontology stored in the memory;

generate an output message with reference to the identified state of the driver; and

send the output message data to at least one output device that is operatively connected to the processor to alert the driver to the identified state.

13. The system of claim 12, the processor being further configured to:

identify a state of drowsiness in the driver in response to the first sensor data indicating a lack of movement for the driver and the second sensor data indicating that the vehicle is traveling in dark conditions; and

generate an audible alarm with an audio output device in the vehicle to alert the driver to the state of drowsiness.