Behavioral adaptation engine for discerning behavioral characteristics of callers interacting with an VXML-compliant voice application

• US 7,242,752 B2
• Filed: 07/02/2003
• Issued: 07/10/2007
• Est. Priority Date: 07/03/2001
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: Apptera Incorporated
• Inventors: Chiu, Leo
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US10/613,857
• Publication Number:
  US 20040006476A1
• Time in Patent Office: 1,469 Days
• Field of Search: 379/88.07, 379/88.17, 379/88.21, 379/88.04, 704/275
• US Class Current: 379/88.04
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/226 using non-speech characteristics
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 2203/355 Interactive dialogue design tools, features or methods
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

A behavioral adaptation engine integrated with a voice application creation and deployment system has at least one data input port for receiving XML-based client interaction data including audio files attached to the data; at least one data port for sending data to and receiving data from external data systems and modules; a logic processing component including an XML reader, voice player, and analyzer for processing received data; and a decision logic component for processing result data against one or more constraints. The engine intercepts client data including dialog from client interaction with a served voice application in real time and processes the received data for behavioral patterns and if attached, voice characteristics of the audio files whereupon the engine according to the results and one or more valid constraints identifies one or a set of possible enterprise responses for return to the client during interaction.

Claims

1. A voice application system comprising:

a voice application server for serving voice applications to clients over a data network;

at least one voice portal node having access to the data network, the portal node for facilitation of client interaction with the voice applications; and

a behavioral adaptation engine executable from the application server;

characterized in that the behavioral adaptation engine monitors client responses during voice interaction, analyzes the responses for both conduct patterns and mood states, including caller stress, and determines which of a set of optional dialog responses is to be played to the client as a result of the analysis of the client'"'"'s response.

2. The system of claim 1 wherein the data network is the Internet network.

3. The system of claim 1 wherein the data network is a combination of the Internet and telephony network.

4. The system of claim 1 wherein the behavioral adaptation engine is part of the application logic of the voice application server.

5. The system of claim 1 wherein the at least one voice portal is an interactive voice response system combined with a telephony server.

6. The system of claim 1 wherein the at least one voice portal is a computerized node connected to a data network having access to the Internet.

7. The system of claim 1 wherein the behavioral adaptation engine analyzes audio files recorded at the at least one voice portal and sent to the application server as digital audio files attached to client responses.

8. The system of claim 1 wherein the behavioral adaptation engine executes upon receipt of a trigger event.

9. The system of claim 1 wherein the constraints are related to one or a combination of menu navigation behavior or perceived mood state of the client.

10. The system of claim 1 wherein the dialog responses and linked options are stored in a data store and are accessible to the behavioral adaptation engine.

11. The system of claim 1 wherein the received client information includes one or a combination of line identification, number identification, client history data, voice imprint results, and recorded voice samples.

12. The system of claim 1 wherein voice sampling is used to discern mood.

13. The system of claim 1 wherein received client information is used in conjunction with voice analysis to determine a response.

14. The system of claim 1 wherein the behavioral adaptation engine detects voice inflection variances and volume characteristics of sampled audio to facilitate mood discernment of a client.

15. The system of claim 14 wherein the variances and volume characteristics of an interaction are collected over multiple interactions with a same application to develop statistics used in gauging enterprise response probability values.

16. A behavioral adaptation engine comprising:

at least one data input port for receiving XML-based client interaction data including audio files attached to the data;

at least one bi-directional data port for sending data to and receiving data from external data systems and modules;

a logic processing component including an XML reader and voice player and analyzer for processing received data; and

a decision logic component for processing result data against one or more constraints;

characterized in that the behavioral adaptation engine intercepts client data including dialog from client interaction with a served voice application in real time and processes the received data to determine both conduct patterns and mood states and selects one or a set of possible enterprise responses for return to the client during interaction according to any pattern or mood state determined.

17. The engine of claim 16 wherein the engine is hosted in a voice application server.

18. The engine of claim 17 wherein the server is hosted on the Internet network.

19. The engine of claim 16 wherein the voice application and deployment system includes at least one voice portal for facilitation of client access to voice applications.

20. The engine of claim 16 wherein the engine is executed to function upon receipt of a trigger event.

21. The engine of claim 16 wherein the selection is related to a combination of menu navigation behavior or determined mood state of the client.

22. The engine of claim 16 wherein data from external data resources is used as additional input data for decision processing.

23. The engine of claim 16 wherein the received client data includes one or a combination of line identification, number identification, client history data, and voice imprint results.

24. The engine of claim 17 wherein voice sampling is used to discern mood state.

25. The engine of claim 16 wherein the voice analyzer detects voice inflection variances and volume characteristics of sampled audio to facilitate mood discernment of a client.

26. The engine of claim 25 wherein the variances and volume characteristics of an interaction are collected over multiple interactions with a same application to develop statistics used in gauging enterprise response probability values.