Virtual human interface for conducting surveys

• US 7,253,817 B1
• Filed: 08/20/2004
• Issued: 08/07/2007
• Est. Priority Date: 12/29/1999
• Status: Expired due to Fees

• Current Assignee: Avaya Incorporated
• Original Assignee: Virtual Personalities, Inc.
• Inventors: McBride, Aaron J., Romero, Jeremy Shay, Mauldin, Michael L., Plantec, Peter M.
• Primary Examiner(s): Tung; Kee M.
• Assistant Examiner(s): HAJNIK, DANIEL F
• Application Number:
  US10/922,729
• Time in Patent Office: 1,082 Days
• Field of Search: None
• US Class Current: 345/473
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0203 Market surveys; Market polls
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: Y10S 345/956 Language driven animation

Abstract

A virtual human interface for conducting survey questioning comprises a system and method which may include a script file which may include survey question data, response pattern data, expression data, advertising data, entertainment data, lobbying data and/or processing instructions. The expression data may include mouth and eye expression data along with respective duration data indicative of the length of time of respective visual representations. The virtual human interface may interact With a user by representing a character object that personifies communicative behavior to make interaction more natural and enjoyable.

Claims

1. A system for questioning, said system comprising:

at least one survey script in a computer readable storage, said survey script comprising first question data, first expression data, and response processing instructions, said first expression data including first mouth expression data and first mouth duration data, said first mouth expression data indicative of a visual appearance of a mouth exhibiting communicative characteristics indicative of at least one portion of one possible response by a user and also indicative of predetermined responsive steps to be performed;

a script server configured to store said at least one survey script; and

a virtual human interface configured to operate in at least a question state and a sleep state,

said virtual human interface configured, while in said sleep state, to actively represent on a display at least a representation of a mouth exhibiting communicative characteristics and to actively and periodically request a user to engage in answering at least a question, said virtual human interface further configured to switch to said question state upon receiving an affirmative response,

said virtual human interface configured, while in said question state, to retrieve said at least one survey script from said script server and to process said first question data to present a first question to a user, said virtual human interface configured to process said first expression data to represent on said display said mouth in accordance with said first mouth expression data for a duration in accordance with said first mouth expression duration data, said virtual human interface configured to process said response processing instructions to identify said at least one portion of one possible response by said user to said first question and to associate said predetermined responsive steps with said response, said virtual human interface configured to process input provided by said user to detect said portion of said one possible response and to perform said predetermined responsive steps, said predetermined responsive steps including storing answer data representing said input provided by said user.

2. The system as described in claim 1, wherein said survey script further comprises second question data and second expression data, said second expression data including second mouth expression data and second mouth expression duration data, said second mouth expression data indicative of a second visual appearance of said mouth of said character, wherein said virtual human interface is configured to process said second question data to present a second question to said user, and wherein said virtual human interface is configured to process said second expression data to represent on said display said mouth of said character in accordance with said second mouth expression data for a duration in accordance with said second mouth expression duration data.

3. The system as described in claim 2, wherein said virtual human interface is configured to represent on said display said mouth of said character in accordance with said second mouth expression data at a time during said presenting of said second question to said user.

4. The system as described in claim 1, wherein said expression data includes eye expression data and eye expression duration data, and wherein said virtual human interface is configured to process said expression data to represent an eye of said character in accordance with said eye expression data for a duration in accordance with said eye expression duration data.

5. The system as described in claim 1, wherein said virtual human interface comprises software instructions stored on a computer readable storage.

6. A survey system comprising:

a first script comprising question data representing a question, topic data representing a topic, and load data identifying a second script, said second script including information about said topic, said first script stored in a computer readable medium;

character image data representing a character, said character image data stored in said computer readable medium, said character representing a visual object that personifies communicative behavior of a human being; and

a computer-based user interface configured to, operate in at least a question state and a sleep state, said user interface configured, while in said sleep state, to actively represent on a display at least a representation of a mouth exhibiting communicative characteristics and to actively and periodically request a user to engage in answering at least a question, said user interface further configured to switch to said question state upon receiving an affirmative response, said user interface configured, while in said question state, to access said first script and to process said question data to communicate said question to said user, said user interface configured to process said character image data to create a representation of said character on said display during said communication of said question, said user interface configured to receive and process response data representing a response provided by said user, said user interface configured to determine whether said response identifies said topic, and, if so, said user interface loads said second script and communicates said information about said topic to said user and modifies said representation of said character to create a visual indication that said character is communicating said information about said topic.

7. The survey system as described in claim 6, said script further comprising:

expression data representing an expression of said character, said user interface configured to process said expression data to cause said character to show said expression on said display.

8. The survey system as described in claim 6, said script further comprising:

response pattern data representing a portion of a possible user response to said question data; and

advertising data representing advertising information to inform said user about goods or services, said user interface configured to compare said response data to said response pattern data to determine whether said response provided by said user includes said predetermined portion of a possible response and, if so, to process said advertising data to communicate said advertising information to said user.

9. The survey system as described in claim 6, said script further comprising:

response pattern data representing a portion of a possible user response to said question; and

entertainment data representing an offer of an incentive or reward to said user for answering said question, said user interface configured to compare said response data to said response pattern data to determine whether said response provided by said user includes said predetermined portion of a possible response and, if so, to process said entertainment data to communicate or present said offer to said user.

10. The survey system as described in claim 6, said script further comprising:

first response pattern data representing a portion of a first possible user response to said question;

second response pattern data representing a portion of a second possible user response to said question; and

predetermined answer data, said user interface configured to compare said response data to said first response pattern data and to compare said response data to said second response pattern data, and, if either comparison results in a match, to store said predetermined answer data in said computer readable medium without storing said response data.

11. The survey system as described in claim 10, said script further comprising:

third response pattern data representing a portion of a third possible user response to said question; and

second predetermined answer data, said user interface configured to compare said response data to said third response pattern data and, if that comparison results in a match, to store said second predetermined answer data in said computer readable medium without storing said response data.

12. The survey system as described in claim 6, wherein said user interface is configured to communicate said question by generating audio output which represents said question.

13. The survey system as described in claim 6, wherein said user interface is configured to communicate said question by displaying text characters.

14. The survey system as described in claim 6, said system further comprising:

a voice recognition module creating said response data from a spoken response provided by said user.

15. The survey system as described in claim 6, further comprising:

an answer format value representing a predetermined format for storing data.

16. A method for survey questioning, said method comprising the steps of:

providing in a script file first question data representing a question, first expression data and response processing instructions, said first expression data including first mouth expression data and first mouth expression duration data, said first mouth expression data indicative of a visual appearance of a mouth of a character;

providing in a computer readable medium initial mouth expression data indicative of an initial visual appearance of said mouth of said character, said initial visual appearance of said mouth indicative of oral communication;

providing in a computer readable medium survey request data representing a request that a user take a survey;

monitoring from a sleep state input provided by a user;

accessing, while in said sleep state, said initial mouth expression data to actively represent on a display said mouth of said character in accordance with said initial visual appearance;

accessing, while in said sleep state, said survey request data to actively and periodically request that a user take a survey;

entering a survey state upon detecting input provided by said user;

processing said first question data to present a first question to a user;

representing said character on a display during said presenting of said first question;

representing said mouth of said character in accordance with said first mouth expression data for a duration in accordance with said first mouth expression duration data;

processing said response processing instructions to identify at least one portion of one possible response by said user to said first question and to associate predetermined responsive steps with said response;

processing input provided by said user, and if said input includes said portion of said one possible response, then performing said predetermined responsive steps, including storing answer data representing said input.

17. The method as described in claim 16, said method comprising the further steps of:

providing in said script file second question data and second expression data, said second expression data including second mouth expression data and second mouth expression duration data, said second mouth expression data indicative of a second visual appearance of said mouth of said character;

processing said second question data to present a second question to said user; and

processing said second expression data to represent said mouth of said character in accordance with said second mouth expression data for a duration in accordance with said second mouth expression duration data.

18. The method as described in claim 17, said method comprising the further steps of:

representing said mouth of said character in accordance with said second mouth expression data at a time during said presenting of said second question to said user.

19. The method as described in claim 16, said method comprising the further steps of:

providing in said script file eye expression data and eye expression duration data, said eye expression data indicative of a visual appearance of said eye; and

processing said eye expression data to represent an eye of said character in accordance with said eye expression data for a duration in accordance with said eye expression duration data.

20. A method for survey questioning, said method comprising the steps of:

monitoring from a sleep state a status of input concerning a user;

actively representing on a display, while in said sleep state, a mouth of a character indicative of oral communication;

actively and periodically requesting, while in said sleep state, that said user take a survey;

entering a survey state upon a determined change in the status of said input;

receiving survey question data representing a survey question;

receiving first expression data, said first expression data indicative of a first facial expression of a character object that personifies communicative behavior;

processing said question data to communicate said question to a user;

processing said first expression data to visually represent said character object in accordance with said first facial expression;

receiving an answer from said user that does not match at least one predetermined answer and responsively processing clarification data to communicate to said user a request to provide a different answer;

receiving second expression data, said second expression data indicative of a second facial expression of said character object; and

processing said second expression data to represent said character object in accordance with said second facial expression at a time after said receipt of said answer;

checking for additional survey question data and, while additional survey question data is found, repeating each receiving, processing, and checking step; and

returning to said sleep state upon finding no additional survey question data.

21. The method as described in claim 20, wherein said first expression data includes first mouth expression data and first mouth expression duration data, wherein said first facial expression includes a representation of a mouth of said character object in accordance with said first mouth expression data, wherein said character object is visually represented in accordance with said first facial expression for a duration at least as long as a duration represented by said first mouth expression duration data, wherein said second expression data includes second mouth expression data and second mouth expression duration data, wherein said second facial expression includes a representation of said mouth of said character object in accordance with said second mouth expression data, wherein said character object is visually represented in accordance with said second facial expression for a duration at least as long as a duration represented by said second mouth expression duration data.

22. The method as described in claim 20, wherein said first expression data includes first eye expression data and first eye expression duration data, wherein said first facial expression includes a representation of an eye of said character object in accordance with said first eye expression data, wherein said character object is visually represented in accordance with said first facial expression for a duration at least as long as a duration represented by said first eye expression duration data, wherein said second expression data includes second eye expression data and second eye expression duration data, wherein said second facial expression includes a representation of said eye of said character object in accordance with said second eye expression data, wherein said character object is visually represented in accordance with said second facial expression for a duration at least as long as a duration represented by said second eye expression duration data.

23. The method as described in claim 20, wherein the steps described therein are represented by software instructions stored in a computer readable medium.

24. A system for interacting with a computer user, comprising:

a script comprising communication data representing at least one communication designed to illicit a response, the script also comprising response data representing at least two response patterns, the script stored in a computer readable medium; and

a script processor capable of processing the script to output a representation of the at least one communication and also capable of processing a response to determine whether it matches either of the at least two response patterns;

a computer-based user interface configured to reside on a user'"'"'s computer in at least a sleep state and an active state, the user interface configured to actively and periodically issue a request for the user to communicate while in the sleep state and to switch to the active state upon receiving input from the user indicating a willingness to communicate, wherein the user interface is configured to engage the script processor when switching to the active state and the script processor processes the script and outputs a representation of the communication, the user interface further configured to receive a response to the communication provided by the user and to provide a representation of the response to the script processor which determines whether the response matches one of the at least two response patterns, and if so an action is performed based on the matching.

25. The system of claim 24, wherein the action is causing the script processor to process another portion of the script.

26. The system of claim 24, wherein the action includes changing the representation of the character according to the character image data.

27. The system of claim 24, wherein the action includes the loading of a second script.

28. The system of claim 24, wherein the response provided by the user is audible, the system further comprising:

a voice recognition module, the voice recognition module configured to work with the script processor to translate an audible user response into a representation of the user response for use by the script processor to determine whether the user response matches either of the at least two response patterns.

29. The system of claim 24 further comprising:

a voice output module configured to work with the script processor to process communication data to generate an audible representation of the communication.

30. The system of claim 29 wherein the audible representation comprises a pre-recorded human voice.

31. The system of claim 29 wherein the audible representation comprises a computer-generated voice.

32. The system of claim 28 further comprising:

a voice output module configured to work with the script processor to translate the communication data into an audible representation of the communication, such that an audible conversation is carried on.

33. The system of claim 24, wherein the user interface determines if the script has been processed by the script processor at a previous time and, if so, facilitates the processing of a second script by the script processor.

34. The system of claim 24, wherein the user interface is configured to issue the non-persistent request at random intervals.

35. The system of claim 24, further comprising:

lobbying data representing lobbying information to persuade the user to respond;

wherein the user interface, while in the sleep state, uses the lobbying data to encourage the user to indicate the willingness to communicate.

36. The system of claim 24, further comprising:

lobbying data representing lobbying information to persuade the user to respond;

wherein the user interface, while in the active state, uses the lobbying data to encourage the user to provide a response that matches one of the at least two response patterns.

37. A method for interacting with a user, the steps of the method comprising:

displaying a virtual character on a display screen of a computer, the virtual character comprising a visual object that exhibits communicative behavior, the virtual character having at least a sleep state and an active state;

actively and repeatedly issuing, while the virtual character is in sleep state, a non-persistent prompt for the user to interact with the virtual character;

monitoring for a user signal that indicates a willingness to interact with the virtual character;

responding to the user signal by;

switching the virtual character to the active state;

accessing a script containing communication data representing at least one communication and also containing response pattern data representing a plurality of response patterns associated with the at least one communication, the script stored in a computer readable medium;

processing the script to communicate the communication to the user;

accessing character image data indicative of visual characteristics of the virtual character;

processing the character image data to alter the visual appearance of the virtual character;

receiving response data representing the user'"'"'s response to the communication; and

processing the response data to determine whether it matches one of the plurality of response patterns, and if so, performing an action associated with the communication.

38. The method of claim 37, wherein the communication is a survey question.

39. The method of claim 38, further comprising the step of:

using, while the virtual character is in the sleep state, lobbying data to persuade the user to provide the user signal.

40. The method of claim 37, further comprising the step of:

using, while the virtual character is in the active state, lobbying data to persuade the user to alter the response to the communication.

41. The method of claim 40, wherein the step of using lobbying data to persuade the user to alter the response to the communication is repeated until the user provides a response that is determined to match one of the plurality of response patterns.

42. The method of claim 37, further comprising the steps of:

determining whether the script has previously been accessed and, if so, accessing a different script containing second communication data representing a second communication and also containing second response pattern data representing a plurality of response patterns associated with the second communication.

43. The method of claim 37, wherein the non-persistent prompts are repeated at random time intervals.

44. The method of claim 37, wherein the action performed includes accessing a second script.

45. The method of claim 37, wherein communicating the communication includes generating an audible representation of the communication.

46. The method of claim 37, wherein the user'"'"'s response to the communication is an audible response and the response data is generated by processing the audible response.

47. The method of claim 37, further comprising the step of:

returning the virtual character to the sleep state.