System and method for controlling expression characteristics of a virtual agent

• US 20020008716A1
• Filed: 12/13/2000
• Published: 01/24/2002
• Est. Priority Date: 07/21/2000
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Colburn, Robert A., Drucker, Steven M., Cohen, Michael F.
• Application Number:
  US09/737,530
• Publication Number:
  US 20020008716A1
• Time in Patent Office: Days
• US Class Current: 345/706
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 2213/12 Rule based animation

Abstract

A method is presented comprising rendering a virtual character to interface with at least a user, and controlling one or more anatomical attributes of the virtual character based, at least in part, on a scientifically-based model of physically expressive behavior for that anatomical attribute.

Claims

1. A method comprising:

rendering a character to interface with at least a user; and

controlling an anatomical feature of the character based, at least in part, on a scientifically-based model of physically expressive behavior for the anatomical feature in response to interaction with the user.

2. A method according to claim 1, wherein the character engages or is engaged by the at least one user in a conversation.

3. A method according to claim 1, wherein control of the anatomical feature of the character is based, at least in part, on eye gaze input of the at least one user.

4. A method according to claim 1, wherein the anatomical feature is an eye gaze.

5. A method according to claim 4, wherein controlling an anatomical feature comprises:

identifying a speaker in a conversation;

directing the eye gaze of the character to the identified speaker during select times of the conversation in accordance with the scientifically-based model of physically expressive behavior;

6. A method according to claim 5, further comprising:

directing the eye gaze of the character away from the identified speaker during select times of the conversation in accordance with the scientifically-based model of physically expressive behavior.

7. A method according to claim 5, wherein the identified speaker is the character, the method further comprising:

directing the eye gaze of the character to another during select times of the conversation, in accordance with the scientifically-based model of physically expressive behavior.

8. A method according to claim 7, wherein another is one or more of another virtual character, a local user of an application which rendered the character, a remote user of an application which rendered the character, and the like.

9. A method according to claim 8, wherein the application is one or more of a financial institution kiosk, a gaming application, a video conferencing application, a virtual newscaster, a virtual travel agent, and/or a virtual teacher in an educational application.

10. A method according to claim 8, wherein the virtual character or the another virtual character represent a proxy for associated user(s).

11. A method according to claim 5, wherein select times of the conversation are dynamically determined based, at least in part, on a number of conversation participants, which participant is speaking, how long the participant has been speaking, how long it has been since the eye gaze of the character was directed at another, and the like.

12. A method according to claim 1, wherein control of the one or more anatomical features is based, at least in part, on one or more of a number of conversation participants, which participant is speaking, how long the participant has been speaking, time elapsed in a current eye gaze state, and the like.

13. A storage medium comprising a plurality of executable instructions that, when executed, implement a method according to claim 1.

14. A computing system comprising:

a storage medium having stored therein a plurality of instructions; and

an execution unit, communicatively coupled to the storage medium, to execute at least a subset of the instructions stored therein to implement a method according to claim 1.

15. A computing system comprising:

a user input/output system including a display device to render a virtual character; and

a modeling agent, coupled to the user I/O system, to control one or more anatomical features of a rendered virtual character based, at least in part, on a scientifically-based model of physically expressive behavior of the anatomical feature, and in response to user interaction with the rendered character.

16. A computing system according to claim 15, wherein the user interaction with the rendered character is in speech form.

17. A computing system according to claim 15, wherein the rendered character engages, or is engaged by, a user of the computing system in conversation.

18. A computing system according to claim 17, wherein the user utilizes the rendered character as a virtual proxy in communication with another.

19. A computing system according to claim 15, wherein the modeling agent identifies a speaker in a conversation and, at select times, directs an eye gaze of the rendered character to that of the speaker, in accordance with the scientifically-based model of physically expressive behavior.

20. A computing system according to claim 15, wherein the modeling agent identifies other conversation participants and, at select times, directs an eye gaze of the rendered character to that of the other conversation participants, in accordance with the scientifically based model of physically expressive behavior.

21. A computing system according to claim 15, wherein the input/output system further comprises:

a video camera, in communication with the modeling agent, to provide the modeling agent with eye gaze information of the user.

22. A computing system according to claim 21, wherein the modeling agent receives eye gaze information about other conversation participants from remote computing systems.

23. A computing system according to claim 22, wherein the computing systems are participating in a video conferencing session, wherein the rendered character is a proxy for the user(s).