System and method of enhanced computer user interaction

• US 20020154124A1
• Filed: 02/22/2001
• Published: 10/24/2002
• Est. Priority Date: 02/22/2001
• Status: Abandoned Application

• Current Assignee: Hanstep Co., Ltd.
• Original Assignee: Hanstep Co., Ltd.
• Inventors: Han, Sang-Yong
• Application Number:
  US09/791,126
• Publication Number:
  US 20020154124A1
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation

Abstract

A character agent resident on a user'"'"'s computer facilitates interaction with the computer. The character agent provides character animation, text balloons, menus, and speech input/output. The character agent may operate based on locally stored supporting files, and may significantly extend its flexibility with supporting files retrieved dynamically, such as during Internet browsing. In this latter context, the character agent greatly extends the opportunity for interaction between various Internet sites and the user. A character server, which may be the web server, downloads a Character Action Markup Language (CAML) document and supporting animation files. These files specify the animation and behavior of the character agent. A browser plug-in allows the character agent to respond to browser events according to the CAML document'"'"'s instructions. The character agent may automatically retrieve supporting files when provided with an active Internet connection, and may also be driven via a remote server using two-way scripting.

Claims

1. A method of conveying information to a user of a computer, the method comprising:

providing an agent program at said computer, said agent program operative to animate a character on a display of said computer based on a graphic file defining an appearance of said character and a behavior file specifying desired control of said character;

retrieving by said agent program said graphic file and said behavior file from a remote character server via an Internet connection between said computer and said remote character server, said remote character server providing dedicated storage for said graphic file and said behavior file;

generating by said agent program said character for display to the user based on graphic information in said graphic file and controlling said character based on instructions in said behavior file to effect said desired control of said character, thereby conveying said information to the user of said computer.

2. The method of claim 1 wherein said instructions in said behavior file define an animated presentation to convey said information to the user, and said graphic file comprises at least one animation sequence supporting said animated presentation, and further comprising, by said agent program, animating said character to effect said animated presentation based on said instructions in said behavior file and said at least one animation sequence in said graphic file.

3. The method of claim 2 further comprising:

retrieving by said agent program audio information associated with said animated presentation from said remote character server; and

controlling by said agent program the playback of said audio information in conjunction with performing said animated presentation.

4. The method of claim 2 further comprising:

retrieving by said agent program informational text associated with said animated presentation from said remote character server; and

controlling by said agent program the display of said informational text in conjunction with performing said animated presentation.

5. The method of claim 2 further comprising:

retrieving by said agent program informational text associated with said animated presentation from said remote character server; and

controlling by said agent program the generation of speech output at said computer in conjunction with performing said animated presentation based on said informational text.

6. The method of claim 2 further comprising:

retrieving by said agent program streaming content associated with said animated presentation from a web server associated with said remote character server; and

controlling by said agent program the display of a video component of said streaming content to a screen viewer provided by said agent program.

7. The method of claim 1 further comprising:

retrieving by said agent program from said remote character server menu information associated with said behavior file;

displaying a menu in conjunction with said character on said display of said computer based on said menu information, said menu information defining at least one menu selection;

monitoring for a selection action by the user directed at said menu; and

by said agent program, responding to said selection action based on control instructions in said behavior file corresponding to a selected one of said at least one menu items of said menu.

8. The method of claim 1 wherein said agent program comprises a number of functional modules including a character interface module to control said character, and at least one of a set of additional functional modules, said set of additional functional modules comprising a speech recognition module, a text-to-speech module, a streaming content viewer module, a sound effects module, a menu module, and a text balloon module.

9. The method of claim 1 further comprising:

providing a browser-associated program to receive selected information from a web browser program active on said computer;

recognizing via said browser-associated program when the browser program receives web page information from a web site indicating support for said agent program;

notifying said agent program via said browser-associated program that a current web page has at least one associated behavior file and graphic file;

retrieving by said agent program said at least one associated behavior file and graphic file from a dedicated character server associated with said web site in response to receiving notice from said browser-associated program; and

performing by said agent program an initial information presentation to the user via at least said character on said display based on said at least one associated behavior file and graphic file.

10. The method of claim 9 further comprising:

notifying via said browser-associated program said agent program of browser events related to said web site;

determining by said agent program if said behavior file defines a desired action corresponding to a given browser event; and

performing by said agent program said desired action, if said desired action is defined in said behavior file for the given event.

11. The method of claim 10 further comprising:

retrieving by said agent program at least one additional supporting file from said remote character server, said additional supporting files comprising at least one of a menu file, a viewer file, a text output file, a speech output file, and a sound effects file; and

providing additional informational output to the user of said computer as part of said desired action based on information in said at least one additional supporting file.

12. The method of claim 9 wherein notifying said agent program via said browser-associated program that a current web page has at least one associated behavior file and graphic file comprises providing an address of said remote character server to said agent program.

13. The method of claim 1 wherein said behavior file comprises a two-way script file, the method further comprising:

performing at least one desired action defined in the two-way script file;

monitoring for a user input to the computer system associated with said character;

determining a desired response to the user input based on information in the two-way script file;

retrieving additional supporting information from said remote character server if necessary to support said desired response; and

performing by said agent program said desired response based on information in the two-way script and any additional supporting information retrieved from said remote character server.

14. The method of claim 1 wherein retrieving by said agent program said graphic file and said behavior file from a remote character server via an Internet connection between said computer and said remote character server, said remote character server providing dedicated storage for said graphic file and said behavior file comprises retrieving a character action markup language (CAML) file as said behavior file.

15. The method of claim 1 wherein retrieving by said agent program said graphic file and said behavior file from a remote character server via an Internet connection between said computer and said remote character server, said remote character server providing dedicated storage for said graphic file and said behavior file comprises retrieving graphical information defining at least one desired animation sequence as said graphic file.

17. The method of claim 16 further comprising:

notifying said agent program via said browser-associated program of user events associated with the web page displayed by the web browser;

responding to notification of a given event by said agent program by determining whether said behavior file defines a desired action corresponding to said given event; and

performing said desired action by said agent program in response to said notification if said desired action is defined for said given event in said behavior file.

18. The method of claim 17 wherein performing said desired action by said agent program in response to said notification if said desired action is defined for said given event in said behavior file comprises performing a subsequent presentation specifically keyed to said given event.

19. The method of claim 17 further comprising:

retrieving at least one additional supporting file from said remote character server if necessary to support said desired action; and

using said at least one additional supporting file retrieved from said remote character server by said agent program to support performance of said desired action.

20. The method of claim 16 wherein providing a presentation under control of said agent program to the user of the computer system to convey said information based on generating a character as defined by a graphic file on a display of the computer system and controlling said character in accordance with instructions for said agent program contained in a behavior file comprises performing a desired animation sequence identified in said behavior file to animate said character.

21. The method of claim 16 further comprising generating audio information in conjunction with providing said performance.

22. The method of claim 21 further comprising retrieving via said agent program data bearing on said audio information from said remote character server.

23. The method of claim 16 further comprising generating at least one word balloon containing informational text in conjunction with providing said performance.

24. The method of claim 23 further comprising retrieving via said agent program data bearing on said informational text from said remote character server.

25. The method of claim 16 further comprising generating at least one word balloon containing informational text in conjunction with providing said performance.

26. The method of claim 25 further comprising retrieving via said agent program data bearing on said informational text from said remote character server.

27. The method of claim 16 further comprising outputting streaming media content in conjunction with providing said performance.

28. The method of claim 27 further comprising retrieving via said agent program data bearing on said streaming media content from said remote character server.

29. The method of claim 16 further comprising generating speech output conjunction with providing said performance.

30. The method of claim 29 further comprising retrieving via said agent program data bearing on said speech output from said remote character server.

31. The method of claim 16 further comprising generating at least one user menu in conjunction with providing said performance.

32. The method of claim 31 further comprising retrieving via said agent program data bearing on said user menu from said remote character server.

33. The method of claim 31 further comprising responding via said agent program to user input selections directed at said user menu based on instructions in said behavior file.

35. The computer readable media comprising software of claim 34 to further instruct the computer system to:

retrieve at least one additional supporting file from said remote character server, said at least one additional supporting file associated with said behavior file; and

output additional information to the user based on information in said at least one additional supporting file in association with controlling said character based on said behavior file;

wherein said at least one additional supporting file comprises at least one of a sound effects file, a text output file, a speech output file, a menu file, and a viewer file.

36. The computer readable media comprising software of claim 35 to further instruct said software to work with at least one supporting service available on the computer system to effect control of said character and output of said additional information.

37. The computer readable media comprising software of claim 36 wherein further instructing said software to work with at least one supporting service available on the computer system to effect control of said character and output of said additional information comprises instructions to effect control of said character using display services available via an operating system available on the computer system.

38. The computer readable media comprising software of claim 36 wherein further instructing said software to work with at least one supporting service available on the computer system to effect control of said character and output of said additional information comprises instructions to effect the output of audio information using audio services available via an operating system available on the computer system.

39. The computer readable media comprising software of claim 36 wherein further instructing said software to work with at least one supporting service available on the computer system to effect control of said character and output of said additional information comprises instructions to effect the output of electronic speech using audio services available via an operating system available on the computer system.

40. The computer readable media comprising software of claim 36 wherein further instructing said software to work with at least one supporting service available on the computer system to effect control of said character and output of said additional information comprises instructions to effect recognition of input speech by the user using speech recognition features available via an operating system available on the computer system.

41. The computer readable media comprising software of claim 34 to further instruct the computer system to:

generate a notification that a web page accessed by a browser program active on the computer system is associated with a specified behavior file and graphic file;

retrieve said specified behavior file and graphic file from a remote character server specified as part of said notification; and

control said character based on said specified behavior file and graphic file retrieved from said remote character server specified as part said notification.

42. The computer readable media comprising software of claim 41 to further instruct the computer system to:

generate event notices in response to user input events directed to the web page displayed by the browser program;

determine whether said specified behavior file defines a desired action for a given event notice; and

performing said desired action if defined by said specified behavior file.

43. The computer readable media comprising software of claim 42 to further instruct the computer system to retrieve any additional supporting files from said remote character server necessary to support performance of said desired action, said additional supporting files comprising at least one of an additional graphic file, a sound effects file, a text output file, a menu file, a speech output file, a viewer file.

44. The computer readable media comprising software of claim 34 wherein said software comprises at least one program module, said at least one module operative to instruct the computer system to display and control said character on the display of the computer system based on said graphic file in accordance with instructions in said behavior file.

45. The computer readable media comprising software of claim 44 wherein said software comprises at least one additional program module to instruct the computer system to display word balloons containing informational text in association with said character.

46. The computer readable media comprising software of claim 44 wherein said software comprises at least one additional program module to instruct the computer system to display user menus in association with said character.

47. The computer readable media comprising software of claim 46 wherein said at least one additional program module further instructs the computer system to respond to menu selection inputs by the user directed to said user menus based on instructions in said behavior file corresponding to said user menus.

48. The computer readable media comprising software of claim 44 wherein said software comprises at least one additional program module to instruct the computer system to output streaming content in association with said character.

49. The computer readable media comprising software of claim 44 wherein said software comprises at least one additional program module to instruct the computer system to output audible speech in association with said character.

50. The computer readable media comprising software of claim 44 wherein said software comprises at least one additional program module to instruct the computer system to recognize input speech from the user.

51. The computer readable media comprising software of claim 50 wherein said at least one additional module instructs the computer system to initiate a desired action in response to recognizing an input command received via said input speech, if said input command has a desired action defined in said behavior file.

52. The computer readable media comprising software of claim 34 wherein said software comprises a plurality of software modules, each said module directed to providing a specific type of functionality.

53. The computer readable media comprising software of claim 52 wherein said plurality of modules is organized as a plurality of dynamic link library (DLL) files.

16. A method of conveying information to a user of a computer system, the method comprising:

accessing a web page using a web browser running on the computer system, said web page containing notification that said web page is associated with a remote character server providing dedicated storage for supporting files associated with said information to be conveyed to the user;

notifying an agent program available on the computer system via a browser-associated program responsive to said notification in said web page;

retrieving by said agent program said supporting files from said character server in response to receiving said notification from said browser-associated program; and

providing a presentation under control of said agent program to the user of the computer system to convey said information based on generating a character as defined by a graphic file on a display of the computer system and controlling said character in accordance with instructions for said agent program contained in a behavior file;

said behavior file and said graphic retrieved from said remote character server by said agent program as part of said supporting files.

34. A computer readable media comprising software for instructing a computer system to:

determine if said computer system has an active connection with the Internet;

establish communications with a remote character server providing dedicated storage for a behavior file and a supporting graphic file;

retrieve said behavior file and said supporting graphic file from said remote character server;

display a character on a display of said computer system based on graphical information in said supporting graphic file; and

control said character to convey information to a user of said computer system based on said behavior file.