Multi-access mode electronic personal assistant

• US 20040230689A1
• Filed: 06/24/2004
• Published: 11/18/2004
• Est. Priority Date: 02/11/2000
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Loveland, Shawn D.
• Application Number:
  US10/875,914
• Publication Number:
  US 20040230689A1
• Time in Patent Office: Days
• US Class Current: 709/229
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: H04L 65/1026 at the edge
• CPC Class Codes: H04L 65/1036 at the edge
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 69/08 Protocols for interworking; Protocol conversion
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A system is disclosed for enabling communication between server resources and a wide spectrum of end-terminals to enable users access to the resources of both converged and non-converged networks via voice and/or electronically generated commands. An electronic personal assistant (ePA) incorporates generalizing/abstracting communications channels, data and resources provided through a converged computer/telephony system interface such that the data and resources are readily accessed by a variety of interface formats including a voice interface or data interface. A set of applications provide dual interfaces for rendering services and data based upon the manner in which a user accesses the data. An electronic personal assistant in accordance with an embodiment of the invention provides voice/data access to web pages, email, file shares, etc.

The electronic personal assistant enables a user to transmit voice commands to a voice-based resource server to provide information accessible to the resource server. In accordance with an aspect of an embodiment of the invention, a user is authenticated by receiving vocal responses by a user to one or more requests variably selected and issued by a speaker recognition-based authentication facility. Thereafter, an application proxy is created. The application proxy acts on behalf of the authenticated authorized user.

In accordance with particular aspects of the specific embodiments of the invention, a set of remotely accessed voice applications are provided. One such application comprises a personal interactive multimedia response (IMR). Each user configures a personal IMR system. In a converged network environment, the user is provided access to the IMR through a personal computer interface, web interface, instant message, e-mail, as well as a voice user interface over a telephone connection.

A configurable distributed conference bridge is another potential application incorporated within the converged network architecture model of the present invention. The distributed conference bridge enables local conference resources to be utilized and incorporates external service bureau conference bridge resources when needed to supplement the internal conference bridge resources of a system.

Claims

1-13. -13. (Canceled)

14. A method for providing access to networked computer resources through a set of different end devices utilizing differing user interfaces, the method comprising the steps of:

providing a terminal abstraction configured to enable communication with a plurality of applications, the terminal abstraction including;

an external input interface for receiving a first message in an end device communication format;

a protocol converter coupled to the external input interface, for receiving the first message and transforming the first message into a second message in an end device independent format, the end device independent format recognized by a first application to which the second message is sent, the transforming of the first message into the end device independent format enabling communication between the first application and the set of differing end devices utilizing differing user interfaces, the protocol converter responsive to a rules engine configured to determine a method of communication; and

an application functional resource interface coupled to the protocol converter, for enabling transmitting the second message in end device independent format to functional resources of the first application; and

providing an extensible set of application programs, including at least the first application, the extensible set of application programs providing access to the networked computer resources.

38. The method of claim 14, wherein the terminal abstraction further includes:

a graphical user interface terminal abstraction component configured to, at least, transform a message from an end device supporting a graphical user interface into the second message in the end device independent format; and

a voice user interface terminal abstraction component configured to, at least, transform a message from an end device supporting a voice user interface into the second message in the end device independent format.

15. A computer-readable media including computer-executable instructions for performing a set of steps for providing access to networked computer resources through a set of different end devices utilizing differing user interfaces, the steps including:

providing a terminal abstraction configured to enable communication with a plurality of applications, the terminal abstraction including;

an external input interface for receiving a first message in an end device communication format;

a protocol converter coupled to the external input interface, for receiving the first message and transforming the first message into a second message in an end device independent format, the end device independent format recognized by a first application to which the second message is sent, the transforming of the first message into the end device independent format enabling communication between the first application and the set of differing end devices utilizing differing message formats, the protocol converter responsive to a rules engine configured to determine a method of communication; and

an application functional resource interface coupled to the protocol converter, for enabling transmitting the second message in end device independent format to functional resources of the first application; and

providing an extensible set of application programs, including at least the first application, the extensible set of application programs providing access to the networked computer resources.

39. The computer-readable media of claim 15, wherein the terminal abstraction further includes:

a graphical user interface terminal abstraction component configured to, at least, transform a message from an end device supporting a graphical user interface into the second message in the end device independent format; and

a voice user interface terminal abstraction component configured to, at least, transform a message from an end device supporting a voice user interface into the second message in the end device independent format.

16. A personal interactive multimedia response (IMR) system including:

an end-terminal-to-application interface providing access to functional components of an interactive multimedia response application by a plurality of end-devices having user interfaces of multiple types, including graphical and voice user interfaces, the end-terminal-to-application interface comprising a terminal abstraction configured to, at least, transform communications from each of the plurality of end-devices into messages having an end-device-independent format;

a set of individually configurable rules defining actions of the personal interactive multimedia response system for responding to calls to a specified recipient; and

a rules engine having access to the set of individually configurable rules and formulating a response to a call according to the set of individually configurable rules and present values for a set of status variables, including at least one status variable corresponding to the mode of access used by the end-device, the rules engine configured to determine a method of communication.

17. The personal interactive multimedia response system of claim 16 wherein the terminal abstraction is interposed between functional resources of the personal IMR system and the plurality of end-devices in order to provide the functional resources in a manner tailored to individual ones of a variety of user interfaces, including graphical and voice user interfaces, the terminal abstraction further comprising:

a graphical user interface terminal abstraction component interposed between the functional resources and a first end-device supporting a graphical user interface, the graphical user interface terminal abstraction component transforming messages from the first end-device to a generic format expected by the functional resources, the graphical user interface terminal abstraction component further transforming messages from the functional resources to a first end-device format expected by the first end-device; and

a voice user interface terminal abstraction component interposed between the functional resources and a second end-device supporting a voice user interface, the voice user interface terminal abstraction component transforming messages from the second end-device to a generic format expected by the functional resources, the voice user interface terminal abstraction component further transforming messages from the functional resources to a second end-device format expected by the second end-device.

18. The personal IMR system of claim 16 further comprising a registration component enabling designating a manner of interaction between a caller and the personal IMR system.

19. The personal IMR system of claim 16 wherein the set of status variables comprises the state of the user'"'"'s terminal.

20. The personal IMR system of claim 16 wherein the set of status variables comprises appointment calendar entries.

40. The computer-readable media of claim 16, wherein the terminal abstraction comprises:

a graphical user interface terminal abstraction component configured to, at least, transform communications from each of the plurality of end-devices that support a graphical user interface into messages having the end-device-independent format; and

a voice user interface terminal abstraction component configured to, at least, transform communications from each of the plurality of end-devices that support a voice user interface into messages having the end-device-independent format.

21. A method for providing a personal interactive multimedia response (IMR) system for end-users, the method comprising the steps of:

executing an end-terminal-to-application interface providing access to functional components of an interactive multimedia response application by a plurality of end-devices having user interfaces of multiple types, including graphical and voice user interfaces, the end-terminal-to-application interface comprising a terminal abstraction configured to, at least, transform communications from each of the plurality of end-devices into messages having an end-device-independent format;

maintaining a set of individually configurable rules defining actions of the personal interactive multimedia response system for responding to calls to a specified recipient; and

operating a rules engine having access to the set of individually configurable rules and formulating a response to a call according to the set of individually configurable rules and present values for a set of status variables, including at least one status variable corresponding to the mode of access used by the end-device, the rules engine configured to determine a method of communication.

22. The method of claim 21 further comprising the step of registering a caller, said registration step comprising determining the manner in which the caller has accessed the personal IMR system.

23. The method of claim 21 wherein the formulating a response includes providing a response tailored to the manner in which a caller has accessed the personal IMR system.

24. The method of claim 21 wherein the manner in which a caller has accessed the personal IMR system involves a computer terminal.

25. The method of claim 21 wherein the manner in which a caller has accessed the personal IMR system involves a telephone.

41. The computer-readable media of claim 21, wherein the terminal abstraction comprises:

a graphical user interface terminal abstraction component configured to, at least, transform communications from each of the plurality of end-devices that support a graphical user interface into messages having the end-device-independent format; and

a voice user interface terminal abstraction component configured to, at least, transform communications from each of the plurality of end-devices that support a voice user interface into messages having the end-device-independent format.

26. A computer-readable media including computer-executable instructions for performing a set of steps to provide a personal interactive multimedia response system for end-users, the steps including:

executing an end-terminal-to-application interface providing access to functional components of an interactive multimedia response application by a plurality of end-devices having user interfaces of multiple types, including graphical and voice user interfaces, the end-terminal-to-application interface comprising a terminal abstraction configured to, at least, transform communications from each of the plurality of end-devices into messages having an end-device-independent format;

maintaining a set of individually configurable rules defining actions of the personal interactive multimedia response system for responding to calls to a specified recipient; and

operating a rules engine having access to the set of individually configurable rules and formulating a response to a call according to the set of individually configurable rules and present values for a set of status variables, including at least one status variable corresponding to the mode of access used by the end-device, the rules engine configured to determine a method of communication based on the status variable.

42. The computer-readable media of claim 26, wherein the terminal abstraction comprises:

a graphical user interface terminal abstraction component configured to, at least, transform communications from each of the plurality of end-devices that support a graphical user interface into messages having the end-device-independent format; and

a voice user interface terminal abstraction component configured to, at least, transform communications from each of the plurality of end-devices that support a voice user interface into messages having the end-device-independent format.

27-37. -37. (Canceled)