ANNOTATIONS IN SOFTWARE APPLICATIONS FOR INVOKING DIALOG SYSTEM FUNCTIONS

• US 20160259767A1
• Filed: 03/08/2016
• Published: 09/08/2016
• Est. Priority Date: 03/08/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Speaktoit, Inc. (Alphabet Inc.)
• Inventors: Gelfenbeyn, Ilya Gennadyevich, Goncharuk, Artem, Sirotin, Pavel Aleksandrovich
• Granted Patent: US 11,231,826 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G06F 8/20 Software design
• CPC Class Codes: G06F 8/31 Programming languages or programming paradigms

Abstract

A method for expanding software application functionalities processing is disclosed herein. The method comprises receiving a user request within a software application. The software application is enhanced with annotations, which include metadata. The method continues with loading the metadata from the annotations to a dialog system located on a remote device, sending at least a part of the user request to the dialog system, and receiving a dialog system response to the user request from the dialog system. At least one of the annotations associated with the dialog system response is identified. A code associated with the identified annotation is invoked within the software application.

Claims

1. A system for expanding software application functionalities, the system comprising:

at least one processor operable to;

receive a user request within a software application, the software application being enhanced with annotations, wherein the annotations include metadata;

send at least a part of the user request to a dialog system located on a remote device;

receive a dialog system response to the user request from the dialog system;

identify at least one of the annotations associated with the dialog system response to obtain an identified annotation; and

invoke a code within the software application, wherein the code is associated with the identified annotation; and

a database in communication with the at least one processor comprising computer-readable instructions for execution by the processor.

2. The system of claim 1, wherein the at least one processor is further operable to load the metadata from the annotations to the dialog system.

3. The system of claim 1, wherein the software application is associated with a user device.

4. The system of claim 3, wherein the code includes an instruction for one or more of the following:

a further software application associated with the user device, a server, a hosting service, a web service, a web site, and a cloud service.

5. The system of claim 1, wherein the dialog system response includes one or more of a displayable message, an audio message, an incentive for a user to provide a further user request, or an instruction for the software application to perform a predetermined function.

6. The system of claim 1, wherein the annotations include one or more of the following:

pre-built annotations, annotations uploaded from a remote resource, and annotations synchronized with an online resource.

7. The system of claim 1, wherein the dialog system response includes a callback Uniform Resource Locator to be accessed by the software application to obtain a text of the dialog system response or the at least one of the annotations associated with the dialog system response.

8. The system of claim 1, wherein the enhancing of the software application with annotations includes integrating the annotations into a code associated with the software application.

9. A method for expanding software application functionalities, the method being performed by at least one processor and a memory, the method comprising:

receiving a user request within a software application, the software application being enhanced with annotations, wherein the annotations include metadata;

sending at least a part of the user request to a dialog system located on a remote device;

receiving a dialog system response to the user request from the dialog system;

identifying at least one of the annotations associated with the dialog system response to obtain an identified annotation; and

invoking a code within the software application, wherein the code is associated with the identified annotation.

10. The method of claim 9, further comprising loading the metadata from the annotations to the dialog system.

11. The method of claim 9, wherein the software application is associated with a user device.

12. The method of claim 11, wherein the code includes an instruction for one or more of the following:

a further software application associated with the user device, a server, a hosting service, a web service, a web site, and a cloud service.

13. The method of claim 9, wherein the dialog system response includes one or more of a displayable message, an audio message, an incentive for a user to provide a further user request, or an instruction for the software application to perform a predetermined function.

14. The method of claim 9, wherein the annotations include one or more of the following:

pre-built annotations, annotations uploaded from a remote resource, and annotations synchronized with an online resource.

15. The method of claim 9, wherein the metadata are associated with variables and parameters to be involved by the dialog system in processing of the user request.

16. The method of claim 9, wherein the dialog system response includes a callback Uniform Resource Locator to be accessed by the software application to obtain a text of the dialog system response or the at least one of the annotations associated with the dialog system response.

17. The method of claim 9, wherein the enhancing of the software application with annotations includes integrating the annotations into a code associated with the software application.

18. The method of claim 9, wherein the annotations define at least a type of the user request, the user request being processed by the dialog system based at least on the type of the user request.

19. The method of claim 9, wherein the annotations define runtime information and user specific information, wherein the runtime information and the user specific information are propagated to the dialog system.

20. A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to implement a method, comprising:

receiving a user request within a software application, the software application being enhanced with annotations, wherein the annotations include metadata;

sending at least a part of the user request to a dialog system located on a remote device;

receiving a dialog system response to the user request from the dialog system;

identifying at least one of the annotations associated with the dialog system response to obtain an identified annotation; and

invoking a code within the software application, wherein the code is associated with the identified annotation.