Systems and methods for generating user interface-based service workflows utilizing voice data

• US 10,339,481 B2
• Filed: 01/30/2017
• Issued: 07/02/2019
• Est. Priority Date: 01/29/2016
• Status: Active Grant

• Current Assignee: Liquid Analytics, Inc.
• Original Assignee: Liquid Analytics, Inc.
• Inventors: Canaran, Vishvas Trimbak, Ellis, David Andrew, Nguyen, Phuonglien Thi, Kallies, Andrea
• Primary Examiner(s): Jarrett, Scott L
• Application Number:
  US15/419,352
• Publication Number:
  US 20170220963A1
• Time in Patent Office: 883 Days
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06Q 10/0633 Workflow analysis
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

Aspects of the present disclosure provide a mechanism to directly interact and access with micro-services and/or services using natural-language and machine intelligence and algorithmic learning so that users may access desired micro-services and/or services with minimal interaction.

Claims

1. A method for generating workflows comprising:

receiving, at a computing device, voice data defining a request to perform a task corresponding to operations of an enterprise;

converting, using the computing device, the voice data to text data;

based on the text data, identifying, using the computing device, an application programming interface (API) associated with a first service defining an executable business function, wherein identifying the API comprises mapping the text data to a symbol graph stored in a memory accessible by the computing device, the symbol graph including a plurality of nodes, each node including textual elements associated with respective APIs;

based on the API, identifying, using the computing device, a user-interface (UI) component from a library including a plurality of user-interface components, wherein the UI component corresponds to a second service defining an executable business function capable of performing a portion of the task; and

generating, at the computing device, a workflow including the UI component, wherein the workflow may be utilized by a user to complete the task.

2. The method of claim 1, identifying the API further comprises mapping a portion of the text data to a parameter of the API.

3. The method of claim 1, wherein each of the plurality of UI components is a web component, the method further comprising mapping the first service associated with the API to a particular UI component of the library of UI components.

4. The method of claim 3, further comprising storing metadata with the first service during the mapping.

5. The method of claim 1, further comprising:

monitoring responses to the workflow to identify a pattern across multiple users; and

modifying the workflow based on the pattern.

6. The method of claim 1, wherein the workflow is a visual workflow visualizing the UI component, the method further comprising presenting the workflow to the user at a client device.

7. The method of claim 1, wherein the converting the voice data to text data comprises processing the voice data using natural language processing algorithms.

8. A non-transitory computer-readable medium encoded with instructions for generating workflows, the instructions being executable by a processor such that, when executed by the processor, the instructions cause the processor to comprising:

receive voice data defining a request to perform a task corresponding to operations of an enterprise;

convert the voice data to text data;

based on the text data, identify an application programming interface (API) associated with a first service defining an executable business function, wherein identifying the API comprises mapping the text data to a symbol graph stored in a memory accessible by the processor, the symbol graph including a plurality of nodes, each node including textual elements associated with respective APIs;

based on the API, identify a user-interface (UI) component from a library including a plurality of UI components, wherein the UI component corresponds to a second service defining an executable business function capable of performing a portion of the task; and

generate a workflow including the UI component, wherein the workflow may be utilized by a user to complete the task.

9. The non-transitory computer-readable medium of claim 8, wherein the instructions further cause the processor to identify the API by mapping a portion of the text data to a parameter of the API.

10. The non-transitory computer-readable medium of claim 8, wherein each of the plurality of UI components is a web component, and the instructions further cause the processor to map the first service associated with the API to a particular UI component of the library of UI components.

11. The non-transitory computer-readable medium of claim 10, wherein the instructions further cause the processor to store metadata with the first service during the mapping.

12. The non-transitory computer-readable medium of claim 8, wherein the instructions further cause the processor to:

monitor responses to the workflow to identify a pattern across multiple users; and

modify the workflow based on the pattern.

13. The non-transitory computer-readable medium of claim 8, wherein the workflow is a visual workflow visualizing the UI component, and the instructions further cause the processor to present the workflow to the user at a client device.

14. The non-transitory computer-readable medium of claim 8, wherein the the voice data to text data includes processing the voice data using natural language processing algorithms.

15. A system for generating workflows comprising:

a computing device to;

receive voice data defining a request to perform a task corresponding to operations of an enterprise;

convert the voice data to text data;

based on the text data, identify an application programming interface (API) associated with a first service defining an executable business function, wherein identifying the API comprises mapping the text data to a symbol graph stored in a memory accessible by the processor, the symbol graph including a plurality of nodes, each node including textual elements associated with respective APIs;

based on the API, identify a user-interface (UI) component from a library including a plurality of UI components, wherein the UI component corresponds to a second service defining an executable business function capable of performing a portion of the task; and

generate a workflow including the UI component, wherein the workflow may be utilized by a user to complete the task.

16. The system of claim 15, wherein the computing device is further to map a portion of the text data to a parameter of the application programming interface.

17. The system of claim 15, wherein each of the plurality of UI components is a web component, the computing device further to map the first service associated with the API to a particular UI component of the library of UI components.

18. The system of claim 17, wherein the computing device is further to store metadata with the first service during the mapping.

19. The system of claim 17, wherein the computing device is further to:

monitor responses to the workflow to identify a pattern across multiple users; and

modify the workflow based on the pattern.

20. The system of claim 17, wherein the workflow is a visual workflow visualizing the UI component, and the computing device is further to present the workflow to the user at a client device.