Natural language user interface for computer-aided design systems

• US 10,162,337 B2
• Filed: 10/18/2017
• Issued: 12/25/2018
• Est. Priority Date: 09/15/2014
• Status: Active Grant

• Current Assignee: Desprez, LLC
• Original Assignee: Desprez, LLC
• Inventors: Jacobs, II, James L.
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US15/787,423
• Publication Number:
  US 20180039253A1
• Time in Patent Office: 433 Days
• Field of Search: 704275, 700182, 700 98, 715964
• CPC Class Codes: G05B 19/4093 characterised by part programming, e.g. entry of geometrical information as taken from a technical drawing, combining this with machining and material information to obtain control information, named part programme, for the NC machine
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

A method of providing a natural language interface for a computer-aided design (CAD) system is disclosed. The method includes displaying to the user a model display graphical user interface (GUI), a view window that displays a first view of the CAD model, and a spectrum GUI configured to allow the user to selectively add CAD-tool functionality, receiving a voice input including a plurality of words and referring to a CAD-tool functionality, parsing the voice input, determining a meaning including a reference to the CAD-tool functionality for the parsed voice input, assembling a query for additional information based on the meaning, sending the assembled query to a corresponding information location, receiving queried information from the corresponding information location, translating received information into a response, determining that the response includes a command for the spectrum GUI regarding the CAD-tool functionality, and sending the command to the spectrum GUI.

Claims

1. A method of providing a natural language interface for a computer-aided design (CAD) system, the method comprising:

automatedly, via a computing device, displaying to the user a model display graphical user interface (GUI);

automatedly, via the computing device, displaying to the user, in the model display GUI, a view window designed and configured to display a first view of a CAD model;

automatedly, via the computing device, displaying to the user, in the model display GUI, a spectrum GUI designed and configured to allow the user to selectively add CAD-tool functionality to the model display GUI;

automatedly, via the computing device, receiving a user voice input comprising a plurality of words and directing the computing device to perform an action using a specific CAD-tool functionality of a plurality of CAD-tool functionalities, wherein the user voice input does not include an instruction to activate the specific CAD-tool functionality;

automatedly, via the computing device, parsing the user voice input;

automatedly, via the computing device, identifying a command for the spectrum GUI to perform the action using the specific CAD-tool functionality based on the plurality of words, wherein identifying the command for the spectrum GUI to perform the action further comprises;

automatedly, via the computing device, determining a meaning for the parsed user voice input, the meaning including a reference to the specific CAD-tool functionality;

automatedly, via the computing device, assembling a query for additional information based on the meaning;

automatedly, via the computing device, sending the assembled query to a corresponding information location;

automatedly, via the computing device, receiving queried information from the corresponding information location;

automatedly, via the computing device, translating received information into a response;

automatedly, via the computing device, determining that the response includes the command for the spectrum GUI to perform the action using the specific CAD-tool functionality;

automatedly, via the computing device, determining that the specific CAD-tool functionality is not currently activated in the Spectrum GUI;

automatedly, via the computing device, sending a command to the Spectrum GUI to activate the specific CAD tool; and

automatedly, via the computing device, sending the command to perform the action using the particular CAD-tool functionality to the spectrum GUI.

2. The method of claim 1, wherein determining the meaning for the parsed user voice input further comprises determining one or more words associated with one or more program actions related to the specific CAD-tool functionality.

3. The method of claim 1, wherein determining the meaning for the parsed user voice input further comprises determining one or more command topics related to the specific CAD-tool functionality.

4. The method of claim 1, wherein determining that the response includes the command for the spectrum GUI regarding the specific CAD-tool functionality further comprises determining that the response is missing information and displaying to the user a prompt for missing information.

5. The method of claim 4 further comprising automatedly receiving, via the computing device, a response from the user to the prompt for missing information.

6. The method of claim 5, wherein providing the command to the spectrum GUI further comprises providing the command based on the additional information and the response from the user to the prompt for missing information.

7. The method of claim 1 further comprising:

determining that the user is authorized to access the specific CAD-tool functionality; and

automatedly activating the specific CAD-tool functionality.

8. The method of claim 1 further comprising displaying to the user a message indicating that the specific CAD-tool functionality is not currently activated.

9. The method of claim 1, wherein the command to perform an action using the specific CAD-tool functionality further comprises a command to modify the first view using a viewing tool.

10. The method of claim 1, wherein the command to perform an action using the specific CAD-tool functionality further comprises a command to modify the CAD model using the CAD manipulation tool.

11. The method of claim 10, further comprising automatedly receiving, via an input device of a computing device, a user selection of a particular location of the displayed first view of the CAD model.

12. The method of claim 11, wherein receiving the voice input further comprises receiving a reference to a specific item.

13. The method of claim 12, further comprising automatedly, via the computing device and based on the determined meaning, identifying information comprising two or more specifications for the specific item via a CAD context database, wherein the specifications comprise two or more of:

a diameter, a length, a depth, a thickness, and a material.

14. The method of claim 13, wherein assembling the query further comprises assembling a query for additional information based on the meaning, the identified information, and the CAD model.

15. The method of claim 12 further comprising prompting the user for missing information determined as a function of the additional information based on whether the specific item is compatible with one or more aspects of the CAD model when placed at the particular location.

16. The method of claim 10 further comprising automatedly, via the computing device, updating the view window with respect to the CAD model based on the command.