Natural language user interface for computer-aided design systems

• US 10,095,217 B2
• Filed: 11/08/2017
• Issued: 10/09/2018
• Est. Priority Date: 09/15/2014
• Status: Active Grant

• Current Assignee: Desprez, LLC
• Original Assignee: Desprez, LLC
• Inventors: Jacobs, II, James L.
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US15/807,153
• Publication Number:
  US 20180067475A1
• Time in Patent Office: 335 Days
• Field of Search: 704275, 700182, 700 98, 715965
• CPC Class Codes: G05B 19/4093 characterised by part programming, e.g. entry of geometrical information as taken from a technical drawing, combining this with machining and material information to obtain control information, named part programme, for the NC machine
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A method of providing a natural language interface for a CAD system includes receiving a user selection through a GUI of a particular location of a CAD model, receiving a user voice input including a plurality of words and referring to the particular location, parsing the user voice input, determining a meaning for the parsed user voice input that includes a reference to the particular location, one or more words associated with one or more program actions, and one or more words associated with one or more command topics, each related to a specific feature of the CAD model, identifying one or more attributes of the specific feature based on the meaning, identifying from several candidate components at least a component compatible with the specific feature using the one or more attributes and the attribute information of the candidate components, and displaying an indication of the at least a component.

Claims

1. A method of providing a natural language interface for a computer-aided design (CAD) system, the method comprising:

automatedly receiving, via an input device of a computing device, a user selection through a graphical user interface (GUI) of a particular location of a displayed CAD model;

automatedly receiving, via the computing device, a user voice input comprising a plurality of words and referring to the particular location;

automatedly, via the computing device, parsing the user voice input;

automatedly, via the computing device, determining a meaning for the parsed user voice input, the meaning including a reference to the particular location, one or more words associated with one or more program actions, and one or more words associated with one or more command topics, each of the particular location, program actions, and command topics related to a specific feature of the displayed CAD model referred to in the voice input;

automatedly, via the computing device and based on the determined meaning, identifying information including one or more attributes of the specific feature;

automatedly, via the computing device, from among a plurality of candidate components, identifying at least a component compatible with the specific feature as a function of the one or more attributes of the specific feature and attribute information of the plurality of candidate components;

automatedly, via the computing device, displaying an indication of the at least a component compatible with the feature of the structure; and

automatedly, via the computing device, updating the GUI with respect to the CAD model based on the indication of the at least a component compatible with the feature of the structure.

2. The method of claim 1, wherein receiving the user selection of the particular location further comprises:

identifying, using the determined meaning, a feature of the displayed CAD model; and

identifying a location at the feature of the displayed CAD model.

3. The method of claim 2 further comprising displaying the identified location to the user.

4. The method of claim 1, wherein identifying information including one or more attributes of the specific feature further comprises:

determining one or more words, of the user voice input, associated with a component type;

identifying the specific feature as a function of the component type; and

identifying the one or more attributes of the specific feature as a function of the specific feature.

5. The method of claim 1, wherein identifying information including one or more attributes of the specific feature further comprises:

identifying, as a function of the determined meaning, one or more manufacturing actions to be represented in the CAD model;

identifying the specific feature as a function of the one or more manufacturing actions; and

identifying the one or more attributes of the specific feature as a function of the specific feature.

6. The method of claim 1, wherein identifying information including one or more attributes of the specific feature further comprises:

identifying specific feature as a function of the particular location; and

identifying the one or more attributes of the specific feature as a function of the specific feature.

7. The method of claim 1, wherein identifying information including one or more attributes of the specific feature further comprises identifying information including one or more attributes of the specific feature via a CAD context database, using the determined meaning.

8. The method of claim 1, wherein the user voice input further comprises a command to combine a specific component with the specific feature, and further comprising determining that the specific component is not compatible with the specific feature.

9. The method of claim 8, wherein displaying the indication of the at least one component compatible with the feature further comprises displaying a message indicating that the specific component is not compatible.

10. The method of claim 8, wherein identifying the at least one component compatible with the feature further comprises:

identifying information including one or more attributes of the specific component; and

identifying the at least one component compatible with the specific feature as a function of the one or more attributes of the specific feature, the one or more attributes of the specific component, and the attribute information of the plurality of candidate components.

11. The method of claim 1 further comprising receiving indication of a second CAD model and identifying one or more attributes of the second CAD model, and wherein identifying the at least a component compatible with the specific feature further comprises identifying the at least a component compatible with the specific feature as a function of the one or more attributes of the second CAD model.

12. The method of claim 1 further comprising:

automatedly, via the computing device, assembling a query for additional information based on the meaning, the identified information, and the CAD model;

automatedly, via the computing device, providing the assembled query to a resource provider service;

automatedly, via the computing device, receiving the additional information from the resource provider service.

13. The method of claim 12, wherein the additional information includes information regarding the specific feature, and wherein identifying information including one or more attributes of the specific feature further comprises identifying information including one or more attributes of the specific feature as a function of the additional information.

14. The method of claim 12, wherein the additional information includes information regarding the specific feature, and wherein identifying the at least a component compatible with the specific feature further comprises identifying the at least a component compatible with the specific feature as a function of the one or more attributes of the specific feature and the additional information.

15. The method of claim 12, wherein the additional information includes information regarding the plurality of components, and wherein identifying the at least a component compatible with the at least a specific feature further comprises identifying the at least a component compatible with the specific feature as a function of the one or more attributes of the specific feature and the additional information.

16. The method of claim 1 further comprising:

automatedly, by the computing device, determining that missing information is necessary to identify the at least a compatible component; and

automatedly, via the computing device, prompting the user for the missing information.

17. The method of claim 16 further comprising:

automatedly, via the computing device, receiving a response from the user to the prompt for missing information; and

identifying the at least a compatible component as a function of the response.

18. The method of claim 1 further comprising modifying the CAD model to represent the at least a component compatible with the specific feature combined with the specific feature.