Natural language user interface for computer-aided design systems
First Claim
1. A non-transitory machine-readable storage medium containing machine-executable instructions for performing a method of providing a natural language interface for a computer-aided design (CAD) system, said machine-executable instructions comprising:
- a first set of machine-executable instructions for automatedly receiving, via an input device of a computing device, a user selection through a graphical user interface (GUI) of a particular location of a displayed CAD model;
a second set of machine-executable instructions for automatedly receiving, via the computing device, a user voice input comprising a plurality of words and referring to the particular location;
a third set of machine-executable instructions for automatedly, via the computing device, parsing the user voice input;
a fourth set of machine-executable instructions for automatedly, via the computing device, determining a meaning for the parsed user voice input, the meaning including a reference to the particular location, one or more words associated with one or more program actions, and one or more words associated with one or more command topics, each of the particular location, program actions, and command topics related to a specific item referred to in the voice input;
a fifth set of machine-executable instructions for automatedly, via the computing device and based on the determined meaning, identifying information comprising two or more specifications for the specific item via a CAD context database, wherein the specifications comprise two or more of;
a diameter, a length, a depth, a thickness, and a material;
a sixth set of machine-executable instructions for automatedly, via the computing device, assembling a query for additional information based on the meaning, the identified information, and the CAD model;
a seventh set of machine-executable instructions for automatedly, via the computing device, providing the assembled query to a resource provider service;
an eighth set of machine-executable instructions for automatedly, via the computing device, receiving the additional information from the resource provider service, the additional information comprising information regarding at least one CAD model of the specific item to be placed at the particular location selected as a function of the meaning, the identified information, and the CAD model;
a ninth set of machine-executable instructions for automatedly, via the computing device, prompting the user for missing information determined as a function of the additional information based on whether the specific item is compatible with one or more aspects of the CAD model when placed at the particular location;
a tenth set of machine-executable instructions for automatedly, via the computing device, receiving a response from the user to the prompt for missing information;
an eleventh set of machine-executable instructions for automatedly, via the computing device, providing a command to at least one CAD program module based on the additional information and the response from the user to the prompt for missing information; and
a twelfth set of machine-executable instructions for automatedly, via the computing device, updating the GUI with respect to the CAD model based on the command.
8 Assignments
0 Petitions
Accused Products
Abstract
A natural language user interface for computer-aided design systems (CAD) comprises a natural language command module including a parser, language database and a CAD model analyzer, and a natural language server module including a second, increased capability parser, a second, preferably larger language database and a CAD context database. The CAD model analyzer analyzes and retrieves associated CAD model information related to a parsed voice command and the CAD context database provides specific CAD related contextual information to facilitate parsing and interpreting CAD specific commands. The natural language server program module may also include an artificial intelligence based query generator and communicate through a network or cloud with resource providers such as third party market places or suppliers to generate queries for retrieval of third party supplied information necessary to respond to or execute CAD specific voice commands.
177 Citations
1 Claim
-
1. A non-transitory machine-readable storage medium containing machine-executable instructions for performing a method of providing a natural language interface for a computer-aided design (CAD) system, said machine-executable instructions comprising:
-
a first set of machine-executable instructions for automatedly receiving, via an input device of a computing device, a user selection through a graphical user interface (GUI) of a particular location of a displayed CAD model; a second set of machine-executable instructions for automatedly receiving, via the computing device, a user voice input comprising a plurality of words and referring to the particular location; a third set of machine-executable instructions for automatedly, via the computing device, parsing the user voice input; a fourth set of machine-executable instructions for automatedly, via the computing device, determining a meaning for the parsed user voice input, the meaning including a reference to the particular location, one or more words associated with one or more program actions, and one or more words associated with one or more command topics, each of the particular location, program actions, and command topics related to a specific item referred to in the voice input; a fifth set of machine-executable instructions for automatedly, via the computing device and based on the determined meaning, identifying information comprising two or more specifications for the specific item via a CAD context database, wherein the specifications comprise two or more of;
a diameter, a length, a depth, a thickness, and a material;a sixth set of machine-executable instructions for automatedly, via the computing device, assembling a query for additional information based on the meaning, the identified information, and the CAD model; a seventh set of machine-executable instructions for automatedly, via the computing device, providing the assembled query to a resource provider service; an eighth set of machine-executable instructions for automatedly, via the computing device, receiving the additional information from the resource provider service, the additional information comprising information regarding at least one CAD model of the specific item to be placed at the particular location selected as a function of the meaning, the identified information, and the CAD model; a ninth set of machine-executable instructions for automatedly, via the computing device, prompting the user for missing information determined as a function of the additional information based on whether the specific item is compatible with one or more aspects of the CAD model when placed at the particular location; a tenth set of machine-executable instructions for automatedly, via the computing device, receiving a response from the user to the prompt for missing information; an eleventh set of machine-executable instructions for automatedly, via the computing device, providing a command to at least one CAD program module based on the additional information and the response from the user to the prompt for missing information; and a twelfth set of machine-executable instructions for automatedly, via the computing device, updating the GUI with respect to the CAD model based on the command.
-
Specification