INTERACTIVE MANUAL, SYSTEM AND METHOD FOR VEHICLES AND OTHER COMPLEX EQUIPMENT
First Claim
1. An interactive manual system of a device, comprising:
- a model package database including a set of at least one of phrases and sentences, an object file, and a grammar table, wherein the object file includes information regarding an appearance of, and spatial characteristics of, one or more structures of the device and includes data representing visual displays that are associated with the device and that are associated with respective ones of the set of the at least one of phrases and sentences, and the grammar table identifies associations between (a) the information and data and (b) the respective ones of the set of the at least one of phrases and sentences;
a processor configured to execute;
a speech engine module for converting an utterance into a word sequence based on the set of the at least one of phrases and sentences and identifying a grammar category to which the word sequence conforms; and
a dialog manager module for extracting a subset of the information regarding the appearance of, and spatial characteristics of, the one or more structures of the device; and
an output arrangement configured to output what has been extracted;
wherein the extraction is based on the identified grammar category, one or more of the set of the at least one of phrases and sentences to which the word sequence corresponds, and the associations of the grammar table.
0 Assignments
0 Petitions
Accused Products
Abstract
A method and system of providing an interactive manual, including a speech engine to receive and process speech from a user, convert the speech into a word sequence, and identify meaning structures from the word sequence, a structured manual including information related to an operation of a device, a visual model to relate visual representation of the information, a dialog management arrangement to interpret the meaning structures in a context and to extract pertinent information and the visual representation from the structured manual and the visual model, and an output arrangement to output the information and visual representation.
23 Citations
24 Claims
-
1. An interactive manual system of a device, comprising:
-
a model package database including a set of at least one of phrases and sentences, an object file, and a grammar table, wherein the object file includes information regarding an appearance of, and spatial characteristics of, one or more structures of the device and includes data representing visual displays that are associated with the device and that are associated with respective ones of the set of the at least one of phrases and sentences, and the grammar table identifies associations between (a) the information and data and (b) the respective ones of the set of the at least one of phrases and sentences; a processor configured to execute; a speech engine module for converting an utterance into a word sequence based on the set of the at least one of phrases and sentences and identifying a grammar category to which the word sequence conforms; and a dialog manager module for extracting a subset of the information regarding the appearance of, and spatial characteristics of, the one or more structures of the device; and an output arrangement configured to output what has been extracted; wherein the extraction is based on the identified grammar category, one or more of the set of the at least one of phrases and sentences to which the word sequence corresponds, and the associations of the grammar table. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer-implemented method of accessing an interactive manual system of a device, the interactive manual system including a model package database that includes a set of at least one of phrases and sentences, an object file, and a grammar table, wherein the object file includes information regarding an appearance of, and spatial characteristics of, one or more structures of the device and includes data representing visual displays that are associated with the device and that are associated with respective ones of the set of the at least one of phrases and sentences, and the grammar table identifies associations between (a) the information and data and (b) the respective ones of the set of the at least one of phrases and sentences, the method comprising:
-
receiving, by a computer processor, a speech input from a user; converting, by the computer processor executing a speech engine application, the speech input into a word sequence based on the set of the at least one of phrases; identifying, by the computer processor, a grammar category to which the word sequence conforms; extracting, by the computer processor a subset of the information regarding the appearance of, and spatial characteristics of, the one or more structures of the device; and outputting, by the computer processor, via an output arrangement what has been extracted; wherein the extraction is based on the identified grammar category, one or more of the set of the at least one of phrases and sentences to which the word sequence corresponds, and the associations of the grammar table. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A hardware computer-readable storage medium having stored thereon a set of instructions executable by a processor to perform a method of accessing an interactive manual system of a device, the interactive manual system including a model package database that includes a set of at least one of phrases and sentences, an object file, and a grammar table, wherein the object file includes information regarding an appearance of, and spatial characteristics of, one or more structures of the device and includes data representing visual displays that are associated with the device and that are associated with respective ones of the set of the at least one of phrases and sentences, and the grammar table identifies associations between (a) the information and data and (b) the respective ones of the set of the at least one of phrases and sentences, the method comprising:
-
receiving a speech input from a user; converting the speech input into a word sequence based on the set of the at least one of phrases; identifying a grammar category to which the word sequence conforms; extracting a subset of the information regarding the appearance of, and spatial characteristics of, the one or more structures of the device; and outputting via an output arrangement what has been extracted; wherein the extraction is based on the identified grammar category, one or more of the set of the at least one of phrases and sentences to which the word sequence corresponds, and the associations of the grammar table.
-
-
23. A device comprising:
-
a processor, coupled to a model package database that includes a set of at least one of phrases and sentences, an object file, and a grammar table, wherein the object file includes information regarding an appearance of, and spatial characteristics of, one or more structures of the device and includes data representing visual displays that are associated with the device and that are associated with respective ones of the set of the at least one of phrases and sentences, and the grammar table identifies associations between (a) the information and data and (b) the respective ones of the set of the at least one of phrases and sentences, the processor being configured to; receive a speech input from a user; execute a speech engine application to convert the speech input into a word sequence; identify a grammar category to which the word sequence conforms; extract a subset of the information regarding the appearance of, and spatial characteristics of, the one or more structures of the device; and output via an output arrangement what has been extracted; wherein the extraction is based on the identified grammar category, one or more of the set of the at least one of phrases and sentences to which the word sequence corresponds, and the associations of the grammar table.
-
-
24. An interactive manual system of a device, comprising:
-
a model package database including a set of at least one of phrases and sentences, and information regarding components of the device, the information being associated with respective ones of the set of the at least one of phrases and sentences; a processor configured to execute; a speech engine module for converting an utterance into a word sequence based on the set of the at least one of phrases and sentences and identifying a grammar category to which the word sequence conforms; and a dialog manager module for extracting a subset of the information; and an output arrangement configured to output the extracted information; wherein the extraction is based on the identified grammar category, one or more of the set of the at least one of phrases and sentences to which the word sequence corresponds, and the associations.
-
Specification