User interface design apparatus and method

• US 7,412,391 B2
• Filed: 11/22/2005
• Issued: 08/12/2008
• Est. Priority Date: 11/26/2004
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Hirota, Makoto, Yamamoto, Hiroki, Nakagawa, Kenichiro
• Primary Examiner(s): Hudspeth; David R.
• Assistant Examiner(s): Albertalli; Brian L
• Application Number:
  US11/286,023
• Publication Number:
  US 20060116863A1
• Time in Patent Office: 994 Days
• Field of Search: None
• US Class Current: 704/270
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

A user interface design apparatus which reduces the load associated with input operation by an author is provided. When a speech recognition grammar including a semantic structure generating rule is acquired, at least one semantic structure is extracted from the semantic structure generating rule included in the grammar. This semantic structure is presented to the author. The author can select the semantic structural element presented using an input device. Upon selection by the author is completed, the selected information is extracted and is reflected in user interface contents.

Claims

1. A user interface design apparatus for generating a user interface content of an application which provides a pattern recognition function, comprising:

acquiring means for acquiring a recognition grammar including a semantic structure generating rule for generating a semantic structure of the pattern recognition result;

extraction means for extracting at least one semantic structure from the semantic structure generating rule included in the recognition grammar acquired by said acquiring means;

display means for displaying semantic structural elements constituting the semantic structure extracted by said extraction means; and

selection means for selecting at least one semantic structural element from the semantic structural elements displayed by said display means.

2. The apparatus according to claim 1, further comprising:

generating means for generating a semantic structural path based on the semantic structural element selected by said selection means; and

reflecting means for reflecting the semantic structural path generated by said generating means in the user interface content.

3. The apparatus according to claim 1, further comprising input information generating means for generating input information which can be accepted in accordance with the recognition grammar acquired by said acquiring means,

wherein said extraction means extracts a semantic structure when the input information generated by the input information generating information is input.

4. The apparatus according to claim 1, further comprising input example sentence extraction means for extracting an input example sentence described in the recognition grammar acquired by said acquiring means,

wherein said extraction means extracts a semantic structure when the input example sentence extracted by said input example sentence extraction means is input.

5. The apparatus according to claim 1, further comprising author input acquiring means for acquiring a pattern recognition input from an author,

wherein said extraction means extracts a semantic structure of a pattern recognition result with respect to the pattern recognition input acquired by said author input acquiring means.

6. The apparatus according to claim 1, wherein the pattern recognition is speech recognition, and the recognition grammar is a speech recognition grammar.

7. The apparatus according to claim 1, wherein the pattern recognition is handwritten character recognition and the recognition grammar is a handwritten character recognition grammar.

8. The apparatus according to claim 6, wherein the speech recognition grammar is described in compliance with a specification of Speech Recognition Grammar Specification recommended by W3C, and the semantic structure generating rule is described in compliance with a specification of Semantic Interpretation for Speech Recognition recommended by W3C.

9. A user interface design apparatus for generating a user interface content of an application which provides a pattern recognition function, comprising:

first acquiring means for acquiring a recognition grammar including a semantic structure generating rule for generating a semantic structure of the pattern recognition result;

second acquiring means for acquiring a semantic structural path input by an author;

confirming means for confirming whether semantic structures which can be generated in accordance with the recognition grammar include a semantic structure which matches the semantic structural path; and

output means for outputting error information when confirmation cannot be obtained by said confirming means.

10. A method for generating a user interface content of an application which provides a pattern recognition function, comprising the steps of:

acquiring a recognition grammar including a semantic structure generating rule for generating a semantic structure of the pattern recognition result;

extracting at least one semantic structure from the semantic structure generating rule included in the acquired recognition grammar;

displaying semantic structural elements constituting the extracted semantic structure on a display unit; and

selecting at least one semantic structural element from the displayed semantic structural elements.

11. A method for generating a user interface content of an application which provides a pattern recognition function, comprising the steps of:

acquiring a recognition grammar including a semantic structure generating rule for generating a semantic structure of the pattern recognition result;

acquiring a semantic structural path input by an author;

confirming whether semantic structures which can be generated in accordance with the recognition grammar include a semantic structure which matches the semantic structural path; and

outputting error information when the confirmation cannot be obtained.

12. A computer readable medium storing a program for causing a computer to function as a user interface design apparatus for generating a user interface content of an application which provides a pattern recognition function, comprising the code for the steps of:

acquiring a recognition grammar including a semantic structure generating rule for generating a semantic structure of the pattern recognition result;

extracting at least one semantic structure from the semantic structure generating rule included in the acquired recognition grammar;

displaying semantic structural elements constituting the extracted semantic structure on a display unit; and

selecting at least one semantic structural element from the displayed semantic structural elements.

13. A computer readable medium storing a program for causing a computer to function as a user interface design apparatus for generating a user interface content of an application which provides a pattern recognition function, comprising the code for the steps of:

acquiring a recognition grammar including a semantic structure generating rule for generating a semantic structure of the pattern recognition result;

acquiring a semantic structural path input by an author;

confirming whether semantic structures which can be generated in accordance with the recognition grammar include a semantic structure which matches the semantic structural path; and

outputting error information when the confirmation cannot be obtained.