Control apparatus

• US 20030139932A1
• Filed: 12/18/2002
• Published: 07/24/2003
• Est. Priority Date: 12/20/2001
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Shao, Yuan, Jost, Uwe Helmut
• Application Number:
  US10/321,448
• Publication Number:
  US 20030139932A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A control apparatus (2) has a user interface manager (21;22) having at least one interface module (215,214,213,216,211;221,222,223,224) adapted to receive data for a corresponding user interface mode. A dialogue manager (201) associated with a dialogue interpreter (202) is arrange to conduct a dialogue with the user in accordance with mark-up language document files supplied to the dialogue conductor. In an embodiment, the control apparatus determines any user interface mode or modes specified by a received mark-up language document, determines whether the user interface manager has an interface module for the specified user interface mode or modes and, if not, obtains an interface module for that interface mode. In another embodiment, the mark-up language document files supplied to the user interface manager specify a type and/or accuracy or confidence level for the interface mode and the control apparatus selects the interface module or modules to be used on the basis of this information. In another embodiment, the control apparatus may be configured to treat an event as an input.

Claims

1. Control apparatus for enabling a user to communicate with a processor-controlled apparatus using user interface means the apparatus comprising:

user interface management means having at least one interface module adapted to receive data for a corresponding user interface mode;

dialogue conducting means for conducting a dialogue with the user in accordance with mark-up language document files;

mark-up language document file supplying means for supplying at least one mark-up language document file to the dialogue conducting means during the course of a dialogue with the user;

mode determining means for determining any user interface mode or modes specified by a mark-up language document file supplied to the dialogue conducting means;

interface module determining means for determining whether the user interface management means has an interface module for the or each user interface mode specified by the mark-up language document file supplied to the dialogue conducting means; and

interface module obtaining means for, when the interface module determining means determines that the user interface management means does not have an interface module for an interface mode, obtaining an interface module for that interface mode.

2. Control apparatus according to claim 1, wherein the interface module obtaining means comprises communication means for establishing communication with a source for the interface module over a network;

and downloading means for downloading the interface module via the network.

3. Control apparatus according to claim 1, wherein the interface module obtaining means comprises prompt means for advising the user that an interface module specified by a mark-up language document file is obtainable from an interface module store;

communication means for establishing communication with the interface module store over a network in accordance with user instructions to obtain the interface module; and

downloading means for downloading the interface module from the interface module store.

4. Control apparatus according to claim 1, wherein the control apparatus has communication means for establishing communication with a mark-up language document file provider arranged to provide at least one mark-up language document file that specifies at least one user interface mode;

mark-up language document file obtaining means for obtaining a mark-up language document file from the mark-up language document file provider when communication with the mark-up language document file provider is established, the mark-up language document file supplying means being operable to supply to the dialogue conducting means a mark-up language document file obtained by the mark-up language document file obtaining means.

5. Control apparatus according to claim 4, wherein the interface module obtaining means comprises prompt means for advising the user that a mark-up language document file obtained from the mark-up language document file provider specifies an interface mode for which the interface management means does not have an interface module;

communication means for establishing communication with an interface module store identified by the mark-up language document file provider over a network in accordance with user instructions to obtain the interface module; and

downloading means for downloading the interface module from the interface module store.

6. Control apparatus according to claim 1, wherein a mark-up language document file specifying a user interface mode has an interface mode tag specifying the interface mode or modes.

7. Control apparatus according to claim 1, wherein a mark-up language document file specifying at least one user interface mode specifies at least one of any one of the following user interface modes:

keyboard, pointing device, speech.

8. Control apparatus according to claim 1, wherein a mark-up language document file specifying at least one user interface mode specifies an interface mode specific to the application of which the mark-up language document file forms a part.

16. Control apparatus according to claim 1, wherein the user interface management means has an interface module for at least one of the following user interface modes:

keyboard, pointing device, speech.

17. Control apparatus according to claim 1, wherein the apparatus is configured to operate in accordance with the JAVA operating platform.

18. Control apparatus according to claim 1, wherein the mark-up language document files use a mark-up language based on XML.

19. Control apparatus according to claim 18, wherein the mark-up language document files use a mark-up language based on VoiceXML.

20. A user interface apparatus comprising a control apparatus according to claim 1 and a user interface for enabling a user to interface with the control apparatus.

26. A signal comprising a mark-up language document file for use in apparatus in accordance with claim 1, the document file specifying at least one user interface mode.

29. A storage medium storing a signal in accordance with claim 26.

9. Control apparatus for enabling a user to communicate with a processor-controlled apparatus using user interface means, the apparatus comprising:

user interface management means having at least one interface module adapted to receive data for a corresponding user interface mode, the or each interface module providing attribute data regarding at least one attribute of the corresponding interface mode;

dialogue conducting means for conducting a dialogue with the user in accordance with mark-up language document files;

mark-up language document file supplying means for supplying different mark-up language document files to the dialogue conducting means during the course of a dialogue with the user;

attribute determining means for determining any user interface attribute specified by a mark-up language document file supplied to the dialogue conducting means;

interface module selecting means for selecting the interface module or modules providing attribute data for the attribute or attributes specified by an mark-up language document file supplied to the dialogue conducting means, thereby enabling use as an interface mode any user interface mode having the attribute or attributes specified by the mark-up language document file supplied to the dialogue conducting means.

10. Control apparatus according to claim 9, wherein the control apparatus has communication means for establishing communication with a mark-up language document file provider arranged to provide at least one mark-up language document file that specifies at least one attribute;

and mark-up language document file obtaining means for obtaining a mark-up language document file from the mark-up language document file provider when communication with the mark-up language document file provider is established, the mark-up language document file supplying means being operable to supply to the dialogue conducting means mark-up language documents obtained by the mark-up language document file obtaining means.

11. Control apparatus according to claim 9, wherein a mark-up language document file specifying an attribute has an interface mode type tag specifying the attribute or attributes.

12. Control apparatus according to claim 9, wherein a mark-up language document file specifies for at least one attribute at least one of mode type and confidence.

13. Control apparatus according to claim 9, wherein a mark-up language document file specifies for at least one attribute a mode type selected from pointing, position and text.

14. Control apparatus according to claim 9, wherein a mark-up language document file specifies for at least one attribute a degree of confidence or precision required for the input.

27. A signal comprising a mark-up language document specifying at least one user interface attribute for use in apparatus in accordance with claim 9.

15. Control apparatus for enabling a user to communicate with a processor-controlled apparatus using user interface means, the apparatus comprising:

user interface management means having at least one interface module adapted to receive data for a corresponding one of the user interface mode;

dialogue conducting means for conducting a dialogue with the user in accordance with mark-up language document files;

mark-up language document file supplying means for supplying different mark-up language document files to the dialogue conducting means during the course of a dialogue with the user;

interface mode determining means for determining any user interface mode or modes specified by a mark-up language document file supplied to the dialogue conducting means;

interface module activating means for activating the interface module for the or each user interface mode specified by the mark-up language document file supplied to the dialogue conducting means, wherein the user interface management means is configured to provide an event interface module and at least one mark-up language document file defines a type of event that may occur in the control apparatus or apparatus coupled thereto as an interface mode.

28. A signal comprising a mark-up language document file that defines an event that may occur as an interface mode, for use in apparatus in accordance with claim 15.

21. A method of operating control apparatus for enabling a user to communicate with a processor-controlled apparatus using a user interface, the apparatus having a user interface manager having at least one interface module adapted to receive data for a corresponding user interface mode, and a dialogue conductor that conducts a dialogue with the user in accordance with mark-up language document files, the method comprising a processor of the control apparatus:

supplying means for supplying different mark-up language document files to the dialogue conductor during the course of a dialogue with the user;

determining any user interface mode or modes specified by a mark-up language document file supplied to the dialogue conductor;

determining whether the user interface manager has an interface module for the or each user interface mode specified by the mark-up language document file supplied to the dialogue conductor; and

when it is determined that the user interface manager does not have an interface module for an interface mode, obtaining an interface module for that interface mode.

24. A signal carrying processor implementable instructions for causing a processor to carry out a method in accordance with claim 21.

25. A storage medium storing processor implementable instructions for causing a processor to carry out a method in accordance with claim 21.

22. A method of operating control apparatus for enabling a user to communicate with a processor-controlled apparatus using a user interface, the apparatus having a user interface manager means having at least one interface module adapted to receive data for a corresponding user interface mode, each interface module providing attribute data regarding at least one attribute of the corresponding interface mode, and a dialogue conductor that conducts a dialogue with the user in accordance with mark-up language document files, the method comprising a processor of the control apparatus:

supplying means for supplying different mark-up language document files to the dialogue conductor during the course of a dialogue with the user;

determining any user interface attribute specified by a mark-up language document file supplied to the dialogue conductor; and

selecting the interface module or modules providing attribute data for the attribute or attributes specified by a mark-up language document file supplied to the dialogue conductor, thereby enabling the user to use as an interface mode any user interface mode having the attribute or attributes specified by the mark-up language document file supplied to the dialogue conductor.

23. A method of operating control apparatus for enabling a user to communicate with a processor-controlled apparatus using a user interface, the apparatus having a user interface manager having at least one interface module adapted to receive data for a corresponding user interface mode and an event interface mode, and a dialogue conductor that conducts a dialogue with the user in accordance with mark-up language document files, the method comprising a processor of the control apparatus:

supplying different mark-up language document files to the dialogue conductor during the course of a dialogue with the user;

determining any user interface mode or modes specified by a mark-up language document file supplied to the dialogue conductor;

activating the interface module for the or each user interface mode specified by the mark-up language document file supplied to the dialogue conductor; and

treating an event that may occur in the control apparatus or apparatus coupled thereto as an interface mode when a mark-up language document file defines a type of event as an interface mode.