LAYERED CONTEXTUAL CONFIGURATION MANAGEMENT SYSTEM AND METHOD AND MINIMIZED INPUT SPEECH RECOGNITION USER INTERFACE INTERACTIONS EXPERIENCE

• US 20100138759A1
• Filed: 11/02/2007
• Published: 06/03/2010
• Est. Priority Date: 11/03/2006
• Status: Active Grant

• Current Assignee: Philippe Roy
• Original Assignee: Conceptual Speech LLC
• Inventors: Roy, Philippe
• Granted Patent: US 9,471,333 B2
• Time in Patent Office: Days
• US Class Current: 715/764
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 9/44505 Configuring for program initiating, e.g. using registry, configuration files
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

In an effort to customize or enhance software applications, configuration data is often used. Configuration settings that are editable by users need not to be limited to a simple flat entry that can be taken out of context anymore. The present invention allows for multiple-levels of configuration settings to interact with each other, so that a single configuration for a given context to be calculated dynamically. In the process, the user gains flexibility to specify more adequately a required change or customization while propagating the information with minimal effort and not requiring additional coding. Furthermore, to simplify a speaker'"'"'s interactions for controlling an automated device, the addition of a superposed layer over graphic user interface may be used. The superposed layer may display coordinates that a speaker may use to navigate the graphic user interface, for example to associate a location with a keyword or a coordinate.

Claims

1. A method for modifying interaction of a computer software application, comprising:

determining a context of execution of the at least one software application;

defining an interface for interaction with the at least one computer software application based on at least one set of configurations selectively made available in dependence on the determined context; and

communicating in relation to the computer software application in dependence on the interface,

wherein the user interaction of the computer software application is modified without requiring access to the source code of, or modification to the computer software application.

2. The method according to claim 1, wherein the context has a hierarchy, and wherein the interface is defined based on a plurality of sets of configurations having a priority varying according to the hierarchy.

4. The method according to claim 1, wherein the context comprises a set of open windows within a graphic user interface.

5. The method according to claim 1, wherein the context is determined based on a set of objects presented through a dynamically changing graphic user interface.

6. The method according to claim 1, wherein a set of configurations comprises a predetermined file associated with a dynamically selectively presented object in a user interface.

7. The method according to claim 1, wherein a configuration comprises a data file representing speech input corresponding to a graphic user interface command.

8. The method according to claim 1, wherein the at least one set of configurations comprises a set of speech commands.

9. The method according to claim 1, wherein said communicating comprises presenting a message comprising a text string to computer software application.

10. The method according to claim 1, wherein the modification of the user interaction provides a speech input to a computer software application whose source code specifies receipt of input through a graphic user interface.

3. The method according to clam 1, wherein the context comprises at least one set of dynamically changing available commands.

11. A system providing a modified interaction of a user with a computer software application, comprising:

a determinable context of execution;

an interface for interaction with the at least one computer software application based on at least one set of configurations selectively made available in dependence on the context;

a processor adapted to communicate in relation to the computer software application in dependence on the interface, wherein a user interaction of the computer software application is modified without requiring access to the source code of, or modification to the computer software application.

12. The system according to claim 11, wherein the context has a hierarchy, and wherein the interface is defined based on a plurality of sets of configurations having a priority varying according to the hierarchy.

14. The system according to claim 11, wherein the context comprises a set of open windows within a graphic user interface.

15. The system according to claim 11, wherein the context is determined based on a set of objects presented through a dynamically changing graphic user interface.

16. The system according to claim 11, wherein a set of configurations comprises a predetermined file associated with a dynamically selectively presented object in a user interface.

17. The system according to claim 11, wherein a configuration comprises a data file representing speech input corresponding to a graphic user interface command.

18. The system according to claim 11, wherein the at least one set of configurations comprises a set of speech commands.

19. The system according to claim 11, wherein the processor is adapted to communicate by at least presenting a message comprising a text string to computer software application.

20. The system according to claim 11, wherein the modification of the user interaction provides a speech input to a computer software application whose source code specifies receipt of input through a graphic user interface.

13. The system according to clam 11, wherein the context comprises at least one set of dynamically changing available commands.

21. A user interface for a graphic user interface computer system, comprising a display adapted to present a set of graphic objects defined by at least one software application having a native graphic user interface;

a speech recognition engine for receiving user speech commands intended to control the at least one software application;

a voice controlled graphic layer superposed on, or blended over, the native graphic user interface or a representation of the graphic user interface of the at least one software application, presenting a graphic indication of available speech commands for the at least one software application, wherein the superposed voice controlled graphic layer does not disrupt the clarity of the native graphic user interface.

22. A method of speech enabling a graphic user interface software application, comprising:

providing a graphic user interface display or a derived image of such graphic user interface;

overlaying a set of identified regions on the graphic user interface display;

receiving a speech input for a user, identifying a selected identified region; and

generating at least one graphic user interface event associated with the identified region.