METHOD AND SYSTEM FOR A USER INTERFACE USING HIGHER ORDER COMMANDS

• US 20080114604A1
• Filed: 11/15/2006
• Published: 05/15/2008
• Est. Priority Date: 11/15/2006
• Status: Abandoned Application

• Current Assignee: Motorola Mobility, Inc. (Lenovo Group Ltd.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Ali, Mir F., Nowlan, Steven J., Davis, Paul C., Russell, Dale W., Matteo, Deborah A., Wei, Yuan-Jun
• Application Number:
  US11/560,139
• Publication Number:
  US 20080114604A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

A Higher Order Command Dialog System (HOCS) 250 for enabling voice control to a user interface is provided. The HOCS can record (302) a sequence of action steps a user performs while navigating a menu system to perform a task, prompt (304) a user to create an HOC for the task, and associate (306) the sequence of actions steps with a Higher Order Command (HOC) for performing the task. The HOC can include multi-modal inputs (120/260) and prompt a user for non-specific additional information (124) required in performing the task. The HOCS can store the HOC as a voice tag or a user-input command.

Claims

1. A method for user interfacing suitable for use in a mobile device, comprising

recording a sequence of action steps a user performs while navigating a menu system to perform a task;

and

associating the sequence of actions steps with a Higher Order Command (HOC) for performing the task,

wherein the HOC is a compact command representation for the sequence of action steps representing a voice modality or a user-input modality.

2. The method of claim 1, further comprising:

receiving the HOC; and

performing the sequence of action steps in accordance with the HOC for performing the task, such that when the user issues the HOC, the task is automatically performed.

3. The method of claim 1, wherein the recording the HOC further comprises:

prompting the user to save the HOC as a voice tag; and

capturing a voice recording in response to the prompting for creating the voice tag,

such that upon receiving the voice recognition command, the sequence of action steps is automatically performed.

4. The method of claim 1, further comprising:

determining when an action step requires a non-specific parameter to complete task; and

prompting the user for the non-specific parameter when the HOC encounters the action step.

5. The method of claim 1, further comprising:

automatically parsing the navigation menu system or menu documentation for menu paths; and

automatically creating multiple HOCs for the menu paths.

6. The method of claim 1, further comprising:

determining when the user is in a process of performing a task; and

prompting the user to create an HOC upon completion of the task.

7. The method of claim 1, wherein the recording further comprises:

determining when the user has entered a misleading action step in performing the task; and

discarding the misleading action step in the sequence of action steps associated with the HOC.

8. The method of claim 1, wherein the associating further comprises replacing a series of long action steps with a series of equivalent short action steps for reducing the sequence of action steps to perform the task.

9. A method for creating a Higher Order Command (HOC), comprising:

capturing a sequence of action steps a user performs while navigating a menu system to perform a task;

associating the sequence of action steps with a Higher Order Command (HOC); and

prompting the user for information that is required for completing an action step associated with the task.

10. The method of claim 9, wherein the prompting further comprises:

identifying variable items in the task; and

creating a template that includes the information in the variable item for including with the HOC.

11. The method of claim 9, wherein the additional information is associated with an email application, a voice mail application, a voice call, or a bluetooth operation.

12. The method of claim 9, further comprising prompting the user to save the HOC as a voice recognition command or as a user-input command.

13. The method of claim 9, wherein the HOC includes a sub-sequence of action steps representing a macro or a built-in shortcut.

14. A Higher Order Command Dialog system, comprising:

a base dialog system (BDS) having a navigation structure that allows a user to perform a sequence of action steps for performing a task; and

a Higher Order Command system (HOCS) communicatively coupled to the BDS, wherein the HOCS parses the navigation structure in response to the sequence of action steps and creates Higher Order Commands (HOC) to associate with the sequence of action steps.

15. The Higher Order Command Dialog system of claim 14, wherein the HOCS further comprises:

a Graphical User Interface (GUI) for visually presenting the navigation structure of the BDS;

a keypad operatively coupled to the GUI for receiving user input to perform the sequence of action steps in the navigation structure; and

a voice user interface (VUI) operatively coupled to the keypad for creating voice recognition commands to associate with the sequence of action steps.

16. The Higher Order Command Dialog system of claim 15, wherein the HOCS further comprises:

a controller operatively coupled to the GUI, keypad, and VUI for receiving the HOC and performing the sequence of action steps in response to the HOC for performing the task, such that when the user issues the HOC, the processor automatically performs the task.

17. The Higher Order Command Dialog system of claim 16, wherein the controller prompts the user for user-input when additional information is required to process the task, wherein the additional information is a text modality of a voice modality.

18. The Higher Order Command Dialog system of claim 16, wherein the controller stores the sequence of action steps in a modality selected by the user.

19. The Higher Order Command Dialog system of claim 16, wherein the controller performs a HOC validity check to ensure the sequence of action steps correctly performs the task.

20. The Higher Order Command Dialog system of claim 16, wherein the controller checks if a similar HOC has been previously created, and if so, informs the user of the similar HOC.