USER INTERFACE DEVICE AND INFORMATION PROCESSING METHOD

• US 20140168130A1
• Filed: 07/26/2012
• Published: 06/19/2014
• Est. Priority Date: 07/27/2011
• Status: Abandoned Application

• Current Assignee: Mitsubishi Electric Corporation
• Original Assignee: Mitsubishi Electric Corporation
• Inventors: Hirai, Masato
• Application Number:
  US14/235,015
• Publication Number:
  US 20140168130A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 21/16 Transforming into a non-visible representation devices or methods enabling ear patients to replace direct auditory perception by another kind of perception A61F11/04

Abstract

An input method determining unit determines whether a hard button is short or long pressed, and an input switching control unit switches between modes. The input switching control unit determines that an operation mode is a touch operation one when the hard button is short pressed, and a touch-to-command converting unit converts an item corresponding to the short-pressed hard button into a command. The input switching control unit determines that the operation mode is a voice operation one when the hard button is long pressed, and a voice-to-command converting unit converts a voice recognition keyword which is voice-recognized into a command (item value). A state transition control unit generates an application execution command corresponding to the command, and an application executing unit executes an application.

Claims

1-13. -13. (canceled)

14. A user interface device comprising:

an input detector that detects which button, among a plurality of buttons in an operation interface with which a plurality of process groups into which a plurality of processes are grouped are brought into correspondence respectively, is selected; and

a voice-to-command converter that converts a result of voice recognition of a voice associated with the selected button detected by said input detector into a first command for performing a process in a process group brought into correspondence with said selected button.

15. The user interface device according to claim 14, wherein said user interface device includes:

a voice recognition dictionary database that stores voice recognition dictionaries each of which is comprised of voice recognition keywords brought into correspondence with said plurality of processes respectively; and

a voice recognition dictionary switcher that switches to a voice recognition dictionary included in said voice recognition dictionary database and including a voice recognition keyword brought into correspondence with the process associated with said selected button; and

a voice recognizer that carries out voice recognition on the voice associated with said selected button by using the voice recognition dictionary to which said voice recognition dictionary switcher switches.

16. The user interface device according to claim 14, wherein said user interface device includes:

a data storage that stores data about items which are divided into groups and which are arranged hierarchically in each of said groups;

a voice recognition dictionary database for storing voice recognition keywords respectively brought into correspondence with said items;

a voice recognition target word dictionary generator that, when a selection is performed on a scroll bar area of a list screen in which items in a predetermined layer of each of the groups of the data stored in said data storage are arranged, extracts a voice recognition keyword brought into correspondence with at least one of the items arranged in said list screen and an item in a layer lower than that of said list screen from said voice recognition dictionary database to generate a voice recognition target word dictionary; and

a voice recognizer that carries out voice recognition on the voice associated with said selected button by using the voice recognition target word dictionary which said voice recognition dictionary generator generates.

17. The user interface device according to claim 14, wherein said user interface device includes:

a touch-to-command converter that, when one process in said process group is brought into correspondence with said button, generates a second command for performing the process corresponding to said button according to a touch operation on said button;

an input method determinator that determines whether a voice operation mode for performing the process corresponding to the first command which said voice-to-command converter generates or a touch operation mode for performing the process corresponding to the second command which said touch-to-command converter generates is selected according to a state of a user'"'"'s touch operation when selecting said button;

an input switching controller that switches between the voice operation mode and the touch operation mode on a basis of a result of the determination by said input method determinator.

18. The user interface device according to claim 17, wherein said user interface device includes:

a process performer that, when receiving an indication of the voice operation mode from said input switching controller, acquires said first command from the voice-to-command converter and performs the process corresponding to said first command, and, when receiving an indication of the touch operation mode from said input switching controller, acquires said second command from the touch-to-command converter and performs the process corresponding to said second command; and

an output controller that controls an outputter that outputs a result of the performance by said process performer.

19. The user interface device according to claim 18, wherein said user interface device includes an output method determinator that receives an indication of the touch operation mode or the voice operation mode from said input switching controller to determine an output method of outputting the result of the performance which said outputter uses according to said indicated mode, and said output controller controls said outputter according to the output method which said output method determinator determines.

20. The user interface device according to claim 19, wherein said user interface device includes an output data storage that stores data about voice guidance for each second command, said voice guidance urging a user to utter a voice recognition keyword brought into correspondence with a process included in a process group associated with a process corresponding to said second command and categorized into a layer lower than that of said process, and wherein said output method determinator acquires data about voice guidance corresponding to the second command which said touch-to-command converter generates from said output data storage and outputs said data to said output controller when receiving an indication of the voice operation mode from said input switching controller, and said output controller causes said outputter to output the data about the voice guidance which said output method determinator outputs.

21. The user interface device according to claim 14, wherein said operational interface is a touch panel.

22. The user interface device according to claim 14, wherein said operational interface is a hard button.

23. The user interface device according to claim 14, wherein said operational interface is a cursor operation hard device for enabling a user to select a process item by operating a cursor displayed on a display.

24. The user interface device according to claim 14, wherein said operational interface is a touchpad.

25. An information processing method comprising:

an input detecting step of detecting which button, among a plurality of buttons in an operation interface with which a plurality of process groups into which a plurality of processes are grouped are brought into correspondence respectively, is selected; and

a voice-to-command converting step of converting a result of voice recognition of a voice associated with the selected button detected in said input detecting step into a first command for performing a process in a process group brought into correspondence with said selected button.