USER INTERFACE SYSTEM, USER INTERFACE CONTROL DEVICE, USER INTERFACE CONTROL METHOD, AND USER INTERFACE CONTROL PROGRAM

• US 20170017497A1
• Filed: 04/22/2014
• Published: 01/19/2017
• Est. Priority Date: 04/22/2014
• Status: Abandoned Application

• Current Assignee: Mitsubishi Electric Corporation
• Original Assignee: Mitsubishi Electric Corporation
• Inventors: SHIMADA, Atsushi, HIRAI, Masato, IMANAKA, Hideo, SAKATA, Reiko
• Application Number:
  US15/124,315
• Publication Number:
  US 20170017497A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/122 Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1464 3D-gesture
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/197 Blocking or enabling of input functions
• CPC Class Codes: B60K 2370/122 with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2370/143 Touch sensitive input devices
• CPC Class Codes: B60K 2370/1438 Touch screens
• CPC Class Codes: B60K 2370/146 Input by gesture
• CPC Class Codes: B60K 2370/1464 3D-gesture
• CPC Class Codes: B60K 2370/148 Input by voice
• CPC Class Codes: B60K 2370/186 Displaying Information according to relevancy
• CPC Class Codes: B60K 2370/197 Blocking or enabling of input functions
• CPC Class Codes: B60K 2370/52 Control of displays
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/81 : for controlling displays
• CPC Class Codes: G01C 21/3608 : using speech input, e.g. using speech recognition
• CPC Class Codes: G06F 2203/0381 : Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 : Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04895 : Guidance during keyboard input operation, e.g. prompting
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/445 : Program loading or initiating bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57
• CPC Class Codes: G06F 9/451 : Execution arrangements for user interfaces

Abstract

An object of the present invention is to allow execution of a target function by an operation means that is easy to operate for a user. In order to achieve the object, a user interface system according to the present invention includes a function-means storage section 5 that stores candidates for a plurality of functions and candidates for a plurality of operation means for issuing an instruction to execute each function, an estimation section 3 that estimates a function intended by a user, and the operation means for issuing the instruction to execute the function, from among the candidates stored in the function-means storage section 5, based on information related to a current situation, and a presentation section 6 that presents the candidate for the function estimated by the estimation section 3, together with the candidate for the operation means for executing the function.

Claims

1. A user interface system comprising:

a function-means storage that stores candidates for a plurality of functions, and candidates for a plurality of operation means for issuing an instruction to execute each of the functions;

an estimator that estimates a function intended by a user and the operation means for issuing an instruction to execute the function, from among the candidates stored in the function-means storage, based on information related to a current situation; and

a presentator that presents the candidate for the function estimated by the estimator, together with the candidate for the operation means to execute the function.

2. The user interface system according to claim 1, wherein

the function-means storage is updated based on a selection of the function by the user.

3. The user interface system according to claim 1, wherein

the estimator estimates the function intended by the user, and the operation means for issuing the instruction to execute the function based on external environment information and history information.

4. The user interface system according to claim 1, wherein the estimator estimates the function intended by the user and the operation means by using a function or operation means corresponding to the current situation determined from external environment information.

5. A user interface control device comprising:

an estimator that estimates a function intended by a user and an operation means for issuing an instruction to execute the function based on information related to a current situation; and

a presentation controller that controls a presentator that presents a candidate for the function estimated by the estimator, together with a candidate for the operation means for executing the function.

6. The user interface control device according to claim 5, further comprising:

a function-means combiner that generates, when a new function is selected by the user or when a new operation means is used by the user, a new combination of the function and the operation means by using the new function or the new operation means, wherein

the estimator performs the estimation by using the new combination.

7. The user interface control device according to claim 5, wherein

the estimator estimates the function intended by the user, and the operation means for issuing the instruction to execute the function based on external environment information and history information.

8. The user interface control device according to claim 5, further comprising:

a situation determinator that determines what a function or operation means corresponding to the current situation is, based on external environment information, wherein

the estimator estimates the function intended by the user and the operation means based on a result of the determination.

9. A user interface control method comprising the steps of:

estimating a function intended by a user, and an operation means for issuing an instruction to execute the function based on information related to a current situation; and

controlling a presentator that presents a candidate for the function estimated in the estimating step together with a candidate for the operation means for executing the function.

10. A user interface control program causing a computer to execute:

estimation processing that estimates a function intended by a user, and an operation means for issuing an instruction to execute the function based on information related to a current situation; and

presentation control processing that controls a presentator that presents a candidate for the function estimated by the estimation processing together with a candidate for the operation means for executing the function.