MOBILE TERMINAL DEVICE AND INPUT OPERATION RECEIVING METHOD

• US 20150227194A1
• Filed: 04/24/2015
• Published: 08/13/2015
• Est. Priority Date: 10/25/2012
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Kyocera Corporation
• Inventors: KUBOTA, Saki, SAIKI, Atsutaka
• Granted Patent: US 9,760,165 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A mobile terminal device includes: a first operation receiving module configured to receive a first input operation; a second operation receiving module configured to receive a second input operation having a method different from that of the first input operation; a determination module configured to determine whether or not a switch condition is satisfied which indicates that the reception of the first input operation by the first operation receiving module is difficult; and a switch control module configured to, based on the determination that the switch condition is satisfied by the determination module, switch a first mode of receiving the first input operation with the first operation receiving module to a second mode of receiving the second input operation with the second operation receiving module.

Claims

1. A mobile terminal device comprising:

a first operation receiving module configured to receive a first input operation;

a second operation receiving module configured to receive a second input operation having a method different from a method of the first input operation;

a determination module configured to determine whether or not a switch condition is satisfied, the switch condition indicating that a reception of the first input operation by the first operation receiving module is difficult; and

a switch control module configured to, based on a determination that the switch condition is satisfied by the determination module, switch a first mode of receiving the first input operation by the first operation receiving module to a second mode of receiving the second input operation by the second operation receiving module.

2. The mobile terminal device according to claim 1, wherein

when the determination module determines that the switch condition is satisfied, and when an operation of refusing a switch from the first mode to the second mode is performed, the switch control module continues the reception of the input operation in the first mode.

3. The mobile terminal device according to claim 1, further comprising

a third operation receiving module configured to receive a third input operation having a method different from the methods of the first input operation and the second input operation,

wherein, in a case where the determination module determines that the switch condition is satisfied, the switch control module switches the first mode to the second mode when an operation of selecting the second input operation is performed, and the switch control module switches the first mode to a third mode of receiving the third input operation by the third operation receiving module when an operation of selecting the third input operation is performed.

4. The mobile terminal device according to claim 1, wherein

the first operation receiving module comprises a sound input module and a sound recognition module, the sound recognition module being configured to convert a sound input to the sound input module into text data,

the first operation receiving module receives an input operation by the sound as the first input operation, and

the switch condition includes a case in which a sound volume in surroundings exceeds a predetermined level.

5. The mobile terminal device according to claim 1, wherein

the first operation receiving module comprises a first photographing module and a gesture detection module, the gesture detection module being configured to detect a gesture performed by a user based on an image photographed by the first photographing module,

the first operation receiving module receives an input operation by the gesture as the first input operation, and

the switch condition includes a case in which an ambient brightness is lower than or equal to a predetermined brightness.

6. The mobile terminal device according to claim 1, further comprising

an operation surface serving as a target of an input operation,

wherein

the first operation receiving module comprises a second photographing module and a line-of-sight detection module, the line-of-sight detection module being configured to detect a position on the operation surface to which the line of sight of a user is given based on a movement of eyes of a user photographed by the second photographing module,

the first operation receiving module receives an input operation by the line of sight as the first input operation, and

the switch condition includes a case in which the mobile terminal device is moving.

7. The mobile terminal device according to claim 1, wherein

the switch condition includes a case in which the number of false input operations exceeds a predetermined number.

8. An input operation receiving method comprising:

determining whether or not a switch condition is satisfied, the switch condition indicating that a reception of a first input operation is difficult; and

based on a determination that the switch condition is satisfied, switching an input mode from a first mode of receiving the first input operation to a second mode of receiving a second input operation, the second input operation having a method different from a method of the first input operation.