Information input apparatus, information input method, and program

• US 9,335,878 B2
• Filed: 11/26/2014
• Issued: 05/10/2016
• Est. Priority Date: 06/16/2010
• Status: Expired due to Fees

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Ikeda, Yoichi, Yamauchi, Masaki, Kojima, Yoshihiro, Takahashi, Tomonari, Harada, Kumi
• Primary Examiner(s): Dharia, Prabodh M
• Application Number:
  US14/554,602
• Publication Number:
  US 20150077395A1
• Time in Patent Office: 531 Days
• Field of Search: 345/90, 345156-184, 345/684, 178/18.03, 715/2, 715/765, 341/176, 349/12
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/0339 Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42208 Display device provided on the remote control
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control

Abstract

An information input apparatus includes: a touch pad; a touch information detecting unit which detects touch information that is information resulting from an operator contacting the touch sensor with a finger; a touch operation start position detecting unit which detects, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator; a touch operation recognition condition storage unit which stores a plurality of touch operation recognition conditions each for recognizing one of types of touch operation, in association with each of touch operation start positions; and a touch recognizing unit, which recognizes the touch operation, using the touch operation recognition conditions stored in association with the touch operation start position detected by the touch operation start position detecting unit, to determine a type of the touch operation.

Claims

1. An information input apparatus comprising:

a touch sensor which is a sensor for inputting information;

a touch information detecting unit configured to detect touch information that is information resulting from an operator contacting the touch sensor with a finger;

a touch operation start position detecting unit configured to detect, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator;

a touch operation recognition condition storage unit configured to store a plurality of touch operation recognition conditions each for recognizing one of types of touch operation, in association with each of touch operation start positions; and

a touch operation recognizing unit configured to recognize the touch operation, using the touch operation recognition conditions stored in association with the touch operation start position detected by the touch operation start position detecting unit, to determine a type of the touch operation; and

a grip information detecting unit configured to detect grip information about the operator relative to the information input apparatus,

wherein the grip information includes at least one of a type of holding hand with which the operator holds the information input apparatus, a grip position on the information input apparatus gripped by the operator, a direction angle of the information input apparatus relative to a gripping hand of the operator, and a length of the finger used for a touch operation by the operator, and

the touch operation recognizing unit is configured to calculate a difference between a predetermined reference grip state and the at least one of the detected grip position, direction angle, and length of the finger, adjust the touch operation start position so that the difference becomes smaller, determine the type of the touch operation, using the adjusted touch operation start position, and output an operation amount indicating a magnitude of the touch operation.

2. The information input apparatus according to claim 1,

wherein the touch operation recognizing unit is configured to output, as a result of the recognition, the type of the touch operation and an operation amount indicating a magnitude of the touch operation, and

the type of the recognized touch operation indicates either a pointing operation for inputting a position designated by the operator or any one of gesture operations of types each for instructing execution of a predetermined specific process.

3. The information input apparatus according to claim 2,

wherein when the touch operation recognizing unit outputs the type of the gesture operation as the recognition result, the touch operation recognizing unit is configured to determine whether or not the gesture operation of the outputted type has been inputted, and when the touch operation recognizing unit determines that the gesture operation has been inputted, the touch operation recognizing unit is configured to output, as a gesture operation end position, at least one of (1) a touch position that is a position which is on an operation surface of the touch sensor being contacted by the operator and is detected when the determination is made and (2) a touch position that is a position which is on the operation surface of the touch sensor being contacted by the operator and is detected immediately before the determination, and

the touch operation start position detecting unit is configured to detect the outputted gesture operation end position as the touch operation start position.

4. The information input apparatus according to claim 2, further comprising

a touch information series storage unit configured to store the touch information for a predetermined certain period of time,

wherein the touch operation recognizing unit includes:

a touch feature amount calculation unit configured to calculate, as a touch feature amount, at least one of a touch operation time, a touch movement distance, a touch movement speed, a touch movement acceleration, and a touch movement direction, using the touch information stored in the touch information series storage unit; and

a touch operation determining unit configured to determine the type of touch operation using the touch feature amount, based on the touch operation recognition conditions stored in the touch operation recognition condition storage unit in association with each of the touch operation start positions.

5. The information input apparatus according to claim 4,

wherein the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with each of a plurality of subregions specified on an operation surface of the touch sensor, and

the touch operation determining unit is configured to determine whether or not the touch feature amount satisfies a touch operation recognition condition, and to determine, when the touch operation determining unit determines that the touch feature amount fails to satisfy the touch operation recognition condition, that the type of the touch operation does not indicate a first touch operation that is a touch operation of one of the types, the touch operation recognition condition being one of the touch operation recognition conditions stored in association with, among the subregions, a subregion including the touch operation start position and being for recognizing the first touch operation.

6. The information input apparatus according to claim 5, further comprising

a gesture operation end determination condition storage unit,

wherein the touch operation recognizing unit further includes a gesture operation end determining unit and a gesture end position obtaining unit,

the gesture operation end determination condition storage unit is configured to store a plurality of gesture operation end determination conditions that are conditions each for determining whether or not one of the gesture operations of the types has been ended, in association with each of the subregions,

the gesture operation end determining unit is configured to determine whether or not the touch feature amount satisfies a gesture operation end determination condition, the gesture operation end determination condition being one of the gesture operation end determination conditions stored in association with, among the subregions, the subregion including the touch operation start position and being for determining whether or not the gesture operation of the type determined by the touch operation determining unit has ended,

the gesture end position obtaining unit is configured to output, when a result of the determination shows that the touch feature amount satisfies the gesture operation end determination condition, at least one of a touch position detected when the gesture operation end determination condition is satisfied and a touch position detected prior to the satisfaction of the gesture operation end determination condition, as a gesture operation end position, and

the touch operation start position detecting unit is configured to detect the outputted gesture operation end position as the touch operation start position.

7. The information input apparatus according to claim 5, further comprising:

a recognition priority level determining unit configured to determine a recognition priority level indicating a degree of recognition for each of the types of touch operation, in association with each of the subregions; and

a touch operation recognition condition update unit configured to update, according to the recognition priority level determined in association with, among the subregions, a third subregion, the touch operation recognition conditions stored in association with the third subregion,

wherein the touch operation recognition condition update unit is configured to update a threshold value included in the touch operation recognition conditions so that a type of touch operation having a higher recognition priority level is recognized more easily.

8. The information input apparatus according to claim 7, further comprising

a touch operation type frequency storage unit configured to store a type frequency that is a frequency for each of the types of touch operation recognized by the touch operation recognizing unit, in association with each of the subregions,

wherein the recognition priority level determining unit is configured to determine the recognition priority level so that a touch operation of a type having a higher type frequency has a higher recognition priority level.

9. The information input apparatus according to claim 1, further comprising

a peripheral contact sensor which is provided to at least part of a housing of the information input apparatus and detects a contact position of at least one of the hand and the finger of the operator relative to the information input apparatus,

wherein the grip information detecting unit is configured to detect the type of holding hand included in the grip information, using the contact position detected by the peripheral contact sensor,

the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with each of types of holding hand and each of the touch operation start positions, and

the touch operation recognizing unit is configured to determine the type of the touch operation, using the touch operation recognition conditions obtained from the touch operation recognition condition storage unit.

10. The information input apparatus according to claim 1, further comprising

a peripheral proximity sensor which is provided to at least part of a housing of the information input apparatus and detects a proximity state of at least one of the hand and the finger of the operator relative to the information input apparatus,

wherein the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with each of a plurality of subregions specified on an operation surface of the touch sensor,

the grip information detecting unit is configured to detect at least one of the grip position, the direction angle, and the length of the finger, using the proximity state detected by the peripheral proximity sensor, and

the touch operation recognizing unit is configured to calculate the difference between the predetermined reference grip state and the at least one of the detected grip position, direction angle, and length of the finger, adjust the touch operation start position so that the difference becomes smaller, and recognize the touch operation, using the touch operation recognition conditions stored in association with, among the subregions, a subregion including the adjusted touch operation start position.

11. An information input method using a touch sensor of an information input apparatus, the information input method comprising:

detecting touch information that is information resulting from an operator contacting the touch sensor with a finger;

detecting, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator;

recognizing the touch operation, using touch operation recognition conditions stored in association with the touch operation start position detected in the detecting of a touch operation start position, to determine a type of the touch operation among types of touch operation; and

detecting grip information about the operator relative to the information input apparatus;

wherein the grip information includes at least one of a type of holding hand with which the operator holds the information input apparatus, a grip position on the information input apparatus gripped by the operator, a direction angle of the information input apparatus relative to a gripping hand of the operator, and a length of the finger used for a touch operation by the operator, and

said recognizing the touch operation further comprises calculating a difference between a predetermined reference grip state and the at least one of the detected grip position, direction angle, and length of the finger, adjusting the touch operation start position so that the difference becomes smaller, determining the type of the touch operation, using the adjusted touch operation start position, and outputting an operation amount indicating a magnitude of the touch operation.

12. The information input method according to claim 11,

wherein said recognizing the touch operation further comprises outputting, as a result of the recognition, the type of the touch operation and an operation amount indicating a magnitude of the touch operation, and

the type of the recognized touch operation indicates either a pointing operation for inputting a position designated by the operator or any one of gesture operations of types each for instructing execution of a predetermined specific process.

13. The information input method according to claim 12,

wherein said recognizing the touch operation further comprises:

determining, when the type of the gesture operation is output as the recognition result, whether or not the gesture operation of the outputted type has been inputted, and

outputting, when it is determined that the gesture operation has been inputted, as a gesture operation end position, at least one of (1) a touch position that is a position which is on an operation surface of the touch sensor being contacted by the operator and is detected when the determination is made and (2) a touch position that is a position which is on the operation surface of the touch sensor being contacted by the operator and is detected immediately before the determination, and

said detecting a touch operation start position further comprises detecting the outputted gesture operation end position as the touch operation start position.

14. The information input method according to claim 12, further comprising

storing the touch information for a predetermined certain period of time,

wherein said recognizing the touch operation further comprises:

calculating, as a touch feature amount, at least one of a touch operation time, a touch movement distance, a touch movement speed, a touch movement acceleration, and a touch movement direction, using the touch information stored in the touch information series storage unit; and

determining the type of touch operation using the touch feature amount, based on the touch operation recognition conditions stored in association with each of the touch operation start positions.

15. The information input method according to claim 14,

wherein the touch operation recognition conditions are stored in association with each of a plurality of subregions specified on an operation surface of the touch sensor, and

said determining the type of touch operation further comprises determining whether or not the touch feature amount satisfies a touch operation recognition condition, and determining, when it is determined that the touch feature amount fails to satisfy the touch operation recognition condition, that the type of the touch operation does not indicate a first touch operation that is a touch operation of one of the types, the touch operation recognition condition being one of the touch operation recognition conditions stored in association with, among the subregions, a subregion including the touch operation start position and being for recognizing the first touch operation.

16. The information input method according to claim 15,

wherein said recognizing the touch operation further comprises:

determining whether or not the touch feature amount satisfies a gesture operation end determination condition, the gesture operation end determination condition being one of a plurality of gesture operation end determination conditions stored in association with, among the subregions, the subregion including the touch operation start position and being for determining whether or not a gesture operation of the type determined in said determining the type of touch operation has ended; and

outputting, when a result of the determination shows that the touch feature amount satisfies the gesture operation end determination condition, at least one of a touch position detected when the gesture operation end determination condition is satisfied and a touch position detected prior to the satisfaction of the gesture operation end determination condition, as a gesture operation end position, wherein

said detecting a touch operation start position further comprises detecting the outputted gesture operation end position as the touch operation start position.

17. The information input method according to claim 15, further comprising:

determining a recognition priority level indicating a degree of recognition for each of the types of touch operation, in association with each of the subregions; and

updating, according to the recognition priority level determined in association with, among the subregions, a third subregion, the touch operation recognition conditions stored in association with the third subregion,

wherein said updating further comprises updating a threshold value included in the touch operation recognition conditions so that a type of touch operation having a higher recognition priority level is recognized more easily.

18. The information input method according to claim 17, further comprising

storing a type frequency that is a frequency for each of the types of touch operation recognized in said recognizing the touch operation, in association with each of the subregions,

wherein said determining a recognition priority level further comprises determining the recognition priority level so that a touch operation of a type having a higher type frequency has a higher recognition priority level.

19. The information input method according to claim 11, further comprising

detecting a contact position of at least one of the hand and the finger of the operator relative to the information input apparatus,

wherein said detecting grip information further comprises detecting the type of holding hand included in the grip information, using the contact position detected in said detecting, and

said recognizing the touch operation comprises determining the type of the touch operation, using touch operation recognition conditions stored in association with each of types of holding hand and each of the touch operation start positions.

20. The information input method according to claim 11, further comprising

detecting a proximity state of at least one of the hand and the finger of the operator relative to the information input apparatus,

wherein said detecting grip information further comprises detecting at least one of the grip position, the direction angle, and the length of the finger, using the proximity state detected in said detecting, and

said recognizing the touch operation comprises calculating the difference between the predetermined reference grip state and the at least one of the detected grip position, direction angle, and length of the finger, adjusting the touch operation start position so that the difference becomes smaller, and recognizing the touch operation, using touch operation recognition conditions stored in association with, among a plurality of subregions specified on an operation surface of the touch sensor, a subregion including the adjusted touch operation start position.