INFORMATION INPUT APPARATUS, INFORMATION INPUT METHOD, AND PROGRAM

• US 20120293456A1
• Filed: 06/10/2011
• Published: 11/22/2012
• Est. Priority Date: 06/16/2010
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Ikeda, Yoichi, Yamauchi, Masaki, Kojima, Yoshihiro, Takahashi, Tomonari, Harada, Kumi
• Granted Patent: US 8,933,910 B2
• Time in Patent Office: Days
• US Class Current: 345/174
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/0339 Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42208 Display device provided on the remote control
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control

Abstract

An information input apparatus includes: a touch pad; a touch information detecting unit which detects touch information that is information resulting from an operator contacting the touch sensor with a finger; a touch operation start position detecting unit which detects, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator; a touch operation recognition condition storage unit which stores a plurality of touch operation recognition conditions each for recognizing one of types of touch operation, in association with each of touch operation start positions; and a touch recognizing unit, which recognizes the touch operation, using the touch operation recognition conditions stored in association with the touch operation start position detected by the touch operation start position detecting unit, to determine a type of the touch operation.

Claims

1-20. -20. (canceled)

21. An information input apparatus comprising:

a touch sensor which is a sensor for inputting information;

a touch information detecting unit configured to detect touch information that is information resulting from an operator contacting the touch sensor with a finger;

a touch operation start position detecting unit configured to detect, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator;

a touch operation recognition condition storage unit configured to store a plurality of touch operation recognition conditions each for recognizing one of types of touch operation, in association with each of touch operation start positions; and

a touch recognizing unit configured to recognize the touch operation, using the touch operation recognition conditions stored in association with the touch operation start position detected by the touch operation start position detecting unit, to determine a type of the touch operation,

wherein the touch operation recognizing unit is configured to;

recognize a first touch operation that is one of the types of touch operation at a first touch operation start position among the touch operation start positions, using a first touch operation recognition condition among the touch operation recognition conditions; and

recognize the first touch operation at a second touch operation start position among the touch operation start positions, using a second touch operation recognition condition among the touch operation recognition conditions, the second touch operation start position being different from the first touch operation start position, and the second touch operation recognition condition being different from the first touch operation recognition condition.

22. The information input apparatus according to claim 21,

wherein the touch operation recognizing unit is configured to output, as a result of the recognition, the type of the touch operation and an operation amount indicating a magnitude of the touch operation, and

the type of the recognized touch operation indicates either a pointing operation for inputting a position designated by the operator or any one of gesture operations of types each for instructing execution of a predetermined specific process.

23. The information input apparatus according to claim 22,

wherein when the touch operation recognizing unit outputs the type of the gesture operation as the recognition result, the touch operation recognizing unit is configured to determine whether or not the gesture operation of the outputted type has been inputted, and when the touch operation recognizing unit determines that the gesture operation has been inputted, the touch operation recognizing unit is configured to output, as a gesture operation end position, at least one of (1) a touch position that is a position which is on an operation surface of the touch sensor being contacted by the operator and is detected when the determination is made and (2) a touch position that is a position which is on the operation surface of the touch sensor being contacted by the operator and is detected immediately before the determination, and

the touch operation start position detecting unit is configured to detect the outputted gesture operation end position as the touch operation start position.

24. The information input apparatus according to claim 21,

wherein the touch operation start position detecting unit is configured to detect, as the touch operation start position, a touch position at which the operator first contacts the touch sensor with the finger.

25. The information input apparatus according to claim 22, further comprising

a touch information series storage unit configured to store the touch information for a predetermined certain period of time,

wherein the touch operation recognizing unit includes:

a touch feature amount calculation unit configured to calculate, as a touch feature amount, at least one of a touch operation time, a touch movement distance, a touch movement speed, a touch movement acceleration, and a touch movement direction, using the touch information stored in the touch information series storage unit; and

a touch operation determining unit configured to determine the type of touch operation using the touch feature amount, based on the touch operation recognition conditions stored in the touch operation recognition condition storage unit in association with each of the touch operation start positions.

26. The information input apparatus according to claim 22,

wherein the touch sensor is a capacitance touch sensor, and

the touch information includes a touch position and a capacitance value indicating a touch strength that is a strength of a touch operation at a time of contacting.

27. The information input apparatus according to claim 25,

wherein the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with each of a plurality of subregions specified on an operation surface of the touch sensor, and

the touch operation determining unit is configured to determine whether or not the touch feature amount satisfies a touch operation recognition condition, and to determine, when the touch operation determining unit determines that the touch feature amount fails to satisfy the touch operation recognition condition, that the type of the touch operation does not indicate a first touch operation that is a touch operation of one of the types, the touch operation recognition condition being one of the touch operation recognition conditions stored in association with, among the subregions, a subregion including the touch operation start position and being for recognizing the first touch operation.

28. The information input apparatus according to claim 27, further comprising

a gesture operation end determination condition storage unit,

wherein the touch operation recognizing unit further includes a gesture operation end determining unit and a gesture end position obtaining unit,

the gesture operation end determination condition storage unit is configured to store a plurality of gesture operation end determination conditions that are conditions each for determining whether or not one of the gesture operations of the types has been ended, in association with each of the subregions,

the gesture operation end determining unit is configured to determine whether or not the touch feature amount satisfies a gesture operation end determination condition, the gesture operation end determination condition being one of the gesture operation end determination conditions stored in association with, among the subregions, the subregion including the touch operation start position and being for determining whether or not the gesture operation of the type determined by the touch operation determining unit has ended,

the gesture end position obtaining unit is configured to output, when a result of the determination shows that the touch feature amount satisfies the gesture operation end determination condition, at least one of a touch position detected when the gesture operation end determination condition is satisfied and a touch position detected prior to the satisfaction of the gesture operation end determination condition, as a gesture operation end position, and

the touch operation start position detecting unit is configured to detect the outputted gesture operation end position as the touch operation start position.

29. The information input apparatus according to claim 21, further comprising

a grip information detecting unit configured to detect grip information about the operator relative to the information input apparatus,

wherein the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with the grip information and each of the touch operation start positions, and

the touch operation recognizing unit is configured to recognize the touch operation, using the touch operation recognition conditions stored in association with the grip information and each of the touch operation start positions, to determine the type of the touch operation.

30. The information input apparatus according to claim 29,

wherein the grip information includes at least one of a type of holding hand with which the operator holds the information input apparatus, a grip position on the information input apparatus gripped by the operator, a direction angle of the information input apparatus relative to a gripping hand of the operator, and a length of the finger used for a touch operation by the operator.

31. The information input apparatus according to claim 30, further comprising

a peripheral contact sensor which is provided to at least part of a housing of the information input apparatus and detects a contact position of at least one of the hand and the finger of the operator relative to the information input apparatus,

wherein the grip information detecting unit is configured to detect the type of holding hand included in the grip information, using the contact position detected by the peripheral contact sensor,

the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with each of types of holding hand and each of the touch operation start positions, and

the touch operation recognizing unit is configured to determine the type of the touch operation, using the touch operation recognition conditions obtained from the touch operation recognition condition storage unit.

32. The information input apparatus according to claim 30, further comprising

a peripheral proximity sensor which is provided to at least part of a housing of the information input apparatus and detects a proximity state of at least one of the hand and the finger of the operator relative to the information input apparatus,

wherein the touch operation recognition condition storage unit is configured to store the touch operation recognition conditions in association with each of the subregions specified on an operation surface of the touch sensor,

the grip information detecting unit is configured to detect at least one of the grip position, the direction angle, and the length of the finger, using the proximity state detected by the peripheral proximity sensor, and

the touch operation recognizing unit is configured to calculate a difference between a predetermined reference grip state and the at least one of the detected grip position, direction angle, and length of the finger, adjust the touch operation start position so that the difference becomes smaller, and recognize the touch operation, using the touch operation recognition conditions stored in association with, among the subregions, a subregion including the adjusted touch operation start position.

33. The information input apparatus according to claim 32,

wherein the touch operation recognizing unit is configured to calculate the difference between the predetermined reference grip state and the at least one of the detected grip position, direction angle, and length of the finger, adjust the touch position so that the difference becomes smaller, determine the type of the touch operation, using the adjusted touch position, and output an operation amount indicating a magnitude of the touch operation.

34. The information input apparatus according to claim 27, further comprising:

a recognition priority level determining unit configured to determine a recognition priority level indicating a degree of recognition for each of the types of touch operation, in association with each of the subregions; and

a touch operation recognition condition update unit configured to update, according to the recognition priority level determined in association with, among the subregions, a third subregion, the touch operation recognition conditions stored in association with the third subregion,

wherein the touch operation recognition condition update unit is configured to update a threshold value included in the touch operation recognition conditions so that a type of touch operation having a higher recognition priority level is recognized more easily.

35. The information input apparatus according to claim 34, further comprising

a touch operation type frequency storage unit configured to store a type frequency that is a frequency for each of the types of touch operation recognized by the touch operation recognizing unit, in association with each of the subregions,

wherein the recognition priority level determining unit is configured to determine the recognition priority level so that a touch operation of a type having a higher type frequency has a higher recognition priority level.

36. An information input method using a touch sensor, the information input method comprising:

detecting touch information that is information resulting from an operator contacting the touch sensor with a finger;

detecting, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator; and

recognizing the touch operation, using touch operation recognition conditions stored in association with the touch operation start position detected in the detecting of a touch operation start position, to determine a type of the touch operation among types of touch operation,

wherein in the recognizing;

a first touch operation that is one of the types of touch operation at a first touch operation start position among the touch operation start positions is recognized by using a first touch operation recognition condition among the touch operation recognition conditions; and

the first touch operation at a second touch operation start position among the touch operation start positions is recognized by using a second touch operation recognition condition among the touch operation recognition conditions, the second touch operation start position being different from the first touch operation start position, and the second touch operation recognition condition being different from the first touch operation recognition condition.

37. A non-transitory computer-readable recording medium for use in a computer, the recording medium having a computer program recorded thereon for causing the computer to execute the information input method according to claim 36.

38. An integrated circuit for inputting information using a touch sensor, the integrated circuit comprising:

a touch information detecting unit configured to detect touch information that is information resulting from an operator contacting the touch sensor with a finger;

a touch operation start position detecting unit configured to detect, using the touch information, a touch operation start position that is a start position of a touch operation performed by the operator;

a touch operation recognition condition storage unit configured to store a plurality of touch operation recognition conditions each for recognizing one of types of touch operation, in association with each of touch operation start positions; and

a touch recognizing unit configured to recognize the touch operation, using the touch operation recognition conditions stored in association with the touch operation start position detected by the touch operation start position detecting unit, to determine a type of the touch operation,

wherein the touch operation recognizing unit is configured to;

recognize a first touch operation that is one of the types of touch operation at a first touch operation start position among the touch operation start positions, using a first touch operation recognition condition among the touch operation recognition conditions; and

recognize the first touch operation at a second touch operation start position among the touch operation start positions, using a second touch operation recognition condition among the touch operation recognition conditions, the second touch operation start position being different from the first touch operation start position, and the second touch operation recognition condition being different from the first touch operation recognition condition.