User input apparatus, computer connected to user input apparatus, method of controlling computer connected to user input apparatus, and storage medium

• US 20040243747A1
• Filed: 07/06/2004
• Published: 12/02/2004
• Est. Priority Date: 05/21/2001
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi
• Granted Patent: US 8,773,351 B2
• Time in Patent Office: Days
• US Class Current: 710/72
• CPC Class Codes: G02F 1/13338 Input devices, e.g. touch panels
• CPC Class Codes: G06F 1/16 Constructional details or arrangements
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/83 input devices, e.g. keyboards, mice or controllers thereof
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04111 Cross over in capacitive digitiser, i.e. details of structures for connecting electrodes of the sensing pattern where the connections cross each other, e.g. bridge structures comprising an insulating layer, or vias through substrate
• CPC Class Codes: G06F 2203/04112 Electrode mesh in capacitive digitiser: electrode for touch sensing is formed of a mesh of very fine, normally metallic, interconnected lines that are almost invisible to see. This provides a quite large but transparent electrode surface, without need for ITO or similar transparent conductive material
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/0445 using two or more layers of sensing electrodes, e.g. using two layers of electrodes separated by a dielectric layer
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A user input apparatus is provided with user input means for the user to input data or a command by using the user'"'"'s human body, and use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body. A computer connected to the user input apparatus changes the operation of the application being executed by application execution means, according to a detection result obtained by the use-form detection means. Therefore, input operations can be performed without inconvenience even if the user cannot use one hand due to another work.

Claims

1-42. -42. (Canceled)

43. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body, and

characterized in that

the user input means is formed of a combination of a keyboard and a mouse; and

the use-form detection means determines whether a first use mode in which the user can perform key inputs by using both hands or a second use mode in which the user uses the mouse by one hand and can perform key inputs only by the other hand is used.

44. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body, and,

characterized in that

the use-form detection means determines whether an another-terminal use mode in which the user is using a portable telephone or another information terminal by using at least one hand is used.

45. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body, and,

characterized in that

the user input means is a keyboard;

the use-form detection means comprises;

a transmission electrode disposed almost at the center of the keyboard;

a transmitter for supplying alternating current for transmission to the transmission electrode;

a first receiving electrode disposed almost at the left end of the keyboard;

a second receiving electrode disposed almost at the right end of the keyboard;

a first receiver for receiving alternating current flowing through the first receiving electrode; and

a second receiver for receiving alternating current flowing through the second receiving electrode;

a first capacitor-equivalent circuit equivalent to a capacitor is formed between the transmission electrode and the first receiving electrode, and a second capacitor-equivalent circuit equivalent to a capacitor is formed between the transmission electrode and the second receiving electrode;

a first subordinate capacitor-equivalent circuit is formed in parallel to the first capacitor-equivalent circuit when a human body approaches the left-hand side of the keyboard, or a second subordinate capacitor-equivalent circuit is formed in parallel to the second capacitor-equivalent circuit when a human body approaches the right-hand side of the keyboard; and

it is determined whether the user is using the left-hand side and/or right-hand side of the keyboard, according to a change in alternating current flowing through the first and/or second capacitor-equivalent circuit, the change caused by a change in the capacitance of the first subordinate or second subordinate capacitor-equivalent circuit, generated according to the extent of approximation of the human body.

46. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body, and,

characterized in that

the user input means is a mouse;

the use-form detection means comprises;

a transmission electrode disposed almost at one end of the mouse;

a transmitter for supplying alternating current for transmission to the transmission electrode;

a receiving electrode disposed almost at the other end of the mouse; and

a receiver for receiving alternating current flowing through the receiving electrode;

a first capacitor-equivalent circuit equivalent to a capacitor is formed between the transmission electrode and the receiving electrode;

a second capacitor-equivalent circuit is formed in parallel to the first capacitor-equivalent circuit when a human body approaches the upper surface of the mouse; and

it is determined whether the user is using the mouse, according to a change in alternating current flowing through the first capacitor-equivalent circuit, the change caused by a change in the capacitance of the second capacitor-equivalent circuit, generated according to the extent of approximation of the human body.

47. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body, and,

characterized in that

the use-form detection means comprises;

modulation means for modulating the original signal to generate an output signal;

transmission means formed of a first electrically conductive member and disposed on the user input means so as to be exposed to the outside to be able to transmit the output signal;

receiving means formed of a second electrically conductive member and disposed on an external unit so as to be exposed to the outside to be able to receive the output signal; and

demodulation means for demodulating the received signal, and

signal transfer between the transmission means and the receiving means is enabled when a human body contacts the first and second electrically conductive members.

48. A user input apparatus according to claim 47, characterized in that

the user input means is a keyboard, and the external unit is a portable telephone or another information terminal, and

the use-form detection means determines that one hand of the user is placed on the keyboard and the other hand is used to hold the information terminal, through the signal transfer between the transmission means and the receiving means.

49. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting a form in which the user uses the user input means by the user'"'"'s human body, and,

characterized in that

the use-form detection means comprises;

a plurality of line-shaped transmission electrodes;

a transmitter for supplying alternating current for transmission to each of the transmission electrodes;

a plurality of line-shaped receiving electrodes disposed so as not to contact each of the transmission electrodes; and

a receiver for receiving alternating current flowing through the receiving electrodes;

a use-form detection area where the plurality of transmission electrodes and the plurality of receiving electrodes intersect is superposed on a user input area of the user input apparatus;

a first capacitor-equivalent circuit equivalent to a capacitor is formed at each of the intersections of the transmission electrodes and the receiving electrodes;

a second capacitor-equivalent circuit is formed in parallel to the first capacitor-equivalent circuit when a human body approaches the intersection of a transmission electrode and a receiving electrode; and

the form of use in which the user uses the user input means by the user'"'"'s human body is detected according to a change in alternating current flowing through the first capacitor-equivalent circuit, the change caused by a change in the capacitance of the second capacitor-equivalent circuit, generated according to the extent of approximation of the human body.

50. A user input apparatus for receiving data or a command input by the user to a computer, characterized by comprising:

user input means for the user to input data or a command by using the user'"'"'s human body; and

use-form detection means for detecting the form of use as a multi-dimensional value in response to an operation applied by the user'"'"'s human body to the user input means.

51. A computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

application execution means for executing a predetermined application;

use-form detection means for detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

operation control means for changing the operation of the application being executed by the application execution means, according to a detection result obtained by the use-form detection means, and

characterized in that

the user input apparatus is formed of a combination of a keyboard and a mouse;

the use-form detection means determines whether a first use mode in which the user can perform key inputs by using both hands or a second use mode in which the user uses the mouse by the left hand and can perform key inputs only by the other hand is used; and

the operation control means assigns a usual text character to each key of the keyboard in the first use mode, and assigns command functions to left-hand-operation keys of the keyboard in the second use mode.

52. A computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

application execution means for executing a predetermined application;

use-form detection means for detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

operation control means for changing the operation of the application being executed by the application execution means, according to a detection result obtained by the use-form detection means, and

characterized in that

the use-form detection means determines whether an another-terminal use mode in which the user is using a portable telephone or another information terminal by using at least one hand; and

the operation control means activates an application for driving the another terminal in response to the detection of the another-terminal use mode by the use-form detection means.

53. A computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

application execution means for executing a predetermined application;

use-form detection means for detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

operation control means for changing the operation of the application being executed by the application execution means, according to a detection result obtained by the use-form detection means, and

characterized in that

the user input apparatus is a keyboard;

the use-form detection means comprises;

a transmission electrode disposed almost at the center of the keyboard;

a transmitter for supplying alternating current for transmission to the transmission electrode;

a first receiving electrode disposed almost at the left end of the keyboard;

a second receiving electrode disposed almost at the right end of the keyboard;

a first receiver for receiving alternating current flowing through the first receiving electrode; and

a second receiver for receiving alternating current flowing through the second receiving electrode;

a first capacitor-equivalent circuit equivalent to a capacitor is formed between the transmission electrode and the first receiving electrode, and a second capacitor-equivalent circuit equivalent to a capacitor is formed between the transmission electrode and the second receiving electrode;

a first subordinate capacitor-equivalent circuit is formed in parallel to the first capacitor-equivalent circuit when a human body approaches the left-hand side of the keyboard, or a second subordinate capacitor-equivalent circuit is formed in parallel to the second capacitor-equivalent circuit when a human body approaches the right-hand side of the keyboard;

it is determined whether a first use mode in which the user can perform key inputs by using both hands or a second use mode in which the user can perform key inputs by using the left hand only is used, according to a change in the alternating current flowing through the first or second capacitor-equivalent circuit, the change caused by a change in the capacitance of the first subordinate or second subordinate capacitor-equivalent circuit, generated according to the extent of approximation of the human body; and

the operation control means assigns a usual text character to each key of the keyboard in the first use mode, and assigns command functions to left-hand-operation keys of the keyboard in the second use mode.

54. A computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

application execution means for executing a predetermined application;

use-form detection means for detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

operation control means for changing the operation of the application being executed by the application execution means, according to a detection result obtained by the use-form detection means, and

characterized in that

the user input means is formed of a combination of a keyboard and a mouse;

the use-form detection means comprises;

a transmission electrode disposed almost at one end of the mouse;

a transmitter for supplying alternating current for transmission to the transmission electrode;

a receiving electrode disposed almost at the other end of the mouse; and

a receiver for receiving alternating current flowing through the receiving electrode;

a first capacitor-equivalent circuit equivalent to a capacitor is formed between the transmission electrode and the receiving electrode, a second capacitor-equivalent circuit is formed in parallel to the first capacitor-equivalent circuit when a human body approaches the upper surface of the mouse, and the use-form detection means determines whether the user is using the mouse, according to a change in alternating current flowing through the first capacitor-equivalent circuit, the change caused by a change in the capacitance of the second capacitor-equivalent circuit, generated according to the extent of approximation of the human body; and

the operation control means assigns command functions to left-hand-operation keys of the keyboard when it is determined that the user is using the mouse.

55. A computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

application execution means for executing a predetermined application;

use-form detection means for detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

operation control means for changing the operation of the application being executed by the application execution means, according to a detection result obtained by the use-form detection means, and

characterized in that

the use-form detection means comprises;

modulation means for modulating the original signal to generate an output signal;

transmission means formed of a first electrically conductive member and disposed on the user input means so as to be exposed to the outside to be able to transmit the output signal;

receiving means formed of a second electrically conductive member and disposed on an external unit so as to be exposed to the outside to be able to receive the output signal; and

demodulation means for demodulating the received signal; and

the use-form detection means determines that the user is using the external unit when signal transfer between the transmission means and the receiving means is enabled by the contacts of a human body to the first and second electrically conductive members; and

the operation control means activates an application for the external unit when the use-form detection means detects the use of the external unit.

56. A computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

application execution means for executing a predetermined application;

use-form detection means for detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

operation control means for changing the operation of the application being executed by the application execution means, according to a detection result obtained by the use-form detection means, and

characterized in that

the use-form detection means comprises;

a plurality of line-shaped transmission electrodes;

a transmitter for supplying alternating current for transmission to each of the transmission electrodes;

a plurality of line-shaped receiving electrodes disposed so as not to contact each of the transmission electrodes; and

a receiver for receiving alternating current flowing through the receiving electrodes;

a use-form area where the plurality of transmission electrodes and the plurality of receiving electrodes intersect is superposed on a user input area of the user input apparatus;

a first capacitor-equivalent circuit equivalent to a capacitor is formed at each of the intersections of the transmission electrodes and the receiving electrodes;

a second capacitor-equivalent circuit is formed in parallel to the first capacitor-equivalent circuit when a human body approaches the intersection of a transmission electrode and a receiving electrode;

the form of use in which the user uses the user input apparatus by the user'"'"'s human body is detected as a multi-dimensional value according to a change in alternating current flowing through the first capacitor-equivalent circuit, the change caused by a change in the capacitance of the second capacitor-equivalent circuit, generated according to the extent of approximation of the human body; and

the operation control means executes processing which uses the multi-dimensional value.

57. A computer connected to a user input apparatus, according to claim 56, characterized in that

the operation control means compares and verifies a specified input operation performed by the user and a multi-dimensional value detected in the specified input operation to execute user authentication processing.

58. A control method for a computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

a use-form detection step of detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

an operation control step of changing the operation of the application being executed by the application execution means, according to a detection result obtained in the use-form detection step, and

characterized in that

the user input apparatus is formed of a combination of a keyboard and a mouse;

in the use-form detection step, it is determined whether a first use mode in which the user can perform key inputs by using both hands or a second use mode in which the user uses the mouse by the left hand and can perform key inputs only by the other hand is used; and

in the operation control step, a usual text character is assigned to each key of the keyboard in the first use mode, and command functions are assigned to left-hand-operation keys of the keyboard in the second use mode.

59. A control method for a computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

a use-form detection step of detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

an operation control step of changing the operation of the application being executed by the application execution means, according to a detection result obtained in the use-form detection step, and

characterized in that

in the use-form detection step, it is determined whether an another-terminal use mode in which the user is using a portable telephone or another information terminal by using at least one hand is used; and

in the operation control step, an application for driving the another terminal is activated in response to the detection of the another-terminal use mode in the use-form detection step.

60. A control method for a computer connected to a user input apparatus for the user to input data or a command by using the human body, characterized by comprising:

a use-form detection step of detecting a form in which the user uses the user input apparatus by the user'"'"'s human body; and

an operation control step of changing the operation of the application being executed by the application execution means, according to a detection result obtained in the use-form detection step, and

characterized in that

in the use-form detection step, the form of use in which the user uses the user input apparatus by the user'"'"'s human body is detected as a multi-dimensional value; and

in the operation control step, processing which uses the multi-dimensional value is executed.

61. A control method for a computer connected to a user input apparatus, according to claim 60, characterized in that

in the operation control step, a specified input operation performed by the user and a multi-dimensional value detected in the specified input operation are compared and verified to execute user authentication processing.

62. A user input apparatus for receiving data or a command input by the user to an information processing apparatus, characterized by comprising:

user input means for the user to perform an input operation by using a dielectric object, including the human body; and

detection means for detecting the position of a contact or an approach of the dielectric object and another state in a contact or approach state of the dielectric object as inputs in the input operation applied to the user input means, and

characterized in that

the another state comprises a multi-dimensional value related to the input operation applied by the dielectric object to the user input means.

63. A user input apparatus according to claim 62, characterized in that

the user input means comprises a capacitor of which the capacitance changes according to an approach or a contact of the dielectric object, and

the detection means detects the input operation according to a change in the capacitance.

64. A user input apparatus according to claim 63, characterized in that

the user input means comprises:

a plurality of transmission electrodes;

a transmitter for supplying alternating current to each of the transmission electrodes;

a plurality of receiving electrodes disposed so as not to contact each of the transmission electrodes; and

a receiver for receiving alternating current flowing through each of the receiving electrodes, and

the capacitor is formed at each of the intersections of the transmission electrodes and the receiving electrodes.

65. A user input apparatus according to claim 64, characterized in that

the user input means integrates detection values obtained according to changes in the capacitance of the capacitors formed at a plurality of the intersections.

66. A user input apparatus according to claim 64, characterized in that

the transmitter supplies the alternating current to the plurality of transmission electrodes in a time-division manner.

67. A user input apparatus according to claim 64, characterized in that

the user input means detects a change in the capacitance according to a change in the intensity of the alternating current received by the receiver.

68. A user input apparatus according to claim 62, characterized by

further comprising use-form detection means for detecting the form of use applied to the user input means.

69. A user input apparatus according to claim 68, characterized in that

the user input means is a keyboard;

and

the use-form detection means determines whether the user is using the keyboard in a usual mode in which the user can perform key inputs by using both hands or in an unusual mode in which the user can perform key inputs by using one hand only.

70. A user input apparatus according to claim 62, characterized by

further comprising authentication means for performing user authentication processing according to the multi-dimensional value.

71. A user input apparatus according to claim 62, characterized in that

the user input means comprises a keyboard and/or a mouse.

72. A user input apparatus according to claim 62, characterized in that

the input operation applied to the user input means is related to a data input or a command input to an application program running on the information processing apparatus.

73. A user input apparatus for receiving data, a command, or others input by the user to an information processing apparatus, characterized by comprising:

user input means for the user to perform an input operation by using a dielectric object, including the human body; and

detection means for determining the position of a contact or an approach of the dielectric object and how close the dielectric object has approached the user input apparatus or whether the dielectric object has contacted the user input apparatus, as inputs in the input operation applied to the user input means.

74. A user input apparatus for receiving data or a command input by the user to an information processing apparatus, characterized by comprising:

user input means for the user to perform an input operation by using a dielectric object, including the human body; and

detection means for detecting the position of a contact or an approach of the dielectric object and another state in a contact or approach state of the dielectric object as inputs in the input operation applied to the user input means, and

characterized in that

the detection means detects the position of a contact or an approach and the another state for each of a plurality of dielectric objects independently.

75. A user input apparatus according to claim 74, characterized in that

the detection means distinguishes the plurality of dielectric objects through integration processing of the positions of contacts or approaches.