ELECTRONIC DEVICE HAVING MULTI-FUNCTIONAL HUMAN INTERFACE

• US 20200012354A1
• Filed: 09/01/2017
• Published: 01/09/2020
• Est. Priority Date: 05/01/2016
• Status: Active Grant

• Current Assignee: Mokibo Incorporated
• Original Assignee: Innopresso, Inc.
• Inventors: CHO, Eunhyung
• Granted Patent: US 10,635,192 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/0213 Arrangements providing an integrated pointing device in a keyboard, e.g. trackball, mini-joystick for pointing devices integrated in a laptop computer G06F1/169; joysticks G05G9/047; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/0219 Special purpose keyboards
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/08 Cursor circuits

Abstract

A multi-functional human interface device includes a control unit and a first multi-functional input button. The first multi-functional input button includes a cover unit configured to receive a touch input of a user'"'"'s finger, an electrode unit including a transmitter and a receiver to form an electric field, an elastic unit configured to move from a first height to a second height when a first pressure is applied from the cover unit and configured to move back to the first height when the first pressure from the cover unit is released, and a switch unit configured to generate an electric signal representing an input of a predetermined letter.

Claims

1. An electronic device having a multi-functional human interface with a keyboard layout, the electronic device comprising:

a plurality of buttons arranged according to the keyboard layout and each having a keycap configured to receive a vertical push input from a user;

a button body combined with a lower portion of the keycap and configured to be moved upward or downward according to the push input; and

an electrode interposed between the keycap and the button body and configured to receive a touch input from the user by means of a first block group composed of blocks that are electrically connected in a first direction, which is any one of a length direction and a width direction of the keyboard layout, and a second block group composed of blocks that are electrically connected in a second direction different from the first direction, which is the other one of the length direction and the width direction of the keyboard layout;

a plurality of switches arranged in lower portions of the plurality of buttons according to the keyboard layout and each configured to acquire a key input when the button body is moved downward;

an electric connection member configured to electrically connect the first block group among buttons arranged in the first direction to form a drive line, which applies a drive signal for inducing capacitance in the electrode, and electrically connect the second block group among buttons arranged in the second direction to form a scan line, which receives a scan signal for detecting a change caused by the touch input in the capacitance induced in the electrode by the drive signal, in order to electrically connect the electrode among the buttons; and

a controller configured to acquire a key value allocated to a button corresponding to a switch that acquires the key input and acquire a touch coordinate value calculated using the change in the capacitance of the electrode corresponding to the touch input,

wherein the controller operates in a keyboard mode in which the touch input is ignored and only a keyboard input reflecting a key value corresponding to the push input is output, a mouse mode in which a push input relative to at least some of the plurality of buttons is ignored and a mouse input indicating a movement distance and a movement direction of a pointer is output by means of a variation of the touch coordinate value, or a digitizer mode in which a push input relative to at least some of the plurality of buttons is output and a digitizer input indicating a position of the pointer is output by means of the touch coordinate value.

2. The electronic device of claim 1, wherein the controller calculates the variation of the touch coordinate value in the mouse mode through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period, and outputs the digitizer input from the touch coordinate value in the digitizer mode in consideration of a matching relationship between a screen region of a display outputting the pointer and the touch coordinate value.

3. The electronic device of claim 2, wherein the controller sets the matching relationship so that the position of the pointer on the screen region corresponds to a touch coordinate value of a touch input that is first applied after the digitizer mode is entered.

4. The electronic device of claim 1, wherein the controller calculates the variation of the touch coordinate value in the mouse mode through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period, and acquires the digitizer input in the digitizer mode through the current touch coordinate value and a touch coordinate value of a touch input that is first applied after the digitizer mode is entered.

5. The electronic device of claim 1, wherein the controller determines whether the mouse mode is a left-hand mode or a right-hand mode when the mouse mode is entered, activates only electrodes of buttons located at a left side of an entire touch sensing region when the mouse mode is the left-hand mode, activates only electrodes of buttons located at a right side of the entire touch sensing region when the mouse mode is the right-hand mode, and activates all of the electrodes of the buttons located within the entire touch sensing region when the digitizer mode is entered.

6. The electronic device of claim 1, wherein the controller sets a touch region matched to a screen region in which the pointer is displayed so that a touch coordinate value of a touch input that is first applied after the digitizer mode is entered is matched to a position of the pointer on the screen region.

7. The electronic device of claim 6, wherein, when a touch input is generated in a region outside the touch region that is within the entire touch sensing region, the controller resets the touch region according to the touch input applied to the outside region.

8. The electronic device of claim 1, wherein the controller differently sets a touch region matched to a screen region in which the pointer is displayed according to a touch input that is first applied after the digitizer mode is entered.

9. An electronic device having a multi-functional human interface with a keyboard layout, the electronic device comprising:

a plurality of buttons arranged according to the keyboard layout and each having a keycap configured to receive a vertical push input from a user;

a button body combined with a lower portion of the keycap and configured to be moved upward or downward according to the push input; and

an electrode interposed between the keycap and the button body and configured to receive a touch input from the user by means of a first block group composed of blocks that are electrically connected in a first direction, which is any one of a length direction and a width direction of the keyboard layout, and a second block group composed of blocks that are electrically connected in a second direction different from the first direction, which is the other one of the length direction and the width direction of the keyboard layout;

a plurality of switches arranged in lower portions of the plurality of buttons according to the keyboard layout and each configured to acquire a key input when the button body is moved downward;

an electric connection member configured to electrically connect the first block group among buttons arranged in the first direction to form a drive line, which applies a drive signal for inducing capacitance in the electrode, and electrically connect the second block group among buttons arranged in the second direction to form a scan line, which receives a scan signal for detecting a change caused by the touch input in the capacitance induced in the electrode by the drive signal, in order to electrically connect the electrode among the buttons; and

a controller configured to acquire a key value allocated to a button corresponding to a switch that acquires the key input and acquire a touch coordinate value calculated using the change in the capacitance of the electrode corresponding to the touch input,

wherein the controller operates in a keyboard mode in which the touch input is output and only a keyboard input reflecting a key value corresponding to the push input is output, and a touch mode in which a push input relative to at least some of the plurality of buttons is ignored and a pointer control signal reflecting the touch coordinate value is output, and

wherein the controller calculates a touch coordinate value corresponding to the touch input on the basis of the scan signal when operating in the touch mode, acquires a relative coordinate value from the touch coordinate value when the touch mode is a mouse mode, and acquires an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode.

10. The electronic device of claim 9,

wherein the relative coordinate value is calculated through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period, and

wherein the absolute coordinate value is calculated using the touch coordinate value in consideration of a matching relationship between a touch region and a screen region in which a pointer is displayed.

11. The electronic device of claim 10, wherein the controller sets the matching relationship on the basis of a touch coordinate value of a touch input that is first applied after the digitizer mode is entered.

12. The electronic device of claim 9,

wherein the relative coordinate value is calculated through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period, and

wherein the absolute coordinate value is calculated through a difference operation between the touch coordinate value during the current scan period and a touch coordinate value that is first applied after the digitizer mode is entered.

13. A control method of an electronic device having a multi-functional human interface with a keyboard layout, wherein the electronic device includes:

a plurality of buttons arranged according to the keyboard layout and each having a keycap configured to receive a vertical push input from a user;

a button body combined with a lower portion of the keycap and configured to be moved upward or downward according to the push input; and

an electrode interposed between the keycap and the button body and configured to receive a touch input from the user by means of a first block group composed of blocks that are electrically connected in a first direction, which is any one of a length direction and a width direction of the keyboard layout, and a second block group composed of blocks that are electrically connected in a second direction different from the first direction, which is the other one of the length direction and the width direction of the keyboard layout;

a plurality of switches arranged in lower portions of the plurality of buttons according to the keyboard layout and each configured to acquire a key input when the button body is moved downward;

an electric connection member configured to electrically connect the first block group among buttons arranged in the first direction to form a drive line, which applies a drive signal for inducing capacitance in the electrode, and electrically connect the second block group among buttons arranged in the second direction to form a scan line, which receives a scan signal for detecting a change caused by the touch input in the capacitance induced in the electrode by the drive signal, in order to electrically connect the electrode among the buttons; and

a controller configured to acquire a key value allocated to a button corresponding to a switch that acquires the key input and acquire a touch coordinate value calculated using the change in the capacitance of the electrode corresponding to the touch input, the control method comprising;

entering a keyboard mode;

ignoring a touch input and outputting only a keyboard input reflecting a key value corresponding to a push input when operating in the keyboard mode;

entering a mouse mode;

ignoring a push input relative to at least some of the plurality of buttons and outputting a mouse input indicating a movement distance and a movement direction of a pointer by means of a variation of a touch coordinate value when operating in the mouse mode;

entering a digitizer mode; and

ignoring a push input relative to at least some of the plurality of buttons and outputting a digitizer input indicating a position of a pointer by means of the touch coordinate value.

14. The control method of claim 13,

wherein the outputting of a mouse input comprises calculating the variation of the touch coordinate value through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period, and

wherein the outputting of a digitizer input comprises acquiring the digitizer input from the touch coordinate value in consideration of a matching relationship between a screen region of a display outputting the pointer and the touch coordinate value.

15. The control method of claim 14, further comprising setting the matching relationship so that the position of the pointer on the screen region corresponds to a touch coordinate value of a touch input that is first applied after the digitizer mode is entered.

16. The control method of claim 13,

wherein the outputting of a mouse input comprises calculating the variation of the touch coordinate value through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period;

and

wherein the outputting of a digitizer input comprises acquiring the digitizer input through a difference operation between the current touch coordinate value and a touch coordinate value of a touch input that is first applied after the digitizer mode is entered.

17. The control method of claim 13, further comprising:

determining whether the mouse mode is a left-hand mode or a right-hand mode when the mouse mode is entered;

activating only electrodes of buttons located at a left side of an entire touch sensing region when the mouse mode is the left-hand mode;

activating only electrodes of buttons located at a right side of the entire touch sensing region when the mouse mode is the right-hand mode; and

activating all of the electrodes of the buttons located within the entire touch sensing region when the digitizer mode is entered.

18. The control method of claim 13, further comprising setting a touch region matched to a screen region in which the pointer is displayed so that a touch coordinate value of a touch input that is first applied after the digitizer mode is entered is matched to a position of the pointer on the screen region.

19. The control method of claim 18, further comprising:

acquiring a touch input to a region outside the touch region within an entire touch sensing region while operating in the digitizer mode; and

resetting the touch region according to a touch input applied to the outside region.

20. The control method of claim 13, further comprising setting a different touch region matched to a screen region in which the pointer is displayed according to a touch input that is first applied after the digitizer mode is entered.

21. A control method of an electronic device having a multi-functional human interface with a keyboard layout, wherein the electronic device includes:

a plurality of buttons arranged according to the keyboard layout and each having a keycap configured to receive a vertical push input from a user;

a button body combined with a lower portion of the keycap and configured to be moved upward or downward according to the push input; and

an electrode interposed between the keycap and the button body and configured to receive a touch input from the user by means of a first block group composed of blocks that are electrically connected in a first direction, which is any one of a length direction and a width direction of the keyboard layout, and a second block group composed of blocks that are electrically connected in a second direction different from the first direction, which is the other one of the length direction and the width direction of the keyboard layout;

a plurality of switches arranged in lower portions of the plurality of buttons according to the keyboard layout and each configured to acquire a key input when the button body is moved downward;

an electric connection member configured to electrically connect the first block group among buttons arranged in the first direction to form a drive line, which applies a drive signal for inducing capacitance in the electrode, and electrically connect the second block group among buttons arranged in the second direction to form a scan line, which receives a scan signal for detecting a change caused by the touch input in the capacitance induced in the electrode by the drive signal, in order to electrically connect the electrode among the buttons; and

a controller configured to acquire a key value allocated to a button corresponding to a switch that acquires the key input and acquire a touch coordinate value calculated using the change in the capacitance of the electrode corresponding to the touch input, the control method comprising;

entering any one of a keyboard mode in which a touch input is ignored and only a keyboard input reflecting a key value corresponding to a push input is output, and a touch mode in which a push input relative to at least some of the plurality of buttons is ignored and a pointer control signal reflecting a touch coordinate value is output;

calculating a touch coordinate value corresponding to a touch input on the basis of a scan signal when operating in the touch mode;

acquiring a relative coordinate value from the touch coordinate value when the touch mode is a mouse mode;

acquiring an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode; and

outputting a pointer position control signal on the basis of any one of the relative coordinate value and the absolute coordinate value.

22. The control method of claim 21, further comprising:

calculating the relative coordinate value through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period; and

calculating the absolute coordinate value through the touch coordinate value in consideration of a matching relationship between a touch region and a screen region in which a pointer is displayed.

23. The control method of claim 22, further comprising setting the matching relationship on the basis of a touch coordinate value of a touch input that is first applied after the digitizer mode is entered.

24. The control method of claim 21, further comprising:

calculating the relative coordinate value through a difference operation between a touch coordinate value during a current scan period and a touch coordinate value during a previous scan period; and

calculating the absolute coordinate value through a difference operation between touch coordinate values of touch inputs that are first applied after the digitizer mode is entered.