Human-computer interface system

• US 10,331,265 B2
• Filed: 03/31/2017
• Issued: 06/25/2019
• Est. Priority Date: 03/31/2016
• Status: Active Grant

• Current Assignee: Sensel, Inc.
• Original Assignee: Sensel, Inc.
• Inventors: Rosenberg, Ilya Daniel, Zarraga, John Aaron, Miller, Brogan, Watson, Charles, Moscovich, Tomer, Grau, Alexander
• Primary Examiner(s): Amadiz, Rodney
• Application Number:
  US15/476,732
• Publication Number:
  US 20170285848A1
• Time in Patent Office: 816 Days
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 1/1692 the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04146 using pressure sensitive conductive elements delivering a boolean signal and located between crossing sensing lines, e.g. located between X and Y sensing line layers
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

One variation of a method for interfacing a computer to a human includes: detecting application of a first input onto a touch sensor surface and a first force magnitude of the first input; in response to the first force magnitude exceeding a first threshold magnitude, actuating a vibrator coupled to the touch sensor surface during a first click cycle and triggering an audio driver proximal the touch sensor surface to output a click sound during the first click cycle; detecting retraction of the first input from the touch sensor surface and a second force magnitude of the first input; and, in response to the second force magnitude falling below a second threshold magnitude less than the first threshold magnitude, actuating the vibrator during a second click cycle distinct from the first click cycle and triggering the audio driver to output the click sound during the second click cycle.

Claims

1. A system for interfacing a computer system and a user comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a vibrator coupled to the touch sensor and configured to oscillate a mass within a plane parallel to the touch sensor surface;

a chassis;

a coupler interposed between the touch sensor and the chassis and configured to absorb displacement of the touch sensor relative to the chassis parallel to the touch sensor surface during activation of the vibrator;

an audio driver coupled to the chassis; and

a controller configured to;

access the first threshold magnitude and a first command assigned to a first region of the touch sensor surface containing the first location;

detect application of a first input onto the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

in response to detecting application of the first input onto the touch sensor surface at the first force magnitude exceeding the first threshold magnitude;

output the first command at approximately the first time; and

execute a first click cycle by driving the vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output a click sound; and

output a first touch image representing a first location and the first force magnitude of the first input on the touch sensor surface at approximately the first time;

detect application of a second input onto the touch sensor surface and a second force magnitude of the second input at a second time based on a second change in resistance between a second sense electrode and drive electrode pair in the touch sensor;

access a second threshold magnitude and a second command assigned to a second region of the touch sensor surface containing the second location, the second threshold magnitude greater than the first threshold magnitude, and the second region of the touch sensor surface distinct from the first region; and

output the second command at approximately the second time in response to detecting application of the second input onto the touch sensor surface at the second force magnitude exceeding the second threshold magnitude.

2. The system of claim 1, wherein the controller is configured to:

detect retraction of the first input from the touch sensor surface and a second force magnitude of the first input at a second time succeeding the first time based on a second change in resistance between the first sense electrode and drive electrode pair; and

execute a second click cycle in response to the second force magnitude falling below a second threshold magnitude less than the first threshold magnitude.

3. The system of claim 2, wherein the controller is configured to:

execute the first click cycle by driving the vibrator a first oscillation frequency and triggering the audio driver to output the click sound at a first audio frequency; and

execute the second click cycle by driving the vibrator at a second oscillation frequency greater than the first oscillation frequency and triggering the audio driver to output the click sound at the second audio frequency greater than the first audio frequency.

4. The system of claim 1, wherein the controller is configured to:

detect a first input area of the first input on the touch sensor surface;

calculate a first pressure of the first input based on the first input area and the first force magnitude; and

execute the first click cycle in response to the first pressure exceeding the first threshold magnitude.

5. The system of claim 1, wherein the controller is configured to:

access the first threshold magnitude set by a user for the first command defining a keystroke input assigned to the first region of the touch sensor surface defining a keyboard surface; and

access the second threshold magnitude set by the user for the second command representing a left-click input assigned to the second region of the touch sensor surface defining a trackpad surface.

6. The system of claim 1, wherein the controller is configured to, during the first click cycle:

initiate activation of the vibrator at a second time immediately succeeding the first time and during application of the first input on the touch sensor surface; and

initiate activation of the audio driver at a third time succeeding the second time by a delay duration corresponding to an onset time of the vibrator in which the vibrator reaches a minimum oscillation magnitude.

7. The system of claim 6, wherein the controller is configured to, during the first click cycle:

drive the vibrator with a square wave signal for a duration of approximately 250 milliseconds; and

initiate replay of the click sound through the audio driver at the third time succeeding the second time by approximately 50 milliseconds.

8. The system of claim 1:

wherein the chassis comprises a housing of a mobile computing device and defines a receptacle;

wherein the coupler locates the touch sensor within the receptacle;

wherein the audio driver is mounted to the touch sensor opposite the touch sensor surface; and

wherein the touch sensor surface defines a trackpad surface inset from an edge of the receptacle to form a gap configured to pass sounds output by the audio driver.

9. The system of claim 1:

wherein the chassis comprises a housing of a mobile computing device and defines a receptacle;

wherein the coupler locates the touch sensor within the receptacle;

wherein the audio driver is mounted to the chassis and defines a primary speaker in the mobile computing device; and

wherein the controller is configured to trigger the audio driver to output the click sound at a static, preset volume independent of a global volume setting of the mobile computing device.

10. The system of claim 1:

wherein the vibrator;

is coupled to the rigid backing proximal a center of the touch sensor; and

comprises a linear actuator configured to oscillate the mass along a vector parallel to the touch sensor surface and parallel to an edge of the touch sensor; and

wherein the coupler comprises a grommet;

extending from the chassis and passing through a mounting bore in the rigid backing;

configured to vertically constrain the rigid backing relative to the chassis; and

exhibiting elasticity in a direction parallel to the touch sensor surface.

11. The system of claim 1:

wherein the vibrator is arranged under a first region of the touch sensor surface;

further comprising a second vibrator arranged under a second region of the touch sensor surface adjacent and distinct from the first region of the touch sensor surface;

wherein the controller is configured to;

execute the first click cycle by driving the vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output the click sound in response to detecting application of the first input at the first location contained within the first region of the touch sensor surface;

detect application of a second input onto the touch sensor surface and a second force magnitude of the second input at a second time based on a second change in resistance between a second sense electrode and drive electrode pair in the touch sensor;

execute a second click cycle by actuating the second vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output the click sound in response to detecting application of the second input at a second location contained within the second region of the touch sensor surface.

12. A system comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a vibrator coupled to the touch sensor and configured to oscillate a mass within a plane parallel to the touch sensor surface;

an audio driver coupled to the chassis; and

a controller configured to;

detect application of a first input onto the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

execute a first click cycle in response to the first force magnitude exceeding a first threshold magnitude by actuating the vibrator and triggering the audio driver to output a click sound;

detect retraction of the first input from the touch sensor surface and a second force magnitude of the first input at a second time succeeding the first time based on a second change in resistance between the first sense electrode and drive electrode pair; and

execute a second click cycle in response to the second force magnitude falling below a second threshold magnitude less than the first threshold magnitude by actuating the vibrator and triggering the audio driver to output the click sound;

an overlay;

defining a three-dimensional ergonomic mouse form;

configured to transiently install over the touch sensor surface; and

comprising an elastic material configured to communicate a force applied to a surface of the three-dimensional ergonomic mouse form downward onto the touch sensor surface.

13. The system of claim 12, wherein the controller is configured to:

execute the first click cycle by driving the vibrator at a first oscillation frequency and triggering the audio driver to output the click sound at a first audio frequency; and

execute the second click cycle by driving the vibrator at a second oscillation frequency greater than the first oscillation frequency and triggering the audio driver to output the click sound at the second audio frequency greater than the first audio frequency.

14. The system of claim 12:

further comprising;

a chassis of a mobile computing device defining a receptacle; and

a coupler interposed between the rigid backing and the chassis, configured to locate the touch sensor within the receptacle, and configured to absorb displacement of the rigid backing relative to the chassis parallel to the touch sensor surface during activation of the vibrator;

wherein the audio driver is mounted to the rigid backing opposite the touch sensor surface; and

wherein the touch sensor surface defines a trackpad surface inset from an edge of the receptacle to form a gap configured to pass audio signals output by the audio driver.

15. The system of claim 12, further comprising:

a housing;

containing the touch sensor, the vibrator, the audio driver, and the controller; and

defining a speaker grill adjacent the audio driver and facing opposite the touch sensor surface;

a pad;

extending from the housing opposite the touch sensor surface;

defining a bearing surface configured to slide across a table surface; and

configured to offset the speaker grill above the table surface by a target gap distance.

16. A system for interfacing a computer system and a user comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a vibrator coupled to the touch sensor and configured to oscillate a mass within a plane parallel to the touch sensor surface;

a chassis;

a coupler;

interposed between the touch sensor and the chassis; and

configured to absorb displacement of the touch sensor, relative to the chassis, parallel to the touch sensor surface during activation of the vibrator;

an audio driver coupled to the chassis; and

a controller configured to;

access a first threshold magnitude set by the user for a first command defining a keystroke input assigned to a first region of the touch sensor surface defining a keyboard surface;

access a second threshold magnitude set by the user for a second command representing a left-click input assigned to a second region of the touch sensor surface defining a trackpad surface;

detect application of a first input onto the first region of the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

execute a first click cycle in response to the first force magnitude exceeding the first threshold magnitude by driving the vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output a click sound; and

output a first touch image representing a first location and the first force magnitude of the first input on the touch sensor surface and the first command at approximately the first time.

17. A system for interfacing a computer system and a user comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a vibrator coupled to the touch sensor and configured to oscillate a mass within a plane parallel to the touch sensor surface;

a chassis;

a coupler interposed between the touch sensor and the chassis and configured to absorb displacement of the touch sensor relative to the chassis parallel to the touch sensor surface during activation of the vibrator;

an audio driver coupled to the chassis; and

a controller configured to;

detect application of a first input onto the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

execute a first click cycle in response to the first force magnitude exceeding a first threshold magnitude by;

initiating activation of the vibrator at a second time immediately succeeding the first time and during application of the first input on the touch sensor surface to oscillate the touch sensor within the chassis; and

drive the vibrator with a square wave signal for a duration of approximately 250 milliseconds;

initiating activation of the audio driver to output a click sound at a third time succeeding the second time by a delay duration approximately 50 milliseconds; and

output a first touch image representing a first location and the first force magnitude of the first input on the touch sensor surface at approximately the first time.

18. A system for interfacing a computer system and a user comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a vibrator;

coupled to the rigid backing proximal a center of the touch sensor; and

comprising a linear actuator configured to oscillate a mass along a vector parallel to the touch sensor surface and parallel to an edge of the touch sensor;

a chassis;

a coupler;

comprising a grommet;

interposed between the touch sensor and the chassis;

extending from the chassis and passing through a mounting bore in the rigid backing;

exhibiting elasticity in a direction parallel to the touch sensor surface;

configured to vertically constrain the rigid backing relative to the chassis; and

configured to absorb displacement of the touch sensor relative to the chassis parallel to the touch sensor surface during activation of the vibrator;

an audio driver coupled to the chassis; and

a controller configured to;

detect application of a first input onto the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

execute a first click cycle in response to the first force magnitude exceeding a first threshold magnitude by driving the vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output a click sound; and

output a first touch image representing a first location and the first force magnitude of the first input on the touch sensor surface at approximately the first time.

19. A system for interfacing a computer system and a user comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a first vibrator;

coupled to the touch sensor;

arranged under a first region of the touch sensor surface; and

configured to oscillate a mass within a plane parallel to the touch sensor surface;

a second vibrator arranged under a second region of the touch sensor surface adjacent and distinct from the first region of the touch sensor surface;

a chassis;

a coupler;

interposed between the touch sensor and the chassis; and

configured to absorb displacement of the touch sensor, relative to the chassis, parallel to the touch sensor surface during activation of the first vibrator;

an audio driver coupled to the chassis; and

a controller configured to;

detect application of a first input onto the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

execute a first click cycle by driving the vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output a click sound in response to detecting application of the first input at a first location contained within the first region of the touch sensor surface and in response to the first force magnitude exceeding a first threshold magnitude;

output a first touch image representing a first location and the first force magnitude of the first input on the touch sensor surface at approximately the first time;

detect application of a second input onto the touch sensor surface and a second force magnitude of the second input at a second time based on a second change in resistance between a second sense electrode and drive electrode pair in the touch sensor; and

execute the second click cycle by actuating the second vibrator to oscillate the touch sensor within the chassis and triggering the audio driver to output the click sound in response to detecting application of the second input at a second location contained within the second region of the touch sensor surface.

20. A system comprising:

a touch sensor comprising a rigid backing, comprising an array of sense electrode and drive electrode pairs arranged over the rigid backing, and defining a touch sensor surface extending over the array of sense electrode and drive electrode pairs;

a vibrator coupled to the touch sensor and configured to oscillate a mass within a plane parallel to the touch sensor surface;

an audio driver coupled to the chassis;

a controller configured to;

detect application of a first input onto the touch sensor surface and a first force magnitude of the first input at a first time based on a first change in resistance between a first sense electrode and drive electrode pair in the touch sensor;

execute a first click cycle in response to the first force magnitude exceeding a first threshold magnitude by actuating the vibrator and triggering the audio driver to output a click sound;

detect retraction of the first input from the touch sensor surface and a second force magnitude of the first input at a second time succeeding the first time based on a second change in resistance between the first sense electrode and drive electrode pair; and

execute a second click cycle in response to the second force magnitude falling below a second threshold magnitude less than the first threshold magnitude by actuating the vibrator and triggering the audio driver to output the click sound;

a housing;

containing the touch sensor, the vibrator, the audio driver, and the controller; and

defining a speaker grill adjacent the audio driver and facing opposite the touch sensor surface; and

a pad;

extending from the housing opposite the touch sensor surface;

defining a bearing surface configured to slide across a table surface; and

configured to offset the speaker grill above the table surface by a target gap distance.

21. The system of claim 20, further comprising an overlay:

defining a three-dimensional ergonomic mouse form;

configured to transiently install over the touch sensor surface; and

comprising an elastic material configured to communicate a force applied to a surface of the three-dimensional ergonomic mouse form downward onto the touch sensor surface.