Hand sensing controller

• US 10,353,515 B2
• Filed: 03/19/2018
• Issued: 07/16/2019
• Est. Priority Date: 03/20/2017
• Status: Active Grant

• Current Assignee: Tactual Labs Co.
• Original Assignee: Tactual Labs Co.
• Inventors: De Araujo, Bruno Rodrigues, Holman, David, Jota Costa, Ricardo Jorge, Moseley, Braon
• Primary Examiner(s): Faragalla, Michael A
• Application Number:
  US15/924,782
• Publication Number:
  US 20180267667A1
• Time in Patent Office: 484 Days
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04107 Shielding in digitiser, i.e. guard or shielding arrangements, mostly for capacitive touchscreens, e.g. driven shields, driven grounds
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04164 Connections between sensors and controllers, e.g. routing lines between electrodes and connection pads
• CPC Class Codes: G06F 3/0445 using two or more layers of sensing electrodes, e.g. using two layers of electrodes separated by a dielectric layer
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

Disclosed is a touch-sensitive controller system employing a controller comprising a plurality of separate FMT sensor patterns adapted to detect a variety positions of the human hand. The controller system outputs both touch events as well as data reflective of the hand interaction with the controller. The FMT sensors may be driven by a common signal generator, and can look at body-generate crosstalk to aid in understanding the position, orientation and grip of a hand on the controller. In an embodiment, signal injection can supplement FMT sensor data. Fusion among the data transmitted and received by the plurality of FMT sensors and additional injected signals may provide improved fidelity in both touch and hand modeling.

Claims

1. A touch-sensitive controller, comprising:

controller body supporting a thumb-centric portion, and a trigger-centric portion;

first sensor pattern associated with the thumb-centric portion, the first sensor pattern comprising a first plurality of conductors and a second plurality of conductors, the first and second plurality of conductors oriented such that a touch event proximate to the thumb-centric portion will cause a change in coupling between at least one of the plurality of first conductors and at least one of the plurality of second conductors;

second sensor pattern associated with the trigger-centric portion, the second sensor pattern comprising a third plurality of conductors and a fourth plurality of conductors, the third and fourth plurality of conductors oriented such that a touch event proximate to the trigger-centric portion will cause a change in coupling between at least one of the plurality of third conductors and at least one of the plurality of fourth conductors;

signal generator operatively connected to separate ones of each of the conductors in the first and third pluralities of conductors, the signal generator emitting a frequency orthogonal signal on each of the separate ones of each of the first and third pluralities of conductors;

plurality of signal receivers, each of the plurality of signal receivers operatively connected to separate ones of the conductors of each of the second and fourth plurality of conductors, each of the plurality of signal receivers being adapted to receive signals present on the conductor to which it is operatively connected, the plurality of signal receivers being adapted to receive a frame during an integration period by simultaneously receiving signals present on the separate ones of the conductors to which it is operatively connected;

signal processor adapted to generate a first heatmap reflecting electromagnetic disturbance proximate to the thumb-centric portion and a second heatmap reflecting electromagnetic disturbance proximate to the trigger-centric portion, each heatmap based, at least in part, on a frame received during an integration period.

2. The controller of claim 1, wherein the first sensor pattern is a three-layer sensor pattern.

3. The controller of claim 1, wherein the second sensor pattern is a three-layer sensor pattern.

4. The controller of claim 3, wherein the first sensor pattern is a three-layer sensor pattern.

5. The controller of claim 4, further comprising:

finger information data structure containing information adapted to define at least;

a position of a thumb with respect to the controller; and

a position of an index finger with respect to the controller, and

processor adapted to populate the finger information data structure with information concerning a position of the thumb with respect to the controller based at least in part on the first heatmap, and with information concerning a position of the index finger with respect to the controller based at least in part on the second heatmap.

6. The controller of claim 5, wherein the processor and the signal processor are the same integrated circuit.

7. The controller of claim 6, wherein:

the operative connection between the signal generator and the separate ones of each of the conductors in the first plurality of conductors comprises feedlines; and

the first sensor pattern further comprises decoupling elements proximate to the feedlines.

8. The controller of claim 7, wherein the decoupling elements are one selected from the group of:

decoupling lines, and decoupling planes.

9. The controller of claim 6, wherein:

the operative connection between the signal generator and the separate ones of each of the conductors in the third plurality of conductors comprises feedlines; and

the second sensor pattern further comprises decoupling elements proximate to the feedlines.

10. The controller of claim 9, wherein the decoupling elements are one selected from the group of:

decoupling lines, and decoupling planes.

11. The controller of claim 5, further comprising:

third sensor pattern on the controller body, the third sensor pattern comprising a fifth plurality of conductors and a sixth plurality of conductors;

signal generator being further operatively connected to separate ones of each of the conductors in the fifth plurality of conductors, the signal generator emitting a frequency orthogonal signal on each of the separate ones of each of the fifth plurality of conductors;

additional plurality of signal receivers, each of the additional plurality of signal receivers operatively connected to separate ones of the sixth plurality of conductors, each of the additional plurality of signal receivers being adapted to receive signals present on the conductor to which it is operatively connected, the additional plurality of signal receivers being adapted to receive a controller body frame during an integration period by simultaneously receiving signals present on the separate ones of the conductors to which it is operatively connected;

the signal processor being further adapted to generate a third heatmap reflecting electromagnetic disturbance proximate to the controller body, based, at least in part, on the received controller body frame.

12. The controller of claim 11, wherein the plurality of signal receivers and the additional plurality of signal receivers are part of the same integrated circuit.

13. The controller of claim 11, wherein the third sensor pattern is a two-layer sensor pattern.

14. The controller of claim 11, wherein the finger information data structure additionally contains information adapted to define a position of at least one of:

a middle finger;

a ring finger; and

a pinky finger, with respect to the controller; and

the processor is further adapted to populate the finger information data structure based at least in part on the third heatmap.

15. The controller of claim 11, wherein the finger information data structure additionally contains information adapted to define a position of:

a middle finger;

a ring finger; and

a pinky finger, with respect to the controller; and

the processor is further adapted to populate the finger information data structure with data concerning a position of a middle finger, a ring finger and a pinky finger based at least in part on the third heatmap.

16. The controller of claim 15, further comprising:

signal injector element operatively connected to the signal generator, the signal generator being further adapted to emit a frequency orthogonal signal to the signal injector.

17. The controller of claim 16, further comprising:

a hand strap affixed to the controller body to retain the controller body on a user'"'"'s hand during intended user interaction with the controller; and

wherein the signal injector element is positioned in proximity to the hand strap in a manner that will bring it into touch with a user'"'"'s hand during intended user interaction with the controller.

18. The controller of claim 15, further comprising:

supplemental signal injector system having a signal injector element operatively connected to a supplemental signal generator;

the supplemental signal generator being adapted to emit a frequency orthogonal signal to the signal injector element; and

the supplemental signal injector system is adapted to permit the signal injector element to be in touch with a user'"'"'s body during intend user interaction with the controller.

19. The controller of claim 18, the supplemental signal injector is in one form selected from the group consisting of:

a wristband;

a watch;

a smart-watch;

a mobile phone;

a glove;

a ring;

a stylus;

a pocketable object;

a seat cushion or other seating pad;

a floor mat;

an armrest;

a desk surface;

a belt;

a shoe; and

a wearable computing device.

20. The controller of claim 16, wherein the processor is further adapted to populate the finger information data structure with data concerning a position of at least one of:

a thumb, an index finger, a middle finger, a ring finger and a pinky finger, based at least in part on detection of the frequency orthogonal signal emitted to the signal injector element.