Systems and methods for multi-pressure interaction on touch-sensitive surfaces

• US 10,775,895 B2
• Filed: 11/27/2018
• Issued: 09/15/2020
• Est. Priority Date: 11/07/2011
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Grant, Danny, Cruz-Hernandez, Juan Manuel, Modarres, Ali
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US16/201,594
• Publication Number:
  US 20190227629A1
• Time in Patent Office: 658 Days
• Field of Search: 345174
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G10H 1/38 Chord
• CPC Class Codes: G10H 2220/096 using a touch screen touch screen note input, e.g. using a displayed keyboard G10H2220/241; personal digital assistant [PDA] G10H2230/015
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes

Abstract

Systems and methods for multi-pressure interaction on touch-sensitive surfaces are disclosed. One disclosed embodiment of a method comprises receiving a first sensor signal from a touch-sensitive input device in response to a first contact of a first object on the touch-sensitive input device, the first sensor signal comprising a first location and a first pressure of the first contact, receiving a second sensor signal from the touch-sensitive input device in response to a second contact of a second object on the touch-sensitive input device substantially simultaneously with the first contact, the second sensor signal comprising a second location of the second contact and a second pressure of the second contact, generating a signal based at least in part on the first sensor signal and the second sensor signal, the signal configured to cause a haptic effect, and outputting the signal.

Claims

1. A method, comprising:

receiving, from a first touch-sensitive input device of a first device, a first sensor signal in response to a first contact of a first object on the first touch-sensitive input device, the first sensor signal comprising a first location and a first pressure of the first contact;

receiving, from the first touch-sensitive input device, a second sensor signal in response to a second contact of a second object on the first touch-sensitive input device substantially simultaneously with the first contact, the second sensor signal comprising a second location of the second contact and a second pressure of the second contact;

receiving, from a second touch-sensitive input device of a second device via a communications interface, a third sensor signal in response to a third contact of a third object on the second touch-sensitive input device, the third sensor signal comprising a third location and a third pressure of the third contact;

receiving, from the second touch-sensitive input device via the communications interface, a fourth sensor signal in response to a fourth contact of a fourth object on the second touch-sensitive input device substantially simultaneously with the third contact, the fourth sensor signal comprising a fourth location of the fourth contact and a fourth pressure of the fourth contact;

generating a haptic signal based at least in part on the first sensor signal, the second sensor signal, the third sensor signal, and the fourth sensor signal, the haptic signal configured to cause a haptic effect; and

outputting the haptic signal.

2. The method of claim 1, wherein generating the haptic signal comprises determining a first correspondence between the first location and the third location, and a second correspondence between the second location and the fourth location.

3. The method of claim 2, wherein determining the first correspondence comprises determining that the first location at the first touch-sensitive input device is substantially the same location as the third location at the second touch-sensitive input device;

and

wherein determining the second correspondence comprises determining that the second location at the first touch-sensitive input device is substantially the same location as the fourth location at the second touch-sensitive input device.

4. The method of claim 2, wherein determining the first correspondence comprises determining that the first location at the first touch-sensitive input device is not at substantially the same location as the third location at the second touch-sensitive input device.

5. The method of claim 1, wherein determining the haptic signal comprises determining a difference in pressure between the first pressure and the third pressure, and wherein determining the haptic signal is based on the difference in pressure.

6. The method of claim 5, further comprising determining the haptic signal based on the difference in pressure indicating the first pressure is greater than the third pressure.

7. The method of claim 1, further comprising:

determining that the first contact corresponds to an incorrect input; and

transmitting, via the communications interface, a signal to the second device, the signal indicating the incorrect input.

8. The method of claim 7, further comprising receiving, via the communications interface, a second haptic signal from the second device, the second haptic signal indicating that a haptic effect is to be output at the first touch-sensitive input device;

and

wherein generating the haptic signal is based on the second haptic signal.

9. A device comprising:

a first touch-sensitive input device;

a haptic output device;

a communications interface;

a non-transitory computer-readable medium; and

a processor in communication with the first touch-sensitive input device, the haptic output device, the communications interface, and the non-transitory computer-readable medium, the processor configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to;

receive, from the first touch-sensitive input device, a first sensor signal in response to a first contact of a first object on the first touch-sensitive input device, the first sensor signal comprising a first location and a first pressure of the first contact;

receive, from the first touch-sensitive input device, a second sensor signal in response to a second contact of a second object on the first touch-sensitive input device substantially simultaneously with the first contact, the second sensor signal comprising a second location of the second contact and a second pressure of the second contact;

receive, from a second touch-sensitive input device of a second device via the communications interface, a third sensor signal in response to a third contact of a third object on the second touch-sensitive input device, the third sensor signal comprising a third location and a third pressure of the third contact;

receive, from the second touch-sensitive input device via the communications interface, a fourth sensor signal in response to a fourth contact of a fourth object on the second touch-sensitive input device substantially simultaneously with the third contact, the fourth sensor signal comprising a fourth location of the fourth contact and a fourth pressure of the fourth contact;

generate a haptic signal based at least in part on the first sensor signal, the second sensor signal, the third sensor signal, and the fourth sensor signal, the haptic signal configured to cause a haptic effect; and

output the haptic signal to the haptic output device.

10. The device of claim 9, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to:

determine a first correspondence between the first location and the third location, and a second correspondence between the second location and the fourth location, and

generate the haptic signal based on the first correspondence and the second correspondence.

11. The device of claim 10, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to:

determine the first correspondence based on a determination that the first location at the first touch-sensitive input device is substantially the same location as the third location at the second touch-sensitive input device;

determine the first correspondence based on a determination that the second location at the first touch-sensitive input device is substantially the same location as the fourth location at the second touch-sensitive input device.

12. The device of claim 10, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to determine the first correspondence based on a determination that the first location at the first touch-sensitive input device is not at substantially the same location as the third location at the second touch-sensitive input device.

13. The device of claim 9, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to determine the haptic signal based on a determination of a difference in pressure between the first pressure and the third pressure, and wherein the haptic signal is based on the difference in pressure.

14. The device of claim 13, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to generate the haptic signal based on the difference in pressure indicating the first pressure is greater than the third pressure.

15. The device of claim 9, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to:

determine that the first contact corresponds to an incorrect input; and

transmit, via the communications interface, a signal to the second device, the signal indicating the incorrect input.

16. The device of claim 15, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to:

receive, via the communications interface, a second haptic signal from the second device, the second haptic signal indicating that a haptic effect is to be output at the first touch-sensitive input device; and

generate the haptic signal is based on the second haptic signal.

17. A non-transitory computer-readable medium comprising processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to:

receive, from a first touch-sensitive input device of a first device, a first sensor signal in response to a first contact of a first object on the first touch-sensitive input device, the first sensor signal comprising a first location and a first pressure of the first contact;

receive, from the first touch-sensitive input device, a second sensor signal in response to a second contact of a second object on the first touch-sensitive input device substantially simultaneously with the first contact, the second sensor signal comprising a second location of the second contact and a second pressure of the second contact;

receive, from a second touch-sensitive input device of a second device via a communications interface, a third sensor signal in response to a third contact of a third object on the second touch-sensitive input device, the third sensor signal comprising a third location and a third pressure of the third contact;

receive, from the second touch-sensitive input device via the communications interface, a fourth sensor signal in response to a fourth contact of a fourth object on the second touch-sensitive input device substantially simultaneously with the third contact, the fourth sensor signal comprising a fourth location of the fourth contact and a fourth pressure of the fourth contact;

generate a haptic signal based at least in part on the first sensor signal, the second sensor signal, the third sensor signal, and the fourth sensor signal, the haptic signal configured to cause a haptic effect; and

output the haptic signal.

18. The non-transitory computer-readable medium of claim 17, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to:

determine a first correspondence between the first location and the third location, and a second correspondence between the second location and the fourth location, and

generate the haptic signal based on the first correspondence and the second correspondence.

19. The non-transitory computer-readable medium of claim 17, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to determine the haptic signal based on a determination of a difference in pressure between the first pressure and the third pressure, and wherein the haptic signal is based on the difference in pressure.

20. The non-transitory computer-readable medium of claim 19, wherein the processor configured to output processor-executable instructions stored in the non-transitory computer-readable medium to cause the processor to generate the haptic signal based on the difference in pressure indicating the first pressure is greater than the third pressure.