Systems and methods for multi-pressure interaction on touch-sensitive surfaces

• US 10,152,131 B2
• Filed: 01/13/2017
• Issued: 12/11/2018
• Est. Priority Date: 11/07/2011
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Grant, Danny, Cruz-Hernandez, Juan Manuel, Modarres, Ali
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US15/405,550
• Publication Number:
  US 20170131776A1
• Time in Patent Office: 697 Days
• Field of Search: 345174
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G10H 1/38 Chord
• CPC Class Codes: G10H 2220/096 using a touch screen touch screen note input, e.g. using a displayed keyboard G10H2220/241; personal digital assistant [PDA] G10H2230/015
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes

Abstract

Systems and methods for multi-pressure interaction on touch-sensitive surfaces are disclosed. One disclosed embodiment of a method comprises receiving a first sensor signal from a touch-sensitive input device in response to a first contact of a first object on the touch-sensitive input device, the first sensor signal comprising a first location and a first pressure of the first contact, receiving a second sensor signal from the touch-sensitive input device in response to a second contact of a second object on the touch-sensitive input device substantially simultaneously with the first contact, the second sensor signal comprising a second location of the second contact and a second pressure of the second contact, generating a signal based at least in part on the first sensor signal and the second sensor signal, the signal configured to cause a haptic effect, and outputting the signal.

Claims

1. A method, comprising:

receiving a first sensor signal from a touch-sensitive display in response to a first contact on the touch-sensitive display, the first sensor signal comprising a first location and a first pressure corresponding to the first contact;

receiving a second sensor signal from the touch-sensitive display in response to a second contact on the touch-sensitive display substantially simultaneously with the first contact, the second sensor signal comprising a second location and a second pressure corresponding to the second contact;

determining a graphical object displayed on the touch-sensitive display based on the first and second locations;

determining a multi-pressure input based on the first and second pressures;

changing a display of the graphical object based on the determined multi-pressure input;

generating a signal based at least in part on the multi-pressure input, the signal configured to cause a haptic effect; and

outputting the signal to a haptic output device.

2. The method of claim 1, wherein the haptic output device comprises an actuator and the signal comprises an actuator signal configured to cause the actuator to output the haptic effect.

3. The method of claim 1, wherein the signal is further based on a first pressure threshold and at least one of the first or second pressures.

4. The method of claim 1, wherein the signal is further based on comparing the first pressure to a first pressure threshold, and comparing the second pressure to a second pressure threshold.

5. The method of claim 1, wherein the signal is based at least in part on a difference between the first pressure and the second pressure of the second contact.

6. The method of claim 1, wherein the haptic effect comprises at least one of a vibration, a friction, a texture, or a deformation.

7. The method of claim 2, further comprising:

determining a second actuator signal based at least in part on the first sensor signal and the second sensor signal; and

outputting the second actuator signal to the haptic output device.

8. The method of claim 2, wherein the actuator comprises a piezo-electric actuator, a rotary motor, or a linear resonant actuator.

9. The method of claim 1, wherein outputting the signal comprises sending the signal to a second device in communication with the touch-sensitive display, wherein the second device comprises the haptic output device.

10. The method of claim 1, wherein the determination comprises a determination that the first location corresponds to the graphical object on the touch-sensitive display and the second location corresponds to the graphical object on the touch-sensitive display.

11. The method of claim 1, wherein the determination comprises a determination that the first location corresponds to the graphical object on the touch-sensitive display and the second location does not correspond to the graphical object on the touch-sensitive display.

12. The method of claim 1, wherein the determination comprises a determination that the first location does not correspond to the graphical object on the touch-sensitive display and the second location corresponds to the graphical object on the touch-sensitive display.

13. A system, comprising:

a touch-sensitive display; and

a processor in communication with the touch-sensitive display and configured to;

receive a first sensor signal from the touch-sensitive display in response to a first contact on the touch-sensitive display, the first sensor signal comprising a first location and a first pressure corresponding to the first contact;

receive a second sensor signal from the touch-sensitive display in response to a second contact on the touch-sensitive display substantially simultaneously with the first contact, the second sensor signal comprising a second location and a second pressure corresponding to the second contact;

determine a graphical object displayed on the touch-sensitive display based on the first and second locations;

determine a multi-pressure input based on the first and second pressures;

change a display of the graphical object based on the determined multi-pressure input;

generate a signal based at least in part on multi-pressure input, the signal configured to cause a haptic effect; and

output the signal to a haptic output device.

14. The system of claim 13, wherein a portable computing device comprises the touch-sensitive display, and wherein the portable computing device comprises a smartphone or a tablet.

15. The system of claim 13, wherein the haptic output device comprises a piezo-electric actuator or a linear resonant actuator.

16. The system of claim 13, wherein the determination comprises a determination that the first location corresponds to the graphical object and the second location corresponds to the graphical object.

17. A non-transitory computer-readable medium comprising executable instructions which, when executed by a processor, cause the processor to:

receive a first sensor signal from a touch-sensitive display in response to a first contact on the touch-sensitive display, the first sensor signal comprising a first location and a first pressure corresponding to the first contact;

receive a second sensor signal from the touch-sensitive display in response to a second contact on the touch-sensitive display substantially simultaneously with the first contact, the second sensor signal comprising a second location and a second pressure corresponding to the second contact;

determine a graphical object displayed on the touch-sensitive display based on the first and second locations;

determine a multi-pressure input based on the first and second pressures;

change a display of the graphical object based on the determined multi-pressure input;

generate a signal based at least in part on the multi-pressure input, the signal configured to cause a haptic effect; and

output the signal outputting the signal to haptic output device.

18. The non-transitory computer-readable medium of claim 17, wherein the determination comprises a determination that the first location is on the graphical object on the touch-sensitive display.

19. The non-transitory computer-readable medium of claim 18, wherein the determination comprises a determination that the second location is not on the graphical object on the touch-sensitive display.

20. The non-transitory computer-readable medium of claim 18, wherein the determination comprises a determination that the second location is not on any graphical object on the touch-sensitive display.

21. The non-transitory computer-readable medium of claim 17, wherein the signal is configured to cause:

a first haptic effect if the determination comprises a determination that the first location corresponds to the graphical object and the second location corresponds to the graphical object;

a second haptic effect if the determination comprises a determination that the first location corresponds to the graphical object and the second location does not correspond to the graphical object;

a third haptic effect if the determination comprises a determination that the first location does not correspond to the graphical object and the second location corresponds to the graphical object; and

a fourth haptic effect if the determination comprises a determination that the first location does not correspond to the graphical object and the second location does not correspond to the graphical object, and

wherein each of the first haptic effect, the second haptic effect, the third haptic effect, and the fourth haptic effect is a different haptic effect.