Touch screen interaction using dynamic haptic feedback

• US 10,459,559 B2
• Filed: 06/20/2017
• Issued: 10/29/2019
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Sinclair, Michael J., Pahud, Michel, Benko, Hrvoje
• Primary Examiner(s): Mehmood, Jennifer
• Assistant Examiner(s): Nokham, James S
• Application Number:
  US15/627,839
• Publication Number:
  US 20170329446A1
• Time in Patent Office: 861 Days
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A method, system, and one or more computer-readable storage media for providing multi-dimensional haptic touch screen interaction are provided herein. The method includes detecting a force applied to a touch screen by an object and determining a magnitude, direction, and location of the force. The method also includes determining a haptic force feedback to be applied by the touch screen on the object based on the magnitude, direction, and location of the force applied to the touch screen, and displacing the touch screen in a specified direction such that the haptic force feedback is applied by the touch screen on the object.

Claims

1. A device, comprising:

a touch screen comprising a first display tile, a second display tile, and a force transducer, the touch screen to temporarily hold a displacement from an original touch screen location in response to detecting a decreasing force magnitude of the detected force, where the touch screen would return to the original touch screen location if the decreasing force magnitude of the detected force is below a threshold;

a servomotor to move the first display tile, or the second display tile; and

a controller to send a signal to instruct the servomotor to move the first display tile with a first touch response in response to a detected force by the force transducer, the servomotor to move the second display tile with a second touch response different from the first touch response in response to a second detected force.

2. The device of claim 1, wherein the first display tile and the second display tile are disposed to move independent of each other at a same time.

3. The device of claim 1, wherein the first display tile or the second display tile is disposed to move in opposition to a direction of the detected force, wherein the detected force comprises a force magnitude below a threshold.

4. The device of claim 1, wherein the servomotor is to move the first display tile or the second display tile with a force that increases as a displacement of the touch screen from an original touch screen location increases.

5. The device of claim 1, wherein the servomotor is to move the first display tile or the second display tile to a displacement from an original touch screen location that increases in response to a force magnitude of the detected force increasing.

6. The device of claim 1, wherein:

the touch screen displays an annotation in response to moving from an original touch screen location; and

the servomotor imposes a detent in response to the display of the annotation.

7. The device of claim 1, wherein the servomotor is disposed to move the first display tile or the second display tile to exert a force based on a detected velocity of an object applying a force to the touch screen.

8. The device of claim 1, wherein a touch screen location locks in response to a detection of a first force at a first location of the touch screen and a detection of the second detected force at a second location of the touch screen.

9. The device of claim 1, wherein the force transducer is one of a plurality of force transducers located between a mounting plate and the touch screen at each corner of the touch screen.

10. A method for providing touch screen interaction, comprising:

moving a first display tile of the touch screen or a second display tile of a touch screen, with a servomotor;

instructing, via a controller, the servomotor to move the first display tile with a first touch response in response to a detected force by a force transducer, the servomotor to move the second display tile with a second touch response different from the first touch response in response to a second detected force;

temporarily holding a displacement, of the first display tile or the second display tile, from an original touch screen location in response to detecting a decreasing force magnitude of the detected force; and

returning the first display tile or the second display tile to an original touch screen location if the decreasing force magnitude of the detected force is below a threshold.

11. The method of claim 10, comprising moving the first display tile and the second display tile independent of each other at the same time.

12. The method of claim 10, comprising moving the first display tile or the second display tile in opposition to a direction of the detected force, wherein the detected force comprises a force magnitude below a threshold.

13. The method of claim 10, comprising moving the first display tile or the second display tile with a force that increases as a displacement of a touch screen from an original touch screen location increases.

14. The method of claim 10, comprising moving the first display tile or the second display tile to a displacement from an original touch screen location that increases in response to a force magnitude of the detected force increasing.

15. The method of claim 10, wherein:

the touch screen displays an annotation in response to moving from an original touch screen location; and

the servomotor imposes a detent in response to the display of the annotation.

16. The method of claim 10, comprising moving the first display tile or the second display tile to exert a force based on a detected velocity of an object applying a force to the first display tile or the second display tile.

17. The method of claim 10, comprising locking a touch screen location in response to a detection of a first force at a first location of the touch screen and a detection of a second force at a second location of the touch screen.

18. A computer-readable storage media for storing computer-readable instructions, the computer-readable instructions for touch screen interaction to be executed by a processing device, the computer-readable instructions comprising code configured to:

move a touch screen, a first display tile of the touch screen, or a second display tile of the touch screen, with a servomotor;

instruct, via a controller, the servomotor to move the first display tile with a first touch response in response to a detected force by a force transducer, the servomotor to move the second display tile with a second touch response different from the first touch response in response to a second detected force;

hold a displacement temporarily, of the first display tile or the second display tile, from an original touch screen location in response to detecting a decreasing force magnitude of the detected force; and

return the first display tile or the second display tile to an original touch screen location if the decreasing force magnitude of the detected force is below a threshold.

19. The computer-readable storage media of claim 18, comprising computer-readable instructions that when executed on the processing device are configured to move the first display tile and the second display tile independent of each other at the same time.