Multi-touch manipulation of application objects

• US 10,198,101 B2
• Filed: 09/01/2016
• Issued: 02/05/2019
• Est. Priority Date: 10/26/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Townsend, Reed L., Tu, Xiao, Scott, Bryan, Torset, Todd A., Geidl, Erik M., Pradhan, Samir S., Teed, Jennifer A.
• Primary Examiner(s): Dharia, Prabodh M
• Application Number:
  US15/254,862
• Publication Number:
  US 20170115760A1
• Time in Patent Office: 887 Days
• Field of Search: 345156-178, 345428, 345650, 345660, 715205, 715234, 715863, 715864, 178 1805, 382188
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

The manipulation system described herein provides a common platform and application-programming interface (API) for applications to communicate with various multi-touch hardware devices, and facilitates the interpretation of multi-touch input as one or more manipulations. Manipulations map more directly to user intentions than do individual touch inputs and add support for basic transformation of objects using multiple touch contacts. An application can use manipulations to support rotating, resizing, and translating multiple objects at the same time. The manipulation system outputs two-dimensional (2D) affine transforms that contain rotation, scale, and translation information. Thus, using the manipulation system the application author can focus more on building touch-capable applications and let the manipulation system handle the underlying transformations and communication with the multi-touch hardware.

Claims

1. A method comprising:

receiving one or more touch inputs that corresponds to an interaction with the touch-sensitive input surface, the one or more touch inputs comprising one or more locations of contacts with the touch-sensitive input surface, wherein the input is received by an application;

sending the one or more touch inputs to a manipulation system, the manipulation system interpreting the one or more touch inputs into corresponding manipulation events, wherein the manipulation system is invokable by the application, the one or more touch inputs sent by the application invoking the manipulation system;

receiving, at the application, the manipulation events, the manipulation events comprising geometric transforms produced by the manipulation system according to the one or more inputs; and

handling, by the applications, the received manipulation events.

2. The method according to claim 1, wherein the manipulation system instantiates software-based manipulation processors according to the one or more touch inputs.

3. The method according to claim 1, further comprising, sending information to the manipulation system, the information identifying an association between the one or more touch inputs and an object.

4. The method according to claim 3, wherein interpreting the one or more touch inputs into manipulation events is based at least in part on the association between the one or more touch inputs and the object.

5. The method according to claim 4, further comprising passing a locational attribute for the object to the manipulation system.

6. The method according to claim 5, wherein the locational attribute comprises at least one of a center of the object and a reference point of the object.

7. The method according to claim 1, further comprising managing a set of contact identifiers by the manipulation system.

8. The method according to claim 7, wherein the managing a set of contact identifiers comprises associating the contact identifiers with one or more touch inputs.

9. The method according to claim 8, wherein the contact identifiers are used for interpreting the one or more touch inputs into manipulation events.

10. A method comprising:

receiving, at a manipulation system from an application executing on a computing device having a touch-sensitive input surface, a plurality of touch inputs, the plurality of touch inputs corresponding to a plurality of touches previously directed to the application;

interpreting, the plurality of touch inputs into at least one corresponding manipulation event, the at least one corresponding manipulation event representing at least one manipulation based on relative movements of the plurality of touches on the touch-sensitive input surface; and

providing the at least one corresponding manipulation event to the application.

11. The method of claim 10, wherein the at least one manipulation comprises at least one manipulation of an object, the application being configured to manipulate the object based on the provided at least one corresponding manipulation event and to cause the manipulated object to be displayed by the computing device.

12. The method of claim 10, wherein the plurality of touch inputs comprise two-dimensional input points corresponding to the plurality of touches of the touch-sensitive input screen.

13. The method of claim 10, wherein the manipulation system is configured to be invoked by arbitrary applications executing on the computing device.

14. The method of claim 10, wherein the at least one corresponding manipulation event comprises at least one geometric transform produced by an element that received the plurality of touch inputs.

15. The method of claim 10, wherein the plurality of touch inputs comprises locations of the touches on the touch-sensitive input surface.

16. The method of claim 15, wherein the plurality of touch inputs further comprise values corresponding to pressures applied by the plurality of touches on the touch-sensitive input surface.

17. The method of claim 10, wherein the at least one manipulation event comprises at least one manipulation selected from the group consisting of a rotation event, a translation event, and a scaling event.

18. A system comprising:

at least one processor; and

memory encoding computer executable instructions that, when executed by at least one processor, perform a method comprising;

receiving one or more touch inputs that corresponds to an interaction with the touch-sensitive input surface, the one or more touch inputs comprising one or more locations of contacts with the touch-sensitive input surface, wherein the input is received by an application;

sending the one or more touch inputs to a manipulation system, the manipulation system interpreting the one or more touch inputs into corresponding manipulation events, wherein the manipulation system is invokable by the application, the one or more touch inputs sent by the application invoking the manipulation system;

receiving, at the application, the manipulation events, the manipulation events comprising geometric transforms produced by the manipulation system according to the one or more inputs; and

handling, by the applications, the received manipulation events.

19. The system according to claim 18, wherein the method further comprises sending information to the manipulation system, the information identifying an association between the one or more touch inputs and an object.

20. The system according to claim 19, wherein interpreting the one or more touch inputs into manipulation events is based at least in part on the association between the one or more touch inputs and the object.