Interaction models for indirect interaction devices

• US 9,367,230 B2
• Filed: 11/08/2011
• Issued: 06/14/2016
• Est. Priority Date: 11/08/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Williams, Sarah G., Honji, Scott, Kaneko, Masahiko, Markiewicz, Jan-Kristian, Ball, Vincent, Patel, Amish, Millsap, Paul R.
• Primary Examiner(s): Polo, Gustavo
• Application Number:
  US13/291,639
• Publication Number:
  US 20130113716A1
• Time in Patent Office: 1,680 Days
• Field of Search: 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

One or more techniques and/or systems are provided for utilizing input data received from an indirect interaction device (e.g., mouse, touchpad, etc.) as if the data was received from a direct interaction device (e.g., touchscreen). Interaction models are described for handling input data received from an indirect interaction device. For example, the interaction models may provide for the presentation of two or more targets (e.g., cursors) on a display when two or more contacts (e.g., fingers) are detected by indirect interaction device. Moreover, based upon a number of contacts detected and/or a pressured applied by respective contacts, the presented target(s) may be respectively transitioned between a hover visualization and an engage visualization. Targets in an engage visualization may manipulate a size of an object presented in a user interface, pan the object, drag the object, rotate the object, and/or otherwise engage the object, for example.

Claims

1. An indirect interaction system, comprising:

an input receiver configured to receive input data indicative of an event detected by the sensory surface of an indirect interaction device, the input data indicative of at least a first and second contact being applied relative to the sensory surface, the input data including a location of each of the at least a first and second contact relative to the sensory surface; and

,

a presentation component configured to provide at least a first and second target for presentation on a display based at least in part upon the input data, the first target indicative of the first contact applied to the sensory surface and the second target indicative of the second contact applied to the sensory surface, the first target and the second target provided for presentation on the display based at least in part on the location of the first and second contact, respectively, relative to the sensory surface.

2. The system of claim 1, further comprising a mapping component configured to provide a mapping of touch sensors on the sensory surface of the indirect interaction device to a display wherein the first target and the second target are provided for presentation on the display based at least in part on the mapping provided by the mapping component.

3. The system of claim 2, wherein the mapping component is configured to map the touch sensors on the sensory surface of the indirect interaction device to the display based at least in part upon an absolute display mapping technique.

4. The system of claim 2, wherein the mapping component is configured to map the touch sensors on the sensory surface of the indirect interaction device to the display based at least in part upon a relative display mapping technique.

5. The system of claim 2, wherein the mapping component is configured to map the touch sensors on the sensory surface of the indirect interaction device to the display based at least in part upon a heterogeneous mapping technique.

6. The system of claim 1, wherein the sensory surface and the display are separate physical components of the system.

7. The system of claim 1, the presentation component configured to provide for at least one of:

movement of the first target on the display independently of movement of the second target on the display; and

movement of the first target on the display dependently of movement of the second target on the display.

8. The system of claim 1, wherein the event comprises a first event and the system further comprises an execution component configured to provide for an engagement of an object in a user interface presented on the display based at least in part upon a received second event detected by the sensory surface.

9. An indirect interaction method, comprising:

receiving first input data indicative of a first event detected by a sensory surface of an indirect interaction device the first input data indicative of at least a first and second contact being applied relative to the sensory surface, the input data including a location of each of the at least a first and second contact relative to the sensory surface;

providing at least a first and second target to be presented on a the display based at least in part upon the first input data, the first target indicative of the first contact applied to the sensory surface and the second target indicative of the second contact applied to the sensory surface, the first target and the second target provided for presentation on the display based at least in part on the location of the first and second contact, respectively, relative to the sensory surface;

receiving second input data indicative of a second event detected by the sensory surface; and

engaging an object presented on the display based at least in part upon a position of the first target relative to the object and the received second input data.

10. The method of claim 9, comprising presenting a hover visualization of the first target based at least in part upon the first input data.

11. The method of claim 9, further comprising mapping touch sensors on the sensory surface of the indirect interaction device to the display, and wherein the providing the first and the second target to be presented on the display is based at least in part upon the mapping.

12. The method of claim 11, wherein the mapping comprises using at least one of an absolute mapping technique and a relative mapping technique.

13. The method of claim 9, the first event indicative of as first contact being applied relative to the sensory surface and the second event indicative of a second contact being applied relative to the sensory surface, the first and second events occurring substantially concurrently.

14. The method of claim 9, wherein the method further comprises mapping touch sensors on the sensory surface of the indirect interaction device to the display using an absolute mapping technique.

15. The method of claim 9, wherein the method further comprises mapping touch sensors on the sensory surface of the indirect interaction device to the display using a relative mapping technique.

16. The method of claim 9, the first event indicative of a first contact being applied relative to the sensory surface and the second event indicative of a change in a manner through which the first contact is being applied relative to the sensory surface.

17. The method of claim 16, the change indicative of a change in pressure applied to the sensory surface.

18. The method of claim 16, wherein the method further comprises mapping touch sensors on the sensory surface of the indirect interaction device to the display using an absolute mapping technique.

19. The method of claim 16, wherein the method further comprises mapping the first event to the display using a relative mapping technique.

20. A device comprising:

at least one processing unit and memory including instructions that when executed cause the at least one processing unit to;

receive first input data indicative of an event detected by a sensory surface of an the indirect interaction device the first input data indicative of a first and second contact being applied relative to the sensory surface, the input data including a location of each of the first and second contact relative to the sensory surface;

provide a first and second target to be presented on a display based at least in part upon the first input data, the first target indicative of the first contact applied to the sensory surface and the second target indicative of the second contact applied to the sensory surface, the first target and the second target provided for presentation on the display based at least in part on the location of the first and second contact, respectively, relative to the sensory surface;

receive second input data indicative of a second event detected by the sensory surface, where at least one of;

the first event is indicative of the first and second contact being applied relative to the sensory surface and the second event is indicative of the first and second contact being moved relative to the sensory surface, and

the first event is indicative of the first and second contact being applied relative to the sensory surface and the second event is indicative of a change in a manner through which the first contact is being applied relative to the sensory surface; and

engage an object presented on the display based at least in part upon the location of the first target relative to the object and the second input data.