Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques

• US 8,269,729 B2
• Filed: 01/31/2008
• Issued: 09/18/2012
• Est. Priority Date: 01/31/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Han, Jefferson Y., Davidson, Philip L.
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): SCHNIREL, ANDREW B
• Application Number:
  US12/024,001
• Publication Number:
  US 20080180404A1
• Time in Patent Office: 1,692 Days
• Field of Search: 345/173
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods and systems for interfacing with multi-point input devices employ various techniques for controlling displayed images, including 2D and 3D image translation, scale/zoom, rotation control and globe axis tilt control. Various techniques employ three or more simultaneous inputs, changes in characteristics of those inputs, and pressure sensing, among other things.

Claims

1. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device, the image corresponding to a three-dimensional graphical representation of an object;

detecting positions of at least three elements that are simultaneously in contact with the display device;

identifying a change in an attribute of the at least three elements;

controlling a change in the image displayed on the display device in accordance with the identified change in the attribute of the at least three elements, and

calculating a centroid of the at least three elements,

wherein identifying a change in an attribute comprises;

identifying-movement of the centroid of the at least three elements, and

identifying changes in distances of the positions of the elements to the centroid;

and

wherein controlling a change in the image displayed on the display device comprises;

controlling translation of the three-dimensional graphical representation of the object along X and Y axes in accordance with movement of the centroid, and

controlling movement of the three-dimensional graphical representation of the object along a Z axis as a function of the identified changes in distances of the positions of the elements to the centroid, the X, Y and Z axes being perpendicular to one another.

2. The method of claim 1, further comprising calculating a centroid of the object,

wherein controlling translation of the three-dimensional graphical representation of the object comprises controlling the image so that the centroid of the object moves in accordance with movement of the centroid of the at least three elements.

3. The method of claim 1, wherein the Z axis is normal to a display surface of the display device.

4. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device, the image corresponding to a three-dimensional graphical representation of an object;

detecting positions of at least three elements that are simultaneously in contact with a multi-point input device;

identifying a change in an attribute of the at least three elements;

controlling a change in the image displayed on the display device in accordance with the identified change in the attribute of the at least three elements, and

calculating a centroid of the at least three elements,

wherein identifying a change in an attribute comprises;

identifying-movement of the centroid of the at least three elements, and

identifying changes in distances of the positions of the elements to the centroid;

and

wherein controlling a change in the image displayed on the display device comprises;

controlling translation of the three-dimensional graphical representation of the object along X and Y axes in accordance with movement of the centroid, and

controlling movement of the three-dimensional graphical representation of the object along a Z axis as a function of the identified changes in distances of the positions of the elements to the centroid, the X, Y and Z axes being perpendicular to one another.

8. The method of claim 4, wherein the Z axis is normal to a display surface of the display device.

10. The method of claim 4, further comprising calculating a centroid of the object,

wherein controlling translation of the three-dimensional graphical representation of the object comprises controlling the image so that the centroid of the object moves in accordance with movement of the centroid of the at least three elements.

5. A multi-point input system, comprising

a display device configured to display an image on a display surface, and detect positions of at least three elements that are simultaneously in contact with the display surface, the image corresponding to a three-dimensional graphical representation of an object;

and

a controller configured to identify a change in an attribute of the at least three elements, and control a change in the image displayed on the display device in accordance with the identified change in the attribute of the at least three elements,

wherein the controller is further configured to;

calculate a centroid of the at least three elements;

identify a position and movement of the centroid of the at least three elements,

identify changes in distances of the positions of the elements to the centroid;

control translation as displayed on the display device of the three-dimensional graphical representation of the object along X and Y axes in accordance with movement of the centroid, and

control movement of the three-dimensional graphical representation of the object along a Z axis as a function of the identified changes in distances of the positions of the elements to the centroid, the X, Y and Z axes being perpendicular to one another.

6. The multi-point input system of claim 5, wherein the Z axis is normal to the display surface of the display device.

11. The multi-point input system of claim 5, wherein the controller is further configured to calculate a centroid of the object,

wherein the controller being configured to control translation of the three-dimensional graphical representation of the object comprises the controller being configured to control the image so that the centroid of the object moves in accordance with movement of the centroid of the at least three elements.

7. A multi-point input system, comprising

a display device configured to display an image corresponding to a three-dimensional graphical representation of an object;

a multi-point input device having a contact surface, the multi-point input device adapted to detect positions of at least three elements that are simultaneously in contact with the contact surface; and

a controller configured to identify a change in an attribute of the at least three elements based on the detected positions of the elements contacting the contact surface, and control a change in the image displayed by the display device in accordance with the identified change in the attribute of the at least three elements,

wherein the controller is further configured to;

calculate a centroid of the at least three elements;

identify a position and movement of the centroid of the at least three elements,

identify changes in distances of the positions of the elements to the centroid;

control translation as displayed on the display device of the three-dimensional graphical representation of the object along X and Y axes in accordance with movement of the centroid, and

control movement of the three-dimensional graphical representation of the object along a Z axis as a function of the identified changes in distances of the positions of the elements to the centroid, the X, Y and Z axes being perpendicular to one another.

9. The multi-point input system of claim 7, wherein the Z axis is normal to the display surface of the display device.

12. The multi-point input system of claim 7, wherein the controller is further configured to calculate a centroid of the object,

wherein the controller being configured to control translation of the three-dimensional graphical representation of the object comprises the controller being configured to control the image so that the centroid of the object moves in accordance with movement of the centroid of the at least three elements.

13. A multi-point input system, comprising

a display device configured to display an image on a display surface, and detect positions of at least three elements that are simultaneously in contact with the display surface, the image corresponding to a three-dimensional graphical representation of an object;

and

a controller configured to identify a change in an attribute of the at least three elements, and control a change in the image displayed on the display device in accordance with the identified change in the attribute of the at least three elements, and calculate a centroid of the at least three elements,

wherein the controller includes means for;

identifying a position and movement of the centroid of the at least three elements,

identifying changes in distances of the positions of the elements to the centroid;

controlling translation as displayed on the display device of the three-dimensional graphical representation of the object along X and Y axes in accordance with movement of the centroid, and

controlling movement of the three-dimensional graphical representation of the object along a Z axis as a function of the identified changes in distances of the positions of the elements to the centroid, the X, Y and Z axes being perpendicular to one another.

14. A multi-point input system, comprising

a display device configured to display an image corresponding to a three-dimensional graphical representation of an object;

a multi-point input device having a contact surface, the multi-point input device adapted to detect positions of at least three elements that are simultaneously in contact with the contact surface; and

a controller configured to identify a change in an attribute of the at least three elements based on the detected positions of the elements contacting the contact surface, and control a change in the image displayed by the display device in accordance with the identified change in the attribute of the at least three elements, and calculate a centroid of the at least three elements,

wherein the controller includes means for;

identifying a position and movement of the centroid of the at least three elements,

identifying changes in distances of the positions of the elements to the centroid;

controlling translation as displayed on the display device of the three-dimensional graphical representation of the object along X and Y axes in accordance with movement of the centroid, and

controlling movement of the three-dimensional graphical representation of the object along a Z axis as a function of the identified changes in distances of the positions of the elements to the centroid, the X, Y and Z axes being perpendicular to one another.