Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques

• US 8,674,948 B2
• Filed: 01/31/2008
• Issued: 03/18/2014
• Est. Priority Date: 01/31/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Han, Jefferson Y., Davidson, Philip L.
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): SCHNIREL, ANDREW B
• Application Number:
  US12/024,007
• Publication Number:
  US 20080180406A1
• Time in Patent Office: 2,238 Days
• Field of Search: 345/173
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods and systems for interfacing with multi-point input devices employ various techniques for controlling displayed images, including 2D and 3D image translation, scale/zoom, rotation control and globe axis tilt control. Various techniques employ three or more simultaneous inputs, changes in characteristics of those inputs, and pressure sensing, among other things.

Claims

1. A method of interfacing with a multi-point input device, comprising steps of:

displaying a three-dimensional (3D) graphical representation of an object on a display surface of a display device, wherein the displayed 3D graphical representation is divided into first and second halves;

detecting positions of a plurality of elements that are simultaneously in contact with the display surface of the display device on which the 3D graphical representation of an object is displayed;

ascertaining amounts of pressure exerted by the elements on the display surface; and

controlling a change in the 3D graphical representation of an object displayed on the display device in accordance with the ascertained amounts of pressure exerted by the elements on the display surface by effecting a rotation of the displayed 3D graphical representation of an object about an axis parallel to a display plane substantially corresponding to the display surface on which the 3D graphical representation of an object is displayed, wherein controlling the change in the displayed 3D graphical representation comprises;

identifying a first subset of the elements as being disposed on the first half of the displayed 3D graphical representation;

identifying a second subset of the elements as being disposed on the second half of the displayed 3D graphical representation; and

comparing amounts of pressure exerted by the elements in the first subset with amounts of pressure exerted by the elements in the second subset, and effecting a rotation of the displayed 3D graphical representation about the axis as a function of a difference between the amounts of pressure exerted by the elements in the first subset and the amounts of pressure exerted by the elements in the second subset.

2. The method of claim 1, wherein controlling the change in the displayed 3D graphical representation of an object on the display device comprises effecting a rotation of the displayed 3D graphical representation of an object in a direction corresponding to the ascertained amounts of pressure exerted by the elements on the display device.

3. The method of claim 1, wherein the rotation axis is parallel to an axis extending through positions of first and second elements that are simultaneously in contact with the display device.

4. The method of claim 1,

further comprising identifying a circle in which positions of all of the elements that are simultaneously in contact with the display surface of the display device are disposed;

and

wherein the rotation axis extends through a centerpoint of the circle and is parallel to an axis extending through positions of at least two of the elements.

5. The method of claim 1, wherein displaying a 3D graphical representation of an object on the display device comprises displaying the 3D graphical representation of an object on a pressure-sensitive display device adapted to ascertain amounts of pressure exerted by the elements contacting the display device.

6. The method of claim 1, wherein ascertaining amounts of pressure exerted by the elements on the display surface comprises ascertaining pressure as a function of an area of contact by a respective one of the elements contacting the display surface.

7. The method of claim 1, wherein controlling a change in the 3D graphical representation of an object displayed on the display device comprises ascertaining a virtual depth below a contact surface of the display device of each of the elements contacting the contact surface as a function of the amount of pressure exerted by the respective element on the contact surface, and effecting a rotation of the displayed 3D graphical representation of an object in accordance with the identified virtual depths of the elements contacting the contact surface.

8. The method of claim 1, wherein controlling a change in the 3D graphical representation of an object displayed on the display device comprises:

accessing a predetermined minimum pressure threshold;

comparing the pressure exerted by the elements to the predetermined minimum pressure threshold;

determining whether the pressure exerted by the elements on the display surface of the display device exceeds the predetermined minimum pressure threshold based on results of the comparison, and

if the pressure exerted by the elements is determined to exceed the predetermined minimum pressure threshold, effecting a rotation of the displayed 3D graphical representation of an object about the axis in accordance with the ascertained amounts of pressure exerted by the elements on the display surface of the display device.

9. The method of claim 1, wherein detecting positions of a plurality of elements that are simultaneously in contact with the display device comprises detecting positions of at least three elements that are simultaneously in contact with the display surface of the display device, the method further comprising a step of identifying a change in an attribute of any of the elements;

and wherein controlling a change in the 3D graphical representation of an object displayed on the display device comprises controlling a change in the displayed 3D graphical representation of an object both in accordance with the ascertained amounts of pressure exerted by the plurality of elements on the display surface of the display device and in accordance with the identified change in the attribute.

19. The method of claim 8, wherein controlling a change in the 3D graphical representation of an object displayed on the display device further comprises preventing rotation of the displayed 3D graphical representation of an object about the axis if the pressure exerted by the elements is determined to not exceed the predetermined minimum threshold.

20. The multi-point input system of claim 19, wherein the controller being configured to control a change in the 3D graphical representation of an object displayed on the display device further includes the controller being configured to prevent rotation of the displayed 3D graphical representation of an object about the axis if the pressure exerted by the elements is determined to not exceed the predetermined minimum threshold.

22. The method of claim 1, wherein detecting positions of a plurality of elements that are simultaneously in contact with the display surface of the display device comprises detecting positions of a plurality of elements that are simultaneously in contact with the displayed 3D graphical representation of an object on the display surface.

10. A multi-point input system, comprising:

a display device configured to display a three-dimensional (3D) graphical representation of an object on a display surface and detect positions of a plurality of elements that are simultaneously in contact with the display surface on which the 3D graphical representation of an object is displayed, wherein the displayed 3D graphical representation is divided into first and second halves; and

a controller configured to ascertain amounts of pressure exerted by the elements on the display surface and control a change in the 3D graphical representation of an object displayed by the display device in accordance with the ascertained amounts of pressure exerted by the elements on the display surface by effecting a rotation of the displayed 3D graphical representation of an object about an axis parallel to a display plane substantially corresponding to the display surface on which the 3D graphical representation of an object is displayed, the controller being further configured to;

identify a first subset of the elements as being disposed on the first half of the displayed 3D graphical representation;

identify a second subset of the elements as being disposed on the second half of the displayed 3D graphical representation; and

compare amounts of pressure exerted by the elements in the first subset with amounts of pressure exerted by the elements in the second subset, and effect a rotation of the 3D graphical representation displayed by the display device about the rotation axis as a function of a difference between the amounts of pressure exerted by the elements in the first subset and the amounts of pressure exerted by the elements in the second subset.

11. The multi-point input system of claim 10, wherein the controller is configured to effect a rotation of the displayed 3D graphical representation of an object in a direction corresponding to the ascertained amounts of pressure exerted by the elements on the display surface.

12. The multi-point input system of claim 10, wherein the rotation axis is parallel to an axis extending through positions of first and second elements that are simultaneously in contact with the display surface.

13. The multi-point input system of claim 10, wherein the controller is configured to identify a circle in which positions of all of the elements that are simultaneously in contact with the display surface are disposed, and wherein the rotation axis extends through a centerpoint of the circle and is parallel to an axis extending through positions of at least two of the elements.

14. The multi-point input system of claim 10, wherein the display device is a pressure-sensitive display device adapted to ascertain amounts of pressure exerted by the elements contacting the display surface.

15. The multi-point input system of claim 10, wherein the controller is configured to ascertain pressure as a function of an area of contact by a respective one of the elements contacting the display surface.

16. The multi-point input system of claim 10, wherein the controller is configured to ascertain a virtual depth below the display surface of the display device of each of the elements contacting the display surface as a function of the amount of pressure exerted by the respective element on the display surface and effect a rotation of the displayed 3D graphical representation of an object in accordance with the identified virtual depths of the elements contacting the display surface.

17. The multi-point input system of claim 10, wherein the controller being configured to control a change in the 3D graphical representation of an object displayed on the display device includes the controller being configured to:

access a predetermined minimum pressure threshold;

compare the pressure exerted by the elements to the predetermined minimum pressure threshold;

determine whether the pressure exerted by the elements on the display surface of the display device exceeds the predetermined minimum pressure threshold based on results of the comparison, and

if the pressure exerted by the elements is determined to exceed the predetermined minimum pressure threshold, effect a rotation of the 3D graphical representation of an object displayed by the display device about the axis in accordance with the ascertained amounts of pressure exerted by the elements on the display surface.

18. The multi-point input system of claim 10, wherein the controller is configured to detect positions of at least three elements that are simultaneously in contact with the display surface, identify a change in an attribute of any of the elements;

and

control a change in the 3D graphical representation of an object displayed on the display surface both in accordance with the ascertained amounts of pressure exerted by the elements on the display surface and in accordance with the identified change in the attribute of the elements.

23. The multi-point input system of claim 10, wherein the display device being configured to detect positions of a plurality of elements that are simultaneously in contact with the display surface of the display device comprises the display device being configured to detect positions of a plurality of elements that are simultaneously in contact with the displayed 3D graphical representation of an object on the display surface.

21. A method of interfacing with a multi-point input device, comprising steps of:

detecting positions of a plurality of elements that are simultaneously in contact with a display surface of a display device;

ascertaining amounts of pressure exerted by the plurality of elements on the display surface at a first time;

generating first display data corresponding to a first three-dimensional 3D graphical representation of an object at a first orientation, the first display data being determined as a function of the ascertained amounts of pressure exerted by the plurality of elements at the first time on the display surface;

using the first display data to display the first 3D graphical representation of the object on the display surface of the display device;

ascertaining amounts of pressure exerted by the plurality of elements on the display surface at a second time subsequent to the first time, the ascertained amounts of pressure exerted at the second time being different from the ascertained amounts of pressure exerted at the first time;

generating second display data corresponding to a second 3D graphical representation of the object at a second orientation, the second orientation corresponding to an orientation of the object resulting from the object at the first orientation being rotated an amount that is a function of a difference between the ascertained amounts of pressure exerted at the first time on the display surface and the ascertained amounts of pressure exerted at the second time on the display surface, the rotation being about an axis parallel to a display plane substantially corresponding to the display surface; and

using the second display data to display, on the display surface of the display device, the second 3D graphical representation of the object in place of the first 3D graphical representation of the object.

24. The method of interfacing with a multi-point input device of claim 21, wherein detecting positions of a plurality of elements that are simultaneously in contact with the display surface of the display device comprises detecting positions of a plurality of elements that are simultaneously in contact with the first 3D graphical representation of the object on the display surface.

25. A method of interfacing with a multi-point input device, comprising steps of:

displaying a three-dimensional (3D) graphical representation of an object on a display device;

detecting positions of a plurality of elements that are simultaneously in contact with the display device;

ascertaining amounts of pressure exerted by the elements on the display device;

controlling a change in the 3D graphical representation of an object displayed on the display device in accordance with the ascertained amounts of pressure exerted by the elements on the display device; and

identifying a circle in which positions of all of the plurality of the elements that are simultaneously in contact with the display device are disposed,

wherein controlling a change in the 3D graphical representation of an object displayed on the display device comprises effecting a rotation of the displayed 3D graphical representation of an object about a rotation axis that extends through a centerpoint of the circle, the rotation axis being parallel to an axis extending through positions of at least two of the elements and the rotation axis being disposed substantially within a display plane substantially corresponding to a surface of the display device on which the 3D graphical representation of an object is displayed.

26. A method of interfacing with a multi-point input device, comprising steps of:

displaying a three-dimensional (3D) graphical representation of an object on a display device;

detecting positions of a plurality of elements that are simultaneously in contact with the display device;

ascertaining amounts of pressure exerted by the elements on the display device; and

controlling a change in the 3D graphical representation of an object displayed on the display device in accordance with the ascertained amounts of pressure exerted by the elements on the display device,

wherein the displayed 3D graphical representation of an object is divided into first and second halves, and

wherein controlling a change in the 3D graphical representation of an object displayed on the display device comprises;

identifying a first subset of the elements as being disposed on the first half of the displayed 3D graphical representation of an object;

identifying a second subset of the elements as being disposed on the second half of the displayed 3D graphical representation of an object; and

comparing amounts of pressure exerted by the elements in the first subset with amounts of pressure exerted by the elements in the second subset, and effecting a rotation of the displayed 3D graphical representation of an object as a function of a difference between the amounts of pressure exerted by the elements in the first subset and the amounts of pressure exerted by the elements in the second subset.