METHODS OF INTERFACING WITH MULTI-POINT INPUT DEVICES AND MULTI-POINT INPUT SYSTEMS EMPLOYING INTERFACING TECHNIQUES

• US 20080180405A1
• Filed: 01/31/2008
• Published: 07/31/2008
• Est. Priority Date: 01/31/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Davidson, Philip L., HAN, Jefferson Y.
• Granted Patent: US 8,368,653 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods and systems for interfacing with multi-point input devices employ various techniques for controlling displayed images, including 2D and 3D image translation, scale/zoom, rotation control and globe axis tilt control. Various techniques employ three or more simultaneous inputs, changes in characteristics of those inputs, and pressure sensing, among other things.

Claims

1. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device;

detecting positions of first and second elements simultaneously contacting the display device;

identifying a rotation axis in accordance with the positions of the first and second elements;

detecting a third element contacting the display device simultaneously with the contacting of the display device by the first and second elements; and

controlling, after detecting the third element, a rotation of the image displayed on the display device about the rotation axis.

2. The method of claim 1, wherein detecting the third element contacting the display device occurs after the first and second elements are detected.

3. The method of claim 1, wherein identifying a rotation axis comprises identifying a rotation axis extending through the positions of the first and second elements parallel to a plane substantially corresponding to a display surface of the display device on which the image is displayed.

4. The method of claim 1, wherein controlling a rotation of the image comprises controlling an amount of rotation as a function of an amount of time the third element is detected.

5. The method of claim 1, wherein controlling a rotation of the image comprises controlling, after detecting the third element within a control area, a rotation of the image displayed on the display device, the control area being defined by positions of the first and second elements.

6. The method of claim 1, wherein controlling a rotation of the image comprises controlling a rotation of the image at a constant rate while the third element is detected.

7. The method of claim 1, wherein controlling a rotation of the image comprises controlling a rotation of the image at a progressively increasing rate while the third element is continuously detected.

8. The method of claim 1, wherein controlling a rotation of the image comprises controlling a rotation of the image in a direction that is a function of a position of the third element.

9. The method of claim 1, wherein controlling a rotation of the image comprises controlling a rotation of the image in a first direction when the third element is disposed on a first side of an axis passing through the first and second elements;

and controlling the rotation of the image in a second direction opposite the first direction when the third element is disposed on a second side opposite the first side of the axis passing through the first and second elements.

10. The method of claim 1, further comprising detecting a fourth element contacting the display device simultaneously with the contacting of the display device by the first, second and third elements;

and wherein controlling a rotation of the image displayed on the display device comprises controlling, after detecting the third element, a rotation of the image in a direction corresponding to a position of the fourth element.

11. The method of claim 1, further comprising identifying an amount of pressure exerted by the third element on the display device;

and wherein controlling a rotation of the image comprises controlling a rotation of the image in accordance with the amount of pressure exerted by the third element.

12. The method of claim 1, wherein controlling a rotation of the image comprises controlling a rotation of the image in accordance with an amount of movement of the third element while contacting the display device.

13. The method of claim 12, wherein controlling a rotation of the image comprises controlling a direction and rate of rotation of the image as a function of a direction and length of movement of the third element while contacting the display device.

14. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device;

detecting positions of first and second elements simultaneously contacting a contact surface of the multi-point input device;

identifying a rotation axis of the image in accordance with the positions of the first and second elements;

detecting a third element contacting the contact surface of the multi-point input device simultaneously with the contacting of the contact surface by the first and second elements; and

controlling, after detecting the third element, a rotation of the image displayed on the display device about the rotation axis.

15. A multi-point input system, comprising:

a display device for displaying an image, the display device adapted to detect positions of first and second elements simultaneously contacting the display device and to detect a third element contacting the display device simultaneously with the contacting of the display device by the first and second elements; and

a controller for identifying a rotation axis in accordance with the positions of the first and second elements, and controlling, after the third element is detected, a rotation of the image displayed on the display device about the rotation axis.

16. The multi-point input system of claim 15, wherein the display device detects the third element contacting the display device after the first and second elements are detected.

17. The multi-point input system of claim 15, wherein the controller identifies a rotation axis extending through the positions of the first and second elements parallel to a plane substantially corresponding to a display surface of the display device on which the image is displayed.

18. The multi-point input system of claim 15, wherein the controller controls an amount of rotation as a function of an amount of time the third element is detected.

19. The multi-point input system of claim 15, wherein the controller controls, after detecting the third element within a control area, a rotation of the image displayed on the display device, the control area being defined by positions of the first and second elements.

20. The multi-point input system of claim 15, wherein the controller controls a rotation of the image at a constant rate while the third element is detected.

21. The multi-point input system of claim 15, wherein the controller controls a rotation of the image at a progressively increasing rate while the third element is continuously detected.

22. The multi-point input system of claim 15, wherein the controller controls a rotation of the image in a direction that is a function of a position of the third element.

23. The multi-point input system of claim 15, wherein the controls a rotation of the image in a first direction when the third element is disposed on a first side of an axis passing through the first and second elements, and controls the rotation of the image in a second direction opposite the first direction when the third element is disposed on a second side opposite the first side of the axis passing through the first and second elements.

24. The multi-point input system of claim 15, wherein the display device detects a fourth element contacting the display device simultaneously with the contacting of the display device by the first, second and third elements;

and wherein the controller controls, after detecting the third element, a rotation of the image in a direction corresponding to a position of the fourth element.

25. The multi-point input system of claim 15, wherein the controller identifies an amount of pressure exerted by the third element on the display device, and controls a rotation of the image in accordance with the amount of pressure exerted by the third element.

26. The multi-point input system of claim 15, wherein the controller controls a rotation of the image in accordance with an amount of movement of the third element while contacting the display device.

27. The multi-point input system of claim 26, wherein the controller controls a direction and rate of rotation of the image as a function of a direction and length of movement of the third element while contacting the display device.

28. A multi-point input system, comprising:

a display device for displaying an image;

a multi-point input device having a contact surface, the multi-point input device adapted to detect positions of first and second elements simultaneously contacting the contact surface and to detect a third element contacting the contact surface simultaneously with the contacting of the contact surface by the first and second elements; and

a controller for identifying a rotation axis of the image in accordance with the positions of the first and second elements, and controlling, after the third element is detected, a rotation of the image displayed by the display device about the rotation axis.

29. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device, the image representing a three-dimensional graphical representation of a globe;

detecting positions and movements of first and second elements simultaneously contacting the display device;

controlling a change in the image corresponding to a change in a view of the globe resulting from a change in at least one of latitude, longitude, range and azimuth of the view in accordance with the detected movements of the first and second elements simultaneously contacting the display device;

detecting a position and movement of a third element contacting the display device simultaneously with the contacting of the display device by the first and second elements; and

controlling a change in the image corresponding to a change in a tilt of the globe in accordance with the detected movement of the third element contacting the display device.

30. The method of claim 29, wherein controlling a change in the image corresponding to a change in a view of the globe comprises controlling a change in the image corresponding to changes in all of latitude, longitude, range and azimuth in accordance with the detected movements of the first and second elements simultaneously contacting the display device.

31. The method of claim 30, wherein controlling a change in the image corresponding to a change in a tilt of the globe is carried out simultaneously with the change in the image corresponding to changes in all of the latitude, longitude, range and azimuth of the globe.

32. The method of claim 29, wherein controlling a change in the image corresponding to a change in a tilt of the globe comprises controlling a change in the image corresponding to a change in a tilt of the globe at a tilt angle that is a function of a vertical distance moved by the third element while contacting the display device.

33. The method of claim 29, wherein controlling a change in the image corresponding to a change in a tilt of the globe comprises controlling a change in the image corresponding to a change in a tilt of the globe at a rate of rotation that is a function of a distance moved by the third element while contacting the display device.

34. The method of claim 29, wherein controlling a change in the image corresponding to a change in a tilt of the globe is carried out only if an initial position of the third element contacting the display device is at least a predetermined distance away from the positions of the first and second elements.

35. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device, the image representing a three-dimensional graphical representation of a globe;

detecting positions and movements of first and second elements simultaneously contacting a contact surface of a multi-point input device;

controlling a change in the image displayed on the display device corresponding to a change in a view of the globe resulting from a change in at least one of latitude, longitude, range and azimuth of the view in accordance with the detected movements of the first and second elements simultaneously contacting the contact surface of the multi-point input device;

detecting a position and movement of a third element contacting the contact surface of the multi-point input device simultaneously with the contacting of the contact surface by the first and second elements; and

controlling a change in the image displayed on the display device corresponding to a change in a tilt of the globe in accordance with the detected movement of the third element contacting the contact surface.

36. A multi-point input system, comprising:

a display device for displaying an image representing a three-dimensional graphical representation of a globe; and

a controller for detecting positions and movements of first and second elements simultaneously contacting the display device, controlling a change in the image corresponding to a change in a view of the globe resulting from a change in at least one of latitude, longitude, range and azimuth of the view in accordance with the detected movements of the first and second elements simultaneously contacting the display device, detecting a position and movement of a third element contacting the display device simultaneously with the contacting of the display device by the first and second elements, and controlling a change in the image corresponding to a change in a tilt of the globe in accordance with the detected movement of the third element contacting the display device.

37. The multi-point input system of claim 36, wherein the controller controls a change in the image corresponding to changes in all of latitude, longitude, range and azimuth in accordance with the detected movements of the first and second elements simultaneously contacting the display device.

38. The multi-point input system of claim 37, wherein the controller controls a change in the image corresponding to a change in a tilt of the globe simultaneously with the change in the image corresponding to changes in all of the latitude, longitude, range and azimuth of the globe.

39. The multi-point input system of claim 36, wherein the controller controls a change in the image corresponding to a change in a tilt of the globe at a tilt angle that is a function of a vertical distance moved by the third element while contacting the display device.

40. The multi-point input system of claim 36, wherein the controller controls a change in the image corresponding to a change in a tilt of the globe at a rate of rotation that is a function of a distance moved by the third element while contacting the display device.

41. The multi-point input system of claim 36, wherein the controller controls a change in the image corresponding to a change in a tilt of the globe only if an initial position of the third element contacting the display device is at least a predetermined distance away from the positions of the first and second elements.

42. A multi-point input system, comprising:

a display device for displaying an image representing a three-dimensional graphical representation of a globe;

a multi-point input device having a contact surface, the multi-point input device adapted to detect positions and movements of first, second and third elements simultaneously contacting the contact surface; and

a controller for controlling a change in the image displayed by the display device corresponding to a change in a view of the globe resulting from a change in at least one of latitude, longitude, range and azimuth of the view in accordance with the detected movements of the first and second elements simultaneously contacting the contact surface of the multi-point input device, and for controlling a change in the image displayed by the display device corresponding to a change in a tilt of the globe in accordance with the detected movement of the third element contacting the contact surface of the multi-point input device.

43. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device, the image representing a three-dimensional graphical representation of a globe;

detecting positions of first and second elements simultaneously contacting the display device;

identifying a virtual axis in accordance with the positions of the first and second elements;

detecting a third element contacting the display device simultaneously with the contacting of the display device by the first and second elements; and

controlling, after detecting the third element, a tilt adjustment of the globe represented by the image displayed on the display device in accordance with the virtual axis and the position of the third element.

44. The method of claim 43, wherein controlling a tilt adjustment comprises controlling a magnitude of tilt adjustment of the globe represented by the image displayed on the display device as a function of a distance between the position of the third element and the virtual axis.

45. The method of claim 43, wherein controlling a tilt adjustment comprises controlling a direction of tilt adjustment of the globe represented by the image displayed on the display device in a first direction when the third element is disposed on a first side of the virtual axis and in a second direction opposite the first direction when the third element is disposed on a second side of the virtual axis opposite the first side.

46. The method of claim 43, further comprising ascertaining an amount of pressure exerted by the third element on the display device;

and wherein controlling a tilt adjustment comprises controlling a tilt adjustment of the globe represented by the image displayed on the display device in accordance with the ascertained amount of pressure exerted by the third element.

47. A method of interfacing with a multi-point input device, comprising the steps of:

displaying an image on a display device, the image representing a three-dimensional graphical representation of a globe;

detecting positions of first and second elements simultaneously contacting a contact surface of a multi-point input device;

identifying a virtual axis in accordance with the positions of the first and second elements on the contact surface of the multi-point input device;

detecting a third element contacting the contact surface of the multi-point input device simultaneously with the contacting of the contact surface by the first and second elements; and

controlling, after detecting the third element, a tilt adjustment of the globe represented by the image displayed on the display device in accordance with the virtual axis and the position of the third element on the contact surface of the multi-point input device.

48. A multi-point input system, comprising:

a display device for displaying an image representing a three-dimensional graphical representation of a globe; and

a controller for detecting positions of first and second elements simultaneously contacting the display device, identifying a virtual axis in accordance with the positions of the first and second elements, detecting a third element contacting the display device simultaneously with the contacting of the display device by the first and second elements, and controlling, after detecting the third element, a tilt adjustment of the globe represented by the image displayed on the display device in accordance with the virtual axis and the position of the third element.

49. The multi-point input system of claim 48, wherein the controller controls a magnitude of tilt adjustment of the globe represented by the image displayed on the display device as a function of a distance between the position of the third element and the virtual axis.

50. The multi-point input system of claim 48, wherein the controller controls a direction of tilt adjustment of the globe represented by the image displayed on the display device in a first direction when the third element is disposed on a first side of the virtual axis and in a second direction opposite the first direction when the third element is disposed on a second side of the virtual axis opposite the first side.

51. The multi-point input system of claim 48, wherein the controller ascertains an amount of pressure exerted by the third element on the display device, and controls a tilt adjustment of the globe represented by the image displayed on the display device in accordance with the ascertained amount of pressure exerted by the third element.

52. A multi-point input system, comprising:

a display device for displaying an image representing a three-dimensional graphical representation of a globe;

a multi-point input device having a contact surface, the multi-point input device adapted to detect positions of first, second and third elements simultaneously contacting the contact surface; and

a controller for identifying a virtual axis in accordance with the positions of the first and second elements on the contact surface of the multi-point input device; and

controlling, after the third element is detected, a tilt adjustment of the globe represented by the image displayed on the display device in accordance with the virtual axis and the position of the third element on the contact surface of the multi-point input device.