TEACHING GESTURES WITH OFFSET CONTACT SILHOUETTES

• US 20110117535A1
• Filed: 11/16/2009
• Published: 05/19/2011
• Est. Priority Date: 11/16/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Freeman, Dustin, Benko, Hrvoje, Wigdor, Daniel J.
• Granted Patent: US 8,622,742 B2
• Time in Patent Office: Days
• US Class Current: 434/365
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G09B 19/003 Repetitive work cycles; Sequence of movements
• CPC Class Codes: G09B 19/0053 Computers, e.g. programming
• CPC Class Codes: G09B 19/24 Use of tools
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip

Abstract

A method for providing multi-touch input training on a display surface is disclosed. A touch input is detected at one or more regions of the display surface. A visualization of the touch input is displayed at a location of the display surface offset from the touch input. One or more annotations are displayed at a location of the display surface offset from the touch input and proximate to the visualization, where each annotation shows a different legal continuation of the touch input.

Claims

1. A method for providing touch input training on a display surface, comprising:

detecting a touch or hover input at one or more regions of the display surface;

displaying a visualization of the touch or hover input at a location of the display surface offset from the touch or hover input; and

displaying one or more annotations at a location of the display surface offset from the touch or hover input and proximate to the visualization, each annotation showing a different legal continuation of the touch or hover input.

2. The method of claim 1, where the visualization is displayed after the touch or hover input fails to change at a predetermined rate.

3. The method of claim 1, further comprising hiding the visualization upon completion of a legal continuation of the touch or hover input.

4. The method of claim 1, where the one or more annotations includes information indicating a direction a continuation of the touch or hover input should move to execute a legal continuation of the touch or hover input.

5. The method of claim 4, where the information indicating a direction a continuation of the touch or hover input should move to execute a legal continuation of the touch or hover input includes an arrow.

6. The method of claim 4, where the information indicating a direction a continuation of the touch or hover input should move to execute a legal continuation of the touch or hover input includes a path.

7. The method of claim 1, where the one or more annotations includes a first annotation displayed with a first color and a second annotation displayed with a second color different from the first color, the first annotation indicating a first legal continuation of the touch or hover input, and the second annotation indicating a second legal continuation of the touch or hover input, different from the first legal continuation of the touch or hover input.

8. The method of claim 1, where the one or more annotations includes one or more images simulating a touch or hover input at a corresponding one or more successive time frames to indicate a legal continuation of the touch or hover input.

9. The method of claim 1, where the one or more annotations includes textual information describing a legal continuation of the touch or hover input.

10. The method of claim 1, where the visualization of the touch or hover input includes a contact silhouette showing which portions of an input object performing the touch or hover input are in contact with the display surface.

11. The method of claim 1, where the visualization includes a progress bar indicating a level of completion of a continuation of the touch or hover input.

12. The method of claim 1, further comprising providing a notification to discontinue the touch or hover input upon completion of a continuation of the touch input.

13. A method for providing hand gesture training on a display surface, comprising:

detecting a hand gesture on the display surface;

displaying a contact silhouette showing, at a location of the display surface offset from the hand gesture, regions of a hand performing the hand gesture that are in contact with the display surface; and

displaying one or more annotations proximate to the contact silhouette, each annotation showing a different legal hand gesture continuation.

14. The method of claim 13, where the contact silhouette and the one or more annotations proximate to the contact silhouette are displayed after the hand gesture fails to change at a predetermined rate.

15. The method of claim 13, further comprising hiding the contact silhouette and the one or more annotations proximate to the contact silhouette upon completion of the hand gesture.

16. The method of claim 13, where the one or more annotations includes a first annotation displayed with a first color and a second annotation displayed with a second color different from the first color, the first annotation indicating a first legal continuation of the hand gesture, and the second annotation indicating a second legal continuation of the hand gesture, different from the first legal continuation of the hand gesture.

17. The method of claim 13, where the one or more annotations includes one or more images simulating a hand gesture at a corresponding one or more successive time frames to indicate a legal continuation of the hand gesture.

18. The method of claim 13, where the one or more annotations includes a progress bar indicating a level of completion of a continuation of the hand gesture.

19. A computing system, comprising:

a display surface configured to receive touch input;

a logic subsystem operatively connected to the display surface; and

a data-holding subsystem holding instructions executable by the logic subsystem to;

detect a touch input at one or more regions of the display surface;

display a visualization of the touch input at a location of the display surface offset from the touch input; and

display one or more annotations at a location of the display surface offset from the touch input and proximate to the visualization, each annotation showing a different legal continuation of the touch input.

20. The computing system of claim 19, where the visualization of the touch input includes a contact silhouette showing regions of a hand performing a hand gesture that are in contact with the display surface.