NATURAL INPUT TRAINER FOR GESTURAL INSTRUCTION

• US 20110119216A1
• Filed: 11/16/2009
• Published: 05/19/2011
• Est. Priority Date: 11/16/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wigdor, Daniel J.
• Application Number:
  US12/619,575
• Publication Number:
  US 20110119216A1
• Time in Patent Office: Days
• US Class Current: 706/46
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A computing device that detects precursory user-input preactions executed in an instructive region and user-input action gestures executed in a functionally-active region is provided. The computing device includes a natural input trainer to present a predictive input cue on a display in response to detecting a precursory user-input preaction performed in the instructive region. The computing device also includes an interface engine to execute a computing function in response to detecting a successive user-input action gesture performed in the functionally-active region subsequent to detection of the precursory user-input preaction.

Claims

1. A computing device, comprising:

a display to visually present images to a user;

an input sensing subsystem to detect user-input hovers staged away from the display; and

a natural input trainer to present a predictive input cue on the display in response to the input sensing subsystem detecting a user-input hover staged away from the display.

2. The computing device of claim 1, wherein the predictive input cue includes a graphical representation of a proposed user-input touch executable against a touch-sensor and associated with a computing function if the user-input hover corresponds to a recognized posture.

3. The computing device of claim 1, wherein the predictive input cue includes a graphical representation of a proposed user-input hover stageable away from the display and associated with a set of input gestures if the user-input hover does not correspond to a recognized posture.

4. The computing device of claim 1, wherein the natural input trainer presents the predictive input cue after the user-input hover remains substantially stationary for a predetermined time period.

5. The computing device of claim 4, wherein the natural input trainer is configured to present a second predictive input cue in response to the user-input hover remaining substantially stationary for a second predetermined time period.

6. The computing device of claim 1, where the input sensing subsystem is configured to detect user-input touches executed against the display, and the computing device further comprises an interface engine to execute a computing function in response to the input sensing subsystem detecting a successive user-input touch executed against the display subsequent to the user-input hover staged away from the display.

7. The computing device of claim 6, wherein the computing function corresponds to the predictive input cue presented in response to the user-input hover.

8. The computing device of claim 6, wherein the computing function corresponds to one or more characteristics of the successive user-input touch executed against the display.

9. The computing device of claim 6, further comprising:

a logic subsystem in operative communication with the display and the input sensing subsystem; and

a data-holding subsystem holding instructions executable by the logic subsystem to present the predictive input cue and to execute the computing function.

10. The computing device of claim 6, wherein the predictive input cue includes a contextual function preview graphically representing a foreshadowed implementation of the computing function.

11. A computing device, comprising:

a display to visually present images to a user;

an input sensing subsystem to detect precursory user-input preactions executed in an instructive region and user-input action gestures executed in a functionally-active region; and

a natural input trainer to present a predictive input cue on the display in response to the input sensing subsystem detecting a precursory user-input preaction performed in the instructive region;

an interface engine to execute a computing function in response to the input sensing subsystem detecting a successive user-input action gesture performed in the functionally-active region subsequent to detection of the precursory user-input preaction.

12. The computing device of claim 11, wherein the functionally-active region is spaced away from the display.

13. The computing device of claim 11, wherein the predictive input cue includes a graphical representation of a proposed user-input action gesture executable in the functionally-active region and associated with a computing function if the precursory user-input preaction corresponds to a recognized posture.

14. The computing device of claim 11, wherein the predictive input cue includes a graphical representation of a proposed precursory user-input preaction stageable in the instructive region and associated with a set of input gestures if the precursory user-input preaction does not correspond to a recognized posture.

15. The computing device of claim 11, further comprising:

a logic subsystem in operative communication with the display and the input sensing subsystem; and

a data-holding subsystem holding instructions executable by the logic subsystem to present the predictive input cue and to execute the computing function.

16. The computing device of claim 11, wherein the input sensing subsystem includes a depth camera to detect 3-dimensional gestural input.

17. The computing device of claim 11, wherein the input sensing subsystem includes an infrared, vision-based, touch detection camera.

18. A method for teaching user-input techniques to a user of a computing device and implementing computing functions responsive to user-input comprising:

detecting a first precursory user-input preaction staged in an instructive region;

if the first precursory user-input preaction corresponds to a recognized posture, presenting on a display a graphical representation of a first proposed user-input action gesture that is executable in a functionally-active region and associated with a first computing function;

detecting a second precursory user-input preaction staged in the instructive region, the second precursory user-input preaction different than the first precursory user-input preaction;

if the second precursory user-input preaction corresponds to a recognized posture, presenting a graphical representation of a second proposed user-input action gesture that is executable in the functionally-active region and associated with a second computing function;

detecting a successive user-input action gesture executed in the functionally-active region subsequent to the first precursory user-input preaction and the second precursory user-input preaction; and

executing the second computing function in response to detecting the successive user-input action gesture.

19. The method of claim 18, wherein detecting the first precursory user-input preaction includes using an infrared, vision-based, touch detection camera to detect a user-input hover above a display surface;

and wherein detecting the successive user-input action gesture includes using the infrared, vision-based, touch detection camera to detect a touch against the display surface.

20. The method of claim 18, wherein detecting the first precursory user-input preaction includes using a depth camera to detect a 3-dimensional gestural input in a 3-dimensional volume constituting the instructive region;

and wherein detecting the successive user-input action includes using the depth camera to detect a 3-dimensional gestural input in a 3-dimensional volume constituting the functionally-active region.