Gesture based user interface for augmented reality

• US 9,823,752 B2
• Filed: 11/28/2016
• Issued: 11/21/2017
• Est. Priority Date: 06/21/2011
• Status: Expired due to Fees

• Current Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Bromer, Nicholas S.
• Primary Examiner(s): LANDIS, LISA S
• Application Number:
  US15/361,638
• Publication Number:
  US 20170075429A1
• Time in Patent Office: 358 Days
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Technologies are generally described for systems and methods effective to provide a gesture keyboard that can be utilized with a virtual display. In an example, the method includes receiving sensory information associated with an object in proximity to, or in contact with, an input device including receiving at least one level of interaction differentiation detected from at least three levels of interaction differentiation, interpreting a command from the sensory information as a function of the at least one level of interaction differentiation, and outputting an action indication based on the command.

Claims

1. A method, comprising:

receiving, by a system comprising a processor, sensory information indicative of a proximity level of interaction differentiation with respect to an object in proximity to, or in contact with, an input device;

determining, by the system, a gesture command from the sensory information based on a trigonometric function of a first beat frequency in a first resonant circuit associated with a first character input component of the input device and a second beat frequency in a second resonant circuit associated with a second character input component of the input device; and

outputting, by the system, an action indication based on the gesture command.

2. The method of claim 1, wherein the determining comprises determining the gesture command based on a capacitance between the object and the input device.

3. The method of claim 1, wherein the determining comprises determining, based on the trigonometric function, a lateral position of the object with respect to the input device and a height of the object above a plane of the input device.

4. The method of claim 1, wherein the sensory information is first sensory information, and wherein the receiving comprises receiving second sensory information indicative of an electrical continuity level of interaction differentiation with respect to the object.

5. The method of claim 4, wherein the gesture command is a first gesture command, and wherein the determining comprises determining a second gesture command from the second sensory information based on detection of an electrical contact between the object and a surface associated with the input device.

6. The method of claim 5, wherein the outputting comprises outputting the action indication based on the first gesture command and the second gesture command.

7. The method of claim 1, wherein the sensory information is first sensory information, and wherein the receiving comprises receiving second sensory information indicative of an actuation level of interaction differentiation with respect to the object.

8. The method of claim 7, wherein the gesture command is a first gesture command, and wherein the determining comprises determining a second gesture command from the second sensory information based on movement of at least a portion of the input device by the object.

9. The method of claim 8, wherein the outputting comprises outputting the action indication based on the first gesture command and the second gesture command.

10. The method of claim 1, wherein the outputting comprises presenting, via a virtual display, a virtual representation of the input device and information associated with the action indication.

11. The method of claim 1, wherein the outputting comprises transmitting, to a display device, a signal that comprises the action indication and an interpretation of the gesture command for output by the display device.

12. A system, comprising:

a processor, coupled to a memory, configured to execute or facilitate execution of computer-executable instructions to perform or control performance of operations to;

receive a gesture within a space relative to an input device;

determine a command based on the gesture and a trigonometric function of a first beat frequency associated with a first resonant circuit of the input device and a second beat frequency associated with a second resonant circuit of the input device; and

output, based on the command, an action associated with a virtual display.

13. The system of claim 12, wherein to determine the command, the processor is configured to identify, based on the trigonometric function, a lateral location of an object with respect to the input device and a height of the object above a plane of the input device.

14. The system of claim 12, wherein the processor is configured to determine the command based on the gesture, the trigonometric function, and electrical continuity data indicative of an electrical continuity level associated with a grounding of a surface of the input device by an object.

15. The system of claim 12, wherein the processor is configured to determine the command based on the gesture, the trigonometric function, and actuation data indicative of an actuation detected from movement of a portion of the input device by an object.

16. The system of claim 12, wherein to output the action, the processor is configured to render, on the virtual display, information of the gesture and the command.

17. A computer-readable storage device storing executable instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

receiving sensor data indicative of a proximity level of an object with respect to a sensor of an input device;

determining a gesture command based on the sensor data and a trigonometric function of a first beat frequency in a first resonant circuit associated with the input device and a second beat frequency in a second resonant circuit associated with the input device; and

modifying information presented on a display based on the gesture command.

18. The computer-readable storage device of claim 17, wherein the determining comprises determining the gesture command based on the sensor data, the trigonometric function, and a detection of an electrical contact between an external element and a surface of the input device.

19. The computer-readable storage device of claim 17, wherein the determining comprises determining the gesture command based on the sensor data, the trigonometric function, and actuation of a conductive element of the input device.

20. The computer-readable storage device of claim 17, wherein the modifying comprises initiating a result of the gesture command as an event with respect to the display.