METHOD AND SYSTEM TO CONTROL ELECTRONIC DEVICES THROUGH GESTURES

• US 20160224123A1
• Filed: 02/02/2016
• Published: 08/04/2016
• Est. Priority Date: 02/02/2015
• Status: Abandoned Application

• Current Assignee: Augumenta Ltd.
• Original Assignee: Augumenta Ltd.
• Inventors: Antoniac, Peter M, Aaltonen, Tero, Douxchamps, Damien, Kovalainen, Harri
• Application Number:
  US15/013,021
• Publication Number:
  US 20160224123A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

The present disclosure provides a method for controlling a computing device through hand gestures, using augmented reality. The method includes detecting a toggle gesture. The method further includes analyzing the toggle gesture. The method further includes switching a first interface of the computing device to a second interface based on the analysis of the toggle gesture.

Claims

1. A method for controlling a computing device through a plurality of hand gestures, the method comprising:

detecting a toggle gesture;

analyzing the toggle gesture; and

switching a first interface of the computing device to a second interface based on the analysis of the toggle gesture.

2. The method of claim 1 further comprising comparing the toggle gesture with a plurality of pre-defined gestures.

3. The method of claim 1 further comprising activating a display associated with the computing device based on a detection of a start gesture.

4. The method of claim 1 further comprising de-activating the display associated with the computing device based on a detection of an end gesture.

5. The method of claim 2, wherein the pre-defined gestures are defined by a user.

6. A system for controlling a computing device through a plurality of hand gestures, the system comprising:

a database configured to store a plurality of pre-defined gestures, a plurality of pre-defined actions, a plurality of modes of operation, a toggle gesture, a start gesture, an end gesture, and a plurality of pre-defined control commands;

a detection module configured to detect a toggle gesture;

an analyzing module configured to;

analyze the detected toggle gesture; and

compare the detected toggle gesture with the plurality of pre-defined gestures; and

a controlling module configured to switch a first interface of the computing device to a second interface based on the analysis.

7. The system of claim 6, wherein the detection module is configured to detect a start gesture and an end gesture.

8. The system of claim 6, wherein the display module is configured to:

activate a display of the computing device when the start gesture is detected; and

de-activate the display of the computing device when the end gesture is detected.

9. The system of claim 6, wherein the first interface and the second interface are displayed on a computer graphics overlay.

10. A method for controlling a computing device through a plurality of hand gestures, the method comprising:

detecting a toggle gesture;

activating a display of the computing device based on the detection of the toggle gesture;

displaying a computer graphics overlay on the display, wherein a hand of a user is mapped onto the computer graphics overlay; and

controlling a movement of a cursor on the computer graphics overlay based on one or more hand gestures of the user.

11. The method of claim 10 further comprising:

capturing spatial data based on a movement of the hand in a viewable area of the computing device;

producing at least one of a two dimensional and a three dimensional data map;

determining a pre-defined action corresponding to the at least one of the two dimensional and the three dimensional data map; and

executing the pre-defined action.

12. The method of claim 10, further comprising:

determining one or more pre-defined hand gestures based on the one or more hand gestures;

determining one or more pre-defined control commands corresponding to the one or more pre-defined hand gestures; and

executing the one or more pre-defined control commands.

13. The method of claim 12, wherein a cursor position displayed on the computer graphics overlay is calculated as a function of a size of the hand and a position of at least one of the hand and fingers of another hand.

14. The method of claim 10, de-activating the display of the computing device when an end gesture is detected.

15. A system for controlling a computing device through a plurality of hand gestures, the system comprising:

a detection module for detecting a toggle gesture;

a display module configured to;

activate a display of the computing device based on the detection of the toggle gesture; and

display a computer graphics overlay on the display, wherein a hand of a user is mapped onto the computer graphics overlay; and

a controlling module configured to control a movement of a cursor on the computer graphics overlay based on one or more hand gestures of the user.

16. The system of claim 15, further comprising an image capturing module comprising one or more sensors configured to capture spatial data based on a movement of the hand in a viewable area of the computing device.

17. The system of claim 15, further comprising an analyzing module configured to:

produce at least one of a two dimensional and/or a three dimensional data map; and

determine at least one pre-defined action corresponding to the at least one of the two dimensional and/or the three dimensional data map, wherein the controlling module is configured to execute the at least one pre-defined action.

18. The system of claim 17, wherein the analyzing module is further configured to:

determine one or more pre-defined hand gestures based on the detected hand gestures; and

determine one or more pre-defined control commands corresponding to the one or more pre-defined hand gestures, wherein the controlling module is configured to execute the one or more pre-defined control commands.

19. The system of claim 15, wherein the controlling module is configured to calculate a cursor position displayed on the computer graphics overlay as a function of a size of the hand and a position of at least one of the hand and finger of another hand.

20. The system of claim 15, wherein the display module is configured to de-activate the display of the computing device when an end gesture is detected.

21. The system of claim 15, wherein the display is selected from a group consisting of a transparent display, a non-transparent display, and a wearable display.

22. A method for controlling a computing device through a plurality of hand gestures, the method comprising:

detecting a start gesture;

activating a display of the computing device based on the detection of the start gesture;

detecting a toggle gesture;

analyzing the toggle gesture;

switching a first interface of the computing device to a second interface based on the analysis of the toggle gesture; and

de-activating the display when an end gesture is detected.