HAND-GESTURE-BASED INTERFACE UTILIZING AUGMENTED REALITY

• US 20160357263A1
• Filed: 07/21/2015
• Published: 12/08/2016
• Est. Priority Date: 07/22/2014
• Status: Abandoned Application

• Current Assignee: Augumenta Ltd.
• Original Assignee: Augumenta Ltd.
• Inventors: Antoniac, Peter, Douxchamps, Damien, Aaltonen, Tero
• Application Number:
  US14/804,593
• Publication Number:
  US 20160357263A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A system for providing a hand-gesture-based human-to-device interface includes an imaging device configured to record a sequence of still images and a computing device coupled in communication with the imaging device. The computing device includes a processor and a memory coupled to the processor, wherein the processor is configured to analyse the sequence of still images to identify at least one hand gesture made by a user, determine whether or not the at least one hand gesture includes at least one predefined hand gesture, identify an output signal corresponding to the at least one hand gesture, when the at least one hand gesture includes at least one predefined hand gesture, and use the output signal to control a quantity of at least one analogue parameter.

Claims

1. A system for providing a hand-gesture-based human-to-device interface, the system comprising:

an imaging device configured to record a sequence of still images; and

a computing device coupled in communication with the imaging device, wherein the computing device comprises;

a processor; and

a memory coupled to the processor,

wherein the processor is configured to;

(a) analyse the sequence of still images to identify at least one hand gesture made by a user;

(b) determine whether or not the at least one hand gesture includes at least one predefined hand gesture;

(c) identify an output signal corresponding to the at least one hand gesture, when the at least one hand gesture includes at least one predefined hand gesture; and

(d) use the output signal to control a quantity of at least one analogue parameter.

2. The system according to claim 1, wherein the system further includes a feedback device coupled in communication with the computing device, wherein the feedback device is configured to receive the output signal from the computing device, and to process the output signal to provide a feedback to the user.

3. The system according to claim 2, wherein the feedback device is implemented by way of a see-through display to facilitate augmented reality.

4. The system according to claim 2 or 3, wherein the feedback device is associated with a wearable technology.

5. The system according to claim 1, wherein the at least one analogue parameter is related to a remote device.

6. The system according to claim 1, wherein when controlling the quantity of the at least one analogue parameter at (d), the processor is configured to display a user interface element representing a quantity control on a feedback device in a manner that the user interface element overlaps or blends over a view of a hand of the user.

7. The system according to claim 1, wherein when controlling the quantity of the at least one analogue parameter at (d), the processor is configured to render on a feedback device a value of the quantity of the at least one analogue parameter in real time.

8. The system according to claim 1, wherein the processor is configured to:

render on a feedback device a plurality of user-selectable objects corresponding to a plurality of mutually different analogue parameters; and

detect a user'"'"'s selection of the at least one analogue parameter to be controlled.

9. The system according to claim 1, wherein the computing device includes a data storage for storing a plurality of predefined hand gestures and their corresponding output signals, and wherein when determining at (b), the processor is configured to lookup for the at least one hand gesture in the plurality of predefined hand gestures stored in the data storage.

10. The system according to claim 1, wherein the processor is configured to define mutually different combinations and/or sequences of simple hand gestures as mutually different hand gestures, wherein the mutually different combinations and/or sequences of simple hand gestures are performed within a predefined time period.

11. The system according to claim 1, wherein the processor is configured to switch between a low-power hibernating or sleep mode of operation and a full-power mode of operation in response to an action triggered by the output signal.

12. A method for providing a hand-gesture-based human-to-device interface, the method comprising:

recording a sequence of still images;

analysing the sequence of still images to identify at least one hand gesture made by a user;

determining whether or not the at least one hand gesture includes at least one predefined hand gesture;

identifying an output signal corresponding to the at least one hand gesture, when the at least one hand gesture includes at least one predefined hand gesture; and

using the output signal to control a quantity of at least one analogue parameter.

13. The method according to claim 12, wherein when controlling the quantity of the at least one analogue parameter, the method includes displaying a user interface element representing a quantity control on a feedback device in a manner that the user interface element overlaps or blends over a view of a hand of the user.

14. The method according to claim 12, wherein when controlling the quantity of the at least one analogue parameter, the method includes rendering on a feedback device a value of the quantity of the at least one analogue parameter in real time.

15. The method according to claim 12, wherein the method includes:

rendering on a feedback device a plurality of user-selectable objects corresponding to a plurality of mutually different analogue parameters; and

detecting a user'"'"'s selection of the at least one analogue parameter to be controlled.

16. The method according to any one of claim 12, wherein the method includes defining mutually different combinations and/or sequences of simple hand gestures as mutually different hand gestures, wherein the mutually different combinations and/or sequences of simple hand gestures are performed within a predefined time period.

17. The method according to any one of claim 12, wherein the method includes switching between a low-power hibernating or sleep mode of operation and a full-power mode of operation in response to an action triggered by the output signal.

18. A computer program product comprising a non-transitory machine-readable data storage medium having stored thereon program instructions that, when accessed by a processing device, cause the processing device to:

analyse a sequence of still images to identify at least one hand gesture made by a user;

determine whether or not the at least one hand gesture includes at least one predefined hand gesture;

identify an output signal corresponding to the at least one hand gesture, when the at least one hand gesture includes at least one predefined hand gesture; and

use the output signal to control a quantity of at least one analogue parameter.