System and method for discerning complex gestures using an array of optical sensors

• US 9,507,433 B1
• Filed: 11/02/2015
• Issued: 11/29/2016
• Est. Priority Date: 01/14/2013
• Status: Active Grant

• Current Assignee: Maxim Integrated Products, Inc. (Analog Devices, Inc.)
• Original Assignee: Maxim Integrated Products, Inc. (Analog Devices, Inc.)
• Inventors: Veygman, Ilya K.
• Primary Examiner(s): Sharifi-Tafreshi, Koosha
• Application Number:
  US14/929,983
• Time in Patent Office: 393 Days
• Field of Search: 345/156, 345/166, 345/173, 345/175, 715/863
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A method for gesture determination (e.g., discerning complex gestures) via an electronic system (e.g., a gesture sensing system) including an array of optical sensors is described herein. The method includes detecting a plurality of sub-gestures (e.g., simple gestures provided by a target located proximate to the system) via the array of optical sensors. The sensors generate signals based upon the detected (e.g., received) sub-gestures and transmit the signals to a processor of the gesture sensing system. The processor processes the signals to obtain data associated with the sub-gestures and analyzes the sub-gesture data to determine if the sub-gestures collectively constitute a gesture (e.g., complex gesture). When the analyzing indicates that the sub-gestures collectively constitute a complex gesture, the gesture sensing system detects the complex gesture.

Claims

1. A method for gesture determination via an electronic system, the method comprising:

detecting a plurality of sub-gestures via a plurality of sensors of the electronic system;

when a first sub-gesture included in the plurality of sub-gestures is detected, commencing a data frame for the system, the data frame having a pre-determined, finite duration;

generating a plurality of signals via the plurality of sensors, the plurality of signals being based on the plurality of sub-gestures;

transmitting the plurality of signals via the plurality of sensors to a processor of the system;

processing the plurality of signals via the processor to obtain sub-gesture data associated with the plurality of sub-gestures; and

analyzing the sub-gesture data associated with the plurality of sub-gestures via the processor to determine if the plurality of sub-gestures collectively constitute a gesture,

wherein analyzing the sub-gesture data is performed after the data frame expires by analyzing the sub-gesture data corresponding to;

the first sub-gesture and to sub-gestures detected during the data frame.

2. The method as claimed in claim 1, further comprising:

when analyzing the sub-gesture data associated with the plurality of sub-gestures indicates that the plurality of sub-gestures collectively constitute a gesture, interpreting the plurality of sub-gestures as a detected gesture.

3. The method as claimed in claim 1, wherein commencing the data frame for the system includes starting a countdown timer.

4. The method as claimed in claim 2, wherein analyzing the sub-gesture data includes:

comparing the sub-gesture data to a lookup table, the lookup table including a pre-determined sub-gesture combination corresponding to the gesture.

5. The method as claimed in claim 2, wherein analyzing the sub-gesture data associated with the plurality of sub-gestures includes:

comparing the sub-gesture data to a sequence tree, the sequence tree indicating a pre-determined sub-gesture sequence corresponding to the gesture.

6. The method as claimed in claim 4, further comprising:

when the sub-gesture data corresponds to the pre-determined sub-gesture combination in the table, classifying the plurality of received sub-gestures as the gesture.

7. The method as claimed in claim 5, further comprising:

when the sub-gesture data indicates that the plurality of received sub-gestures corresponds to the pre-determined sub-gesture sequence, classifying the plurality of received sub-gestures as the gesture.

8. A computer-implemented method for gesture determination, the computer-implemented method comprising:

detecting a plurality of sub-gestures;

when a first sub-gesture included in the plurality of sub-gestures is detected, commencing the data frame, the data frame having a pre-determined, finite duration;

generating a plurality of signals based on the plurality of detected sub-gestures;

causing a processor to process the plurality of signals to obtain sub-gesture data associated with the plurality of sub-gestures;

causing the processor to analyze the sub-gesture data associated with the plurality of sub-gestures to determine if the plurality of sub-gestures collectively constitute a gesture, wherein analyzing the sub-gesture data is performed after the data frame expires by analyzing the sub-gesture data corresponding to;

the first sub-gesture and to sub-gestures detected during the data frame; and

when analyzing the sub-gesture data associated with the plurality of sub-gestures indicates that the plurality of sub-gestures collectively constitute the gesture, detecting the gesture.

9. The computer-implemented method as claimed in claim 8, wherein the sub-gestures have a first level of complexity and the gesture has a second level of complexity which is greater than the first level of complexity.

10. The computer-implemented method as claimed in claim 8, wherein commencing the data frame includes starting a countdown timer.

11. The computer-implemented method as claimed in claim 8, wherein analyzing the sub-gesture data includes:

comparing the sub-gesture data to a lookup table, the lookup table including a pre-determined sub-gesture combination corresponding to the gesture.

12. The computer-implemented method as claimed in claim 8, wherein analyzing the sub-gesture data associated with the plurality of sub-gestures includes:

comparing the sub-gesture data to a sequence tree, the sequence tree indicating a pre-determined sub-gesture sequence corresponding to the gesture.

13. The computer-implemented method as claimed in claim 12, further comprising:

when the sub-gesture data corresponds to the pre-determined sub-gesture combination in the table, classifying the plurality of received sub-gestures as the gesture.

14. The computer-implemented method as claimed in claim 13, further comprising:

when the sub-gesture data indicates that the plurality of received sub-gestures corresponds to the pre-determined sub-gesture sequence, classifying the plurality of received sub-gestures as the gesture.

15. An electronic system, comprising:

a plurality of sensors configured to generate and transmit a plurality of signals based on a plurality of sub-gestures detected by the plurality of sensors;

a processor connected to the plurality of sensors and configured to receive the plurality of signals transmitted by the plurality of sensors; and

a memory communicatively coupled with the processor, the memory having computer executable instructions stored thereon, the computer executable instructions, when executed by the processor, causing the processor to;

process the plurality of signals to obtain sub-gesture data associated with the plurality of sub-gestures;

when a first sub-gesture included in the plurality of sub-gestures is detected, commence a data frame, the data frame having a predetermined, finite duration;

analyze the sub-gesture data associated with the plurality of sub-gestures to determine if the plurality of sub-gestures collectively constitute a gesture, wherein the sub-gesture data is analyzed after the data frame expires by analysis of the sub-gesture data corresponding to the first sub-gesture and to sub-gestures detected during the data frame; and

detecting the gesture when analysis of the sub-gesture data indicates that plurality of sub-gestures collectively constitute the gesture.

16. The electronic system as claimed in claim 15, wherein the plurality of sensors are optical sensors.