Electronic system with gesture processing mechanism and method of operation thereof

• US 9,811,165 B2
• Filed: 03/11/2015
• Issued: 11/07/2017
• Est. Priority Date: 03/11/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Wang, Rongrong, Treskunov, Anton
• Primary Examiner(s): DANIELSEN, NATHAN ANDREW
• Application Number:
  US14/644,956
• Publication Number:
  US 20160266649A1
• Time in Patent Office: 972 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

An electronic system includes a control unit, configured to identify a first sensor reading for capturing a gesture directed at a display interface using a first range profile; identify a second sensor reading for capturing the gesture directed at the display interface using a second range profile; calculate a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof; and a communication interface, coupled to the control unit, configured to communicate the blended position indicator by generating a cursor at the blended position indicator.

Claims

1. An electronic system comprising:

a control unit configured to;

identify a first sensor reading for capturing a gesture directed at a display interface using a first range profile corresponding to a granularity or sensitivity, a physical location or orientation, or a combination thereof for the first sensor reading;

calculate a first weight associated with the first sensor reading based on a first sensor characteristic;

identify a second sensor reading for capturing the gesture directed at the display interface using a second range profile corresponding to a further granularity or sensitivity, a further physical location or orientation, or a combination thereof for the second sensor reading;

calculate a second weight associated with the second sensor reading based on a second sensor characteristic;

calculate a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof according to the first range profile and the second range profile;

by applying the first weight to a first position indicator and applying the second weight to a second position indicator; and

a communication interface, coupled to the control unit, configured to communicate the blended position indicator by generating a cursor at the blended position indicator.

2. The system as claimed in claim 1 wherein the control unit is further configured to:

determine an overlapping range profile involving the first range profile and the second range profile;

identify the first sensor reading for capturing the gesture made within the overlapping range profile;

identify the second sensor reading for capturing the gesture made within the overlapping range profile; and

calculate the blended position indicator based on the overlapping range profile, the first sensor reading, and the second sensor reading.

3. The system as claimed in claim 1 wherein the control unit is further configured to:

determine a first origin point and a known terminal point based on a first sensor frame;

determine a second origin point based on a second sensor frame;

calculate an inferred terminal point based on the first origin point, the known terminal point, and the second origin point; and

calculate the blended position indicator based on the first origin point, the known terminal point, the second origin point, and the inferred terminal point.

4. The system as claimed in claim 1 wherein the control unit is further configured to:

calculate the first weight by identifying a confidence score associated with the first sensor reading;

calculate the second weight by identifying the confidence score associated with the second sensor reading; and

calculate the blended position indicator by applying the first weight to the first position indicator and applying the second weight to the second position indicator.

5. The system as claimed in claim 1 wherein the control unit is further configured to:

calculate a first vector for representing the gesture directed at the display interface;

calculate a second vector for representing the gesture directed at the display interface; and

calculate the blended position indicator based on the first vector and the second vector.

6. The system as claimed in claim 1 wherein the control unit is further configured to:

calculate the first weight by identifying a confidence score associated with the first sensor reading and a sensor update frequency associated with a first sensor;

calculate the second weight by identifying a confidence score associated with the second sensor reading and a sensor update frequency associated with a second sensor; and

calculate the blended position indicator by applying the first weight to the first position indicator and applying the second weight to the second position indicator.

7. The system as claimed in claim 1 wherein the control unit is further configured to calculate the blended position indicator based on a user location determined to be within the first range profile, an overlapping range profile, or the second range profile.

8. The system as claimed in claim 1 wherein the control unit is further configured to:

identify the first sensor reading for capturing the gesture by a first sensor;

identify the second sensor reading for capturing the gesture by a second sensor different from the first sensor; and

calculate the blended position indicator for combining the gesture captured by the first sensor and the gesture captured by the second sensor.

9. The system as claimed in claim 1 wherein the control unit is further configured to:

determine an overlapping range profile involving the first range profile and the second range profile;

calculate a first vector based on an elbow position and a hand position for representing the gesture made in the overlapping range profile;

calculate a second vector based on the hand position and a fingertip position for representing the gesture made in the overlapping range profile; and

calculate the blended position indicator based on the overlapping range profile, the first vector, and the second vector.

10. The system as claimed in claim 1 wherein the control unit is further configured to:

determine a first appendage orientation based on a first sensor frame;

determine a second appendage orientation based on a second sensor frame; and

calculate the blended position indicator based on a first origin point, a known terminal point, a second origin point, the first appendage orientation, and the second appendage orientation.

11. A method of operation of an electronic system comprising:

identifying a first sensor reading for capturing a gesture directed at a display interface using a first range profile corresponding to a granularity or sensitivity, a physical location or orientation, or a combination thereof for the first sensor reading;

calculating a first weight associated with the first sensor reading based on a first sensor characteristic;

identifying a second sensor reading for capturing the gesture directed at the display interface using a second range profile corresponding to a further granularity or sensitivity, a further physical location or orientation, or a combination thereof for the second sensor reading;

calculating a second weight associated with the second sensor reading based on a second sensor characteristic;

calculating with a control unit a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof according to the first range profile and the second range profile, by applying the first weight to a first position indicator and applying the second weight to a second position indicator; and

communicating, with a communication interface coupled to the control unit, the blended position indicator by generating a cursor at the blended position indicator.

12. The method as claimed in claim 11 further comprising:

determining an overlapping range profile involving the first range profile and the second range profile;

identifying the first sensor reading for capturing the gesture made within the overlapping range profile;

identifying the second sensor reading for capturing the gesture made within the overlapping range profile; and

calculating the blended position indicator based on the overlapping range profile, the first sensor reading, and the second sensor reading.

13. The method as claimed in claim 11 further comprising:

determining a first origin point and a known terminal point based on a first sensor frame;

determining a second origin point based on a second sensor frame;

calculating an inferred terminal point based on the first origin point, the known terminal point, and the second origin point; and

calculating the blended position indicator based on the first origin point, the known terminal point, the second origin point, and the inferred terminal point.

14. The method as claimed in claim 11 wherein:

calculating the first weight includes identifying a confidence score associated with the first sensor reading;

calculating the second weight includes identifying the confidence score associated with the second sensor reading; and

calculating the blended position indicator by applying the first weight to a first position indicator and applying the second weight to a second position indicator.

15. The method as claimed in claim 11 further comprising:

calculating a first vector for representing the gesture directed at the display interface;

calculating a second vector for representing the gesture directed at the display interface; and

calculating the blended position indicator based on the first vector and the second vector.

16. A non-transitory computer readable medium including instructions for execution, comprising:

identifying a first sensor reading for capturing a gesture directed at a display interface using a first range profile corresponding to a granularity or sensitivity, a physical location or orientation, or a combination thereof for the first sensor reading;

calculating a first weight associated with the first sensor reading based on a first sensor characteristic;

identifying a second sensor reading for capturing the gesture directed at the display interface using a second range profile corresponding to a further granularity or sensitivity, a further physical location or orientation, or a combination thereof for the second sensor reading;

calculating a second weight associated with the second sensor reading based on a second sensor characteristic;

calculating a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof according to the first range profile and the second range profile, by applying the first weight to a first position indicator and applying the second weight to a second position indicator; and

communicating the blended position indicator by generating a cursor at the blended position indicator.

17. The non-transitory computer readable medium as claimed in claim 16 further comprising:

determining an overlapping range profile involving the first range profile and the second range profile;

identifying the first sensor reading for capturing the gesture made within the overlapping range profile;

identifying the second sensor reading for capturing the gesture made within the overlapping range profile; and

calculating the blended position indicator based on the overlapping range profile, the first sensor reading, and the second sensor reading.

18. The non-transitory computer readable medium as claimed in claim 16 further comprising:

determining a first origin point and a known terminal point based on a first sensor frame;

determining a second origin point based on a second sensor frame;

calculating an inferred terminal point based on the first origin point, the known terminal point, and the second origin point; and

calculating the blended position indicator based on the first origin point, the known terminal point, the second origin point, and the inferred terminal point.

19. The non-transitory computer readable medium as claimed in claim 16 wherein

calculating the first weight includes identifying a confidence score associated with the first sensor reading;

calculating the second weight includes identifying the confidence score associated with the second sensor reading; and

calculating the blended position indicator by applying the first weight to a first position indicator and applying the second weight to a second position indicator.

20. The non-transitory computer readable medium as claimed in claim 16 further comprising:

calculating a first vector for representing the gesture directed at the display interface;

calculating a second vector for representing the gesture directed at the display interface; and

calculating the blended position indicator based on the first vector and the second vector.