ELECTRONIC SYSTEM WITH GESTURE PROCESSING MECHANISM AND METHOD OF OPERATION THEREOF

• US 20160266649A1
• Filed: 03/11/2015
• Published: 09/15/2016
• Est. Priority Date: 03/11/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Wang, Rongrong, Treskunov, Anton
• Granted Patent: US 9,811,165 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

An electronic system includes a control unit, configured to identify a first sensor reading for capturing a gesture directed at a display interface using a first range profile; identify a second sensor reading for capturing the gesture directed at the display interface using a second range profile; calculate a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof; and a communication interface, coupled to the control unit, configured to communicate the blended position indicator by generating a cursor at the blended position indicator.

Claims

1. An electronic system comprising:

a control unit configured to;

identify a first sensor reading for capturing a gesture directed at a display interface using a first range profile;

identify a second sensor reading for capturing the gesture directed at the display interface using a second range profile;

calculate a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof; and

a communication interface, coupled to the control unit, configured to communicate the blended position indicator by generating a cursor at the blended position indicator.

2. The system as claimed in claim 1 wherein the control unit is further configured to:

determine an overlapping range profile involving the first range profile and the second range profile;

identify the first sensor reading for capturing the gesture made within the overlapping range profile;

identify the second sensor reading for capturing the gesture made within the overlapping range profile; and

calculate the blended position indicator based on the overlapping range profile, the first sensor reading, and the second sensor reading.

3. The system as claimed in claim 1 wherein the control unit is further configured to:

determine a first origin point and a known terminal point based on a first sensor frame;

determine a second origin point based on a second sensor frame;

calculate an inferred terminal point based on the first origin point, the known terminal point, and the second origin point; and

calculate the blended position indicator based on the first origin point, the known terminal point, the second origin point, and the inferred terminal point.

4. The system as claimed in claim 1 wherein the control unit is further configured to:

calculate a first weight associated with the first sensor reading based on a first sensor characteristic;

calculate a second weight associated with the second sensor reading based on a second sensor characteristic; and

calculate the blended position indicator by applying the first weight to a first position indicator and applying the second weight to a second position indicator.

5. The system as claimed in claim 1 wherein the control unit is further configured to:

calculate a first vector for representing the gesture directed at the display interface;

calculate a second vector for representing the gesture directed at the display interface; and

calculate the blended position indicator based on the first vector and the second vector.

6. The system as claimed in claim 1 wherein the control unit is further configured to:

calculate a first weight by identifying a confidence score associated with the first sensor reading and a sensor update frequency associated with a first sensor;

calculate a second weight by identifying the confidence score associated with the second sensor reading and the sensor update frequency associated with a second sensor; and

calculate the blended position indicator by applying the first weight to a first position indicator and applying the second weight to a second position indicator.

7. The system as claimed in claim 1 wherein the control unit is further configured to calculate the blended position indicator based on a user location determined to be within the first range profile, the overlapping range profile, or the second range profile.

8. The system as claimed in claim 1 wherein the control unit is further configured to:

identify the first sensor reading for capturing the gesture by a first sensor;

identify the second sensor reading for capturing the gesture by a second sensor different from the first sensor; and

calculate the blended position indicator for combining the gesture captured by the first sensor and the gesture captured by the second sensor.

9. The system as claimed in claim 1 wherein the control unit is further configured to:

determine an overlapping range profile involving the first range profile and the second range profile;

calculate a first vector based on an elbow position and a hand position for representing the gesture made in the overlapping range profile;

calculate a second vector based on the hand position and a fingertip position for representing the gesture made in the overlapping range profile; and

calculate the blended position indicator based on the overlapping range profile, the first vector, and the second vector.

10. The system as claimed in claim 1 wherein the control unit is further configured to:

determine a first appendage orientation based on a first sensor frame;

determine a second appendage orientation based on a second sensor frame; and

calculate the blended position indicator based on a first origin point, a known terminal point, a second origin point, the first appendage orientation, and the second appendage orientation.

11. A method of operation of an electronic system comprising:

identifying, with a control unit, a first sensor reading for capturing a gesture directed at a display interface using a first range profile;

identifying a second sensor reading for capturing the gesture directed at the display interface using a second range profile;

calculating a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof; and

communicating, with a communication interface coupled to the control unit, the blended position indicator by generating a cursor at the blended position indicator.

12. The method as claimed in claim 11 further comprising:

determining an overlapping range profile involving the first range profile and the second range profile;

identifying the first sensor reading for capturing the gesture made within the overlapping range profile;

identifying the second sensor reading for capturing the gesture made within the overlapping range profile; and

calculating the blended position indicator based on the overlapping range profile, the first sensor reading, and the second sensor reading.

13. The method as claimed in claim 11 further comprising:

determining a first origin point and a known terminal point based on a first sensor frame;

determining a second origin point based on a second sensor frame;

calculating an inferred terminal point based on the first origin point, the known terminal point, and the second origin point; and

calculating the blended position indicator based on the first origin point, the known terminal point, the second origin point, and the inferred terminal point.

14. The method as claimed in claim 11 further comprising:

calculating a first weight associated with the first sensor reading based on a first sensor characteristic;

calculating a second weight associated with the second sensor reading based on a second sensor characteristic; and

calculating the blended position indicator by applying the first weight to a first position indicator and applying the second weight to a second position indicator.

15. The method as claimed in claim 11 further comprising:

calculating a first vector for representing the gesture directed at the display interface;

calculating a second vector for representing the gesture directed at the display interface; and

calculating the blended position indicator based on the first vector and the second vector.

16. A non-transitory computer readable medium including instructions for execution, comprising:

identifying a first sensor reading for capturing a gesture directed at a display interface using a first range profile;

identifying a second sensor reading for capturing the gesture directed at the display interface using a second range profile;

calculating a blended position indicator based on the first sensor reading, the second sensor reading, or a combination thereof; and

communicating the blended position indicator by generating a cursor at the blended position indicator.

17. The non-transitory computer readable medium as claimed in claim 16 further comprising:

determining an overlapping range profile involving the first range profile and the second range profile;

identifying the first sensor reading for capturing the gesture made within the overlapping range profile;

identifying the second sensor reading for capturing the gesture made within the overlapping range profile; and

calculating the blended position indicator based on the overlapping range profile, the first sensor reading, and the second sensor reading.

18. The non-transitory computer readable medium as claimed in claim 16 further comprising:

determining a first origin point and a known terminal point based on a first sensor frame;

determining a second origin point based on a second sensor frame;

calculating an inferred terminal point based on the first origin point, the known terminal point, and the second origin point; and

calculating the blended position indicator based on the first origin point, the known terminal point, the second origin point, and the inferred terminal point.

19. The non-transitory computer readable medium as claimed in claim 16 further comprising:

calculating a first weight associated with the first sensor reading based on a first sensor characteristic;

calculating a second weight associated with the second sensor reading based on a second sensor characteristic; and

calculating the blended position indicator by applying the first weight to a first position indicator and applying the second weight to a second position indicator.

20. The non-transitory computer readable medium as claimed in claim 16 further comprising:

calculating a first vector for representing the gesture directed at the display interface;

calculating a second vector for representing the gesture directed at the display interface; and

calculating the blended position indicator based on the first vector and the second vector.