HAND SKELETON COMPARISON AND SELECTION FOR HAND AND GESTURE RECOGNITION WITH A COMPUTING INTERFACE

• US 20170177087A1
• Filed: 12/18/2015
• Published: 06/22/2017
• Est. Priority Date: 12/18/2015
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: LERNER, ALON, GLAZER, ITAMAR, FLEISHMAN, SHAHAR
• Application Number:
  US14/975,549
• Publication Number:
  US 20170177087A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 10/34 Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

Hand skeletons are compared to a hand image and selected. The hand skeletons are used for hand and gesture recognition with a computing interface. In one example, the method includes projecting points of a generated hand skeleton onto a received hand image, classifying the skeleton points as inside or outside the hand image, quantifying the comparison to generate a comparison quantity using a comparison function distance measurement, the comparison function distance measurement comprising an outside skeleton distance that includes a sum of distances from each outside skeleton point to a nearest inside skeleton point, applying the comparison function quantity to select the generated hand skeleton as a best match, and applying the selected hand skeleton to generate a command to a computer system command interface.

Claims

1. A method comprising:

projecting points of a generated hand skeleton onto a received hand image;

classifying the skeleton points as inside or outside the hand image;

quantifying the comparison to generate a comparison quantity using a comparison function distance measurement, the comparison function distance measurement comprising an outside skeleton distance that includes a sum of distances from each outside skeleton point to a nearest inside skeleton point;

applying the comparison function quantity to select the generated hand skeleton as a best match; and

applying the selected hand skeleton to generate a command to a computer system command interface.

2. The method of claim 1, wherein the sum of the outside skeleton distance comprises a sum of the squares of the distances from each outside skeleton point to a nearest inside skeleton point.

3. The method of claim 1, wherein the nearest inside skeleton point of the outside skeleton distance is found for points which belong to a finger by tracing a path of sampled points along the finger.

4. The method of claim 1, wherein the nearest inside skeleton point of the outside skeleton distance is found for points which belong to a palm by searching for a closest inside skeleton point by scanning all inside skeleton points.

5. The method of claim 1, wherein the outside skeleton distance is determined by projecting a path from each outside skeleton point to the nearest inside skeleton point onto the received hand image and taking the distance on the hand image.

6. The method of claim 1, further comprising;

generating a set of hand image samples;

enlarging the skeleton points; and

classifying the sampled hand points as inside or outside the enlarged skeleton points,

wherein the comparison function distance measurement further comprises an outside hand distance that includes a sum of distances from each outside hand point to a nearest enlarged skeleton point.

7. The method of claim 6, wherein the distances of the outside hand distance are a geodesic distance from an outside hand point to a nearest inside hand point.

8. The method of claim 7, wherein the sum of the distances from each outside hand point comprises the square of each distance taken before summing.

9. The method of claim 6 wherein the distances of the outside hand distance are distances to a nearest hand region determined using a geodesic distance.

10. The method of claim 1, wherein projecting points of a generated hand skeleton comprises sampling points on a generated hand skeleton and projecting the sampled points onto a received hand image.

11. The method of claim 1, wherein the comparison function distance measurement further comprises an inside skeleton distance that includes a sum of the distance from each inside skeleton point to the hand image.

12. The method of claim 11, wherein the comparison function distance measurement comprises a weighting factor for the outside skeleton distance and a weighting factor for the inside skeleton distance.

13. The method of claim 6, wherein the comparison function distance measurement further comprises an inside hand distance that includes a sum of the distance from each inside hand point to a nearest enlarged skeleton point.

14. The method of claim 13, wherein the comparison function distance measurement comprises a weighting factor for the outside skeleton distance, for the outside hand distance, and for the inside hand distance.

15. The method of claim 1 further comprising projecting points of a second generated hand skeleton onto the received hand image and generating a comparison quantity and selecting the generated hand skeleton comprises comparing the comparison quantity for the first generated hand skeleton to the comparison quantity for the second generated hand skeleton.

16. A non-transitory computer-readable medium having instructions thereon that when operated on by the computer causes the computer to perform operations comprising:

projecting points of a generated hand skeleton onto a received hand image;

classifying the skeleton points as inside or outside the hand image;

quantifying the comparison to generate a comparison quantity using a comparison function distance measurement, the comparison function distance measurement comprising an outside skeleton distance that includes a sum of distances from each outside skeleton point to a nearest inside skeleton point;

applying the comparison function quantity to select the generated hand skeleton as a best match; and

applying the selected hand skeleton to generate a command to a computer system command interface.

17. The medium of claim 16, the operations further comprising:

generating a set of hand image samples;

enlarging the skeleton points; and

classifying the sampled hand points as inside or outside the enlarged skeleton points,

wherein the comparison function distance measurement further comprises an outside hand distance that includes a sum of distances from each outside hand point to a nearest enlarged skeleton point.

18. A computing system comprising:

a camera to generate an input sequence of frames;

a feature recognition system to identify frames of the sequence in which a hand is recognized and to identify points in the identified frames corresponding to features of the recognized hand;

a hand skeleton selection system to project points of a generated hand skeleton onto a received hand image, to classify the skeleton points as inside or outside the hand image, to quantify the comparison to generate a comparison quantity using a comparison function distance measurement, the comparison function distance measurement comprising an outside skeleton distance that includes a sum of distances from each outside skeleton point to a nearest inside skeleton point, to apply the comparison function quantity to select the generated hand skeleton as a best match, and to apply the selected hand skeleton to generate a command to a computer system command interface; and

a command interface to receive commands from the hand skeleton selection system for operation by a processor of the computing system.

19. The system of claim 18, wherein the sum of the outside skeleton distance comprises a sum of the squares of the distances from each outside skeleton point to a nearest inside skeleton point.

20. The method of claim 18, wherein the nearest inside skeleton point of the outside skeleton distance is found for points which belong to a finger by tracing a path of sampled points along the finger.