Capturing and recognizing hand postures using inner distance shape contexts
First Claim
1. A computer based method for recognizing a hand posture captured in an image, the method comprising:
- identifying a hand region in the image;
estimating a scatter direction of the hand region in the image;
determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction;
matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction;
identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin;
classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier.
1 Assignment
0 Petitions
Accused Products
Abstract
A system, method, and computer program product for recognizing hand postures are described. According to one aspect, a set of training images is provided with labels identifying hand states captured in the training images. Inner Distance Shape Context (IDSC) descriptors are determined for the hand regions in the training images, and fed into a Support Vector Machine (SVM) classifier to train it to classify hand shapes into posture classes. An IDSC descriptor is determined for a hand region in a testing image, and classified by the SVM classifier into one of the posture classes the SVM classifier was trained for. The hand posture captured in the testing image is recognized based on the classification.
-
Citations
19 Claims
-
1. A computer based method for recognizing a hand posture captured in an image, the method comprising:
-
identifying a hand region in the image; estimating a scatter direction of the hand region in the image; determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction; matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction; identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin; classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer program product for recognizing a hand posture captured in an image, the computer program product comprising a non-transitory computer-readable storage medium containing executable computer program code for performing a method comprising:
-
identifying a hand region in the image; estimating a scatter direction of the hand region in the image; determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction; matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction; identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin; classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A system for recognizing a hand posture captured in an image, the system comprising:
-
a computer processor for executing executable computer program code; and a computer-readable storage medium containing the executable computer program code for performing a method comprising; identifying a hand region in the image; estimating a scatter direction of the hand region in the image; determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction; matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction; identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin; classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier. - View Dependent Claims (17, 18, 19)
-
Specification