IMAGE-BASED HAND DETECTION APPARATUS AND METHOD

• US 20120087543A1
• Filed: 09/22/2011
• Published: 04/12/2012
• Est. Priority Date: 10/06/2010
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Hwang, Dae-Hwan, CHOI, Seung-Min, Jeong, Jae-Chan, Cho, Jae-II
• Granted Patent: US 8,638,987 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06V 40/11 Hand-related biometrics; Hand pose recognition

Abstract

An image-based hand detection apparatus includes a hand image detection unit for detecting a hand image corresponding to a shape of a hand clenched to form a fist from an image input. A feature point extraction unit extracts feature points from an area, having lower brightness than a reference value, in the detected hand image. An image rotation unit compares the feature points of the detected hand image with feature points of hand images stored in a hand image storage unit, and rotates the detected hand image or the stored hand images. A matching unit compares the detected hand image with the stored hand images and generates a result of the comparison. If at least one of the stored hand images is matched with the detected hand image, a hand shape recognition unit selects the at least one of the stored hand images as a matching hand image.

Claims

1. An image-based hand detection apparatus, comprising

a hand image detection unit for detecting a hand image corresponding to a shape of a hand clenched to form a fist from an image input from a camera;

a feature point extraction unit for extracting feature points from an area, having lower brightness than a reference value, in the hand image detected by the hand image detection unit;

an image rotation unit for comparing the feature points of the detected hand image with feature points of hand images stored in a hand image storage unit, and then rotating the detected hand image or the stored hand images;

a matching unit for comparing the detected hand image with the stored hand images and then generating a result of the comparison; and

a hand shape recognition unit for, if at least one of the stored hand images is matched with the detected hand image as the result of the comparison by the matching unit, selecting the at least one of the stored hand images as a matching hand image.

2. The image-based hand detection apparatus of claim 1, wherein the hand image detection unit sets a window of an M×

N size on a pixel unit for each frame of the input image, and detects the hand image of the M×

N size.

3. The image-based hand detection apparatus of claim 2, wherein the hand image detection unit determines whether a hand is included in the M×

N size window of the input image, and if the hand is not included in the M×

N size window, reduces a size of the input image step by step for detecting the hand image in the M×

N size window.

4. The image-based hand detection apparatus of claim 1, wherein the feature point extraction unit extracts the number of edges, locations of the edges, and angles of the edges as the feature points of the detected hand image, the edges corresponding to areas with lower brightness than the reference value in the detected hand image.

5. The image-based hand detection apparatus of claim 1, wherein the hand shape recognition unit recognizes a front portion of the shape of the hand clenched to form a fist.

6. The image-based hand detection apparatus of claim 1, further comprising a hand shape classifier for, if all the stored hand images are not matched with the detected hand image as the result of the comparison by the matching unit, registering the detected hand image.

7. The image-based hand detection apparatus of claim 6, wherein the hand shape classifier compares a plurality of hand images with images including no hands, calculates feature values of a hand shape included in each of the hand images, and classifies each hand shape based on the calculated feature values.

8. The image-based hand detection apparatus of claim 7, wherein the hand shape classifier is configured such that if an identical hand shape is present in hand shapes included in the respective hand images, weights are applied to feature values of the identical hand shape, and then feature values are recalculated.

9. The image-based hand detection apparatus of claim 1, further comprising a movement recognition unit for recognizing hand movements from one or more hand shapes recognized by the hand shape recognition unit and recognizing commands corresponding to the recognized hand movements.

10. An image-based hand detection method, comprising:

detecting a hand image corresponding to a shape of a hand clenched to form a fist from an image input from a camera, and generating a detected hand image;

extracting feature points from an area, having lower brightness than a reference value, in the detected hand image;

comparing the feature points of the detected hand image with feature points of hand images stored in a hand image storage unit to rotate the detected hand image or the stored hand images, and comparing the detected hand image with the stored hand images to generate a result of the comparison; and

if at least one of the stored hand images is matched with the detected hand image as the result of the comparison, selecting the at least one of the stored hand images as a matching hand image.

11. The image-based hand detection method of claim 10, wherein the detecting the hand image comprises setting a window of an M×

N size on a pixel unit for each frame of the input image, wherein the hand image of the M×

N size is detected.

12. The image-based hand detection method of claim 11, wherein the detecting the hand image further comprises:

determining whether a hand is included in the M×

N size window of the input image; and

if the hand is not included in the M×

N size window, reducing a size of the input image step by step for detecting the hand image in the M×

N size window.

13. The image-based hand detection method of claim 10, wherein the extracting the feature points is configured to extract the number of edges, locations of the edges, and angles of the edges as the feature points of the detected hand image, the edges corresponding to areas with lower brightness than the reference value in the detected hand image.

14. The image-based hand detection method of claim 10, wherein the selecting the at least one of the stored hand images as the matching hand image is configured to recognize a front portion of the shape of the hand clenched to form a fist.

15. The image-based hand detection method of claim 10, further comprising, if all the stored hand images are not matched with the detected hand image as the result of the comparison, inputting the detected hand image to a hand shape classifier and then registering the detected hand image.

16. The image-based hand detection method of claim 15, wherein the registering the hand image comprises:

comparing a plurality of hand images with images including no hands, and calculating feature values of a hand shape included in each of the hand images;

setting the calculated feature values as feature values of the hand shape included in each of the hand images; and

classifying each hand shape based on the feature values of the hand shapes.

17. The image-based hand detection method of claim 16, further comprising:

if an identical hand shape is present in hand shapes included in the respective hand images, applying weights to feature values of the identical hand shape, and then recalculating feature values; and

setting the recalculated feature values as final feature values of the identical hand shape.

18. The image-based hand detection method of claim 10, further comprising:

recognizing hand movements from hand shapes included in one or more hand images selected as the matching hand image; and

recognizing commands corresponding to the hand movements.