SYSTEM AND METHOD FOR RECOGNIZING HAND GESTURE

• US 20170285759A1
• Filed: 09/22/2016
• Published: 10/05/2017
• Est. Priority Date: 03/29/2016
• Status: Active Grant

• Current Assignee: Korea Electronics Technology Institute (Government of South Korea)
• Original Assignee: Korea Electronics Technology Institute (Government of South Korea)
• Inventors: Ahn, Yang Keun, Park, Young Choong
• Granted Patent: US 10,013,070 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06V 40/11 Hand-related biometrics; Hand pose recognition

Abstract

Provided is a hand gesture recognition technique. A hand gesture recognition system according to one aspect of the present invention includes an image capturing unit that captures an image of a gesture recognition region to acquire a depth image; a hand region extractor that extracts a hand region from the depth image; and a hand gesture recognizer that analyzes the extracted hand region to recognize a hand gesture included in the depth image as a grasp gesture or a release gesture.

Claims

1. A hand gesture recognition system comprising:

an image capturing unit that captures an image of a gesture recognition region to acquire a depth image;

a hand region extractor that extracts a hand region from the depth image; and

a hand gesture recognizer that analyzes the extracted hand region to recognize a hand gesture included in the depth image as a grasp gesture or a release gesture, wherein the hand region extractor primarily binarizes the depth image, determines a hand region from the primarily binarized depth image, secondarily binarizes the determined hand region, and finally extracts the hand region,

wherein the hand region extractor compares hand region candidates detected by applying a labeling algorithm to the primarily binarized depth image and a preset threshold, and determines a hand region candidate which is greater than or equal to the threshold as the hand region, and

wherein the hand region recognizer adaptively binarizes the extracted hand region to detect gesture recognition regions, and recognizes the hand gesture as a release gesture or a grasp gesture on the basis of the number of the extracted gesture recognition regions.

9. The system of claim 1, wherein the hand gesture recognizer recognizes a hand gesture as a release gesture when the number of the gesture recognition regions is three or more, and wherein the hand gesture recognizer recognizes a hand gesture as a grasp gesture when the number of the gesture recognition regions is two or less.

2. (canceled)

3. (canceled)

4. (canceled)

5. A method of recognizing a hand gesture comprising:

acquiring a depth image by capturing an image of a gesture recognition region;

analyzing the depth image and determining whether a hand region is extracted;

detecting gesture recognition regions by adaptively binarizing an extracted hand region when the hand region is extracted; and

recognizing a hand gesture included in the depth image as a release gesture or a grasp gesture on the basis of the number of the extracted gesture recognition regions, wherein the determining of whether a hand region is extracted includes primarily binarizing the depth image, determining a hand region from the primarily binarized depth image, secondarily binarizing the determined hand region, and finally extracting the hand region,

wherein the determining of whether a hand region is extracted includes comparing hand region candidates detected by applying a labeling algorithm to the primarily binarized depth image and a preset threshold, and determining a hand region candidate which is greater than or equal to the threshold as the hand region, and

wherein the recognizing includes determining whether the number of the gesture recognition regions is greater than or equal to a preset value, and, when the number of the gesture recognition regions is greater than or equal to the preset value, recognizing the hand gesture as a release gesture, and when the number of the gesture recognition regions is less than the preset value, recognizing the hand gesture as a grasp gesture.

10. The method of claim 5, wherein the recognizing further includes i) recognizing a hand gesture as a release gesture when the number of the gesture recognition regions is three or more and ii) recognizing a hand gesture as a grasp gesture when the number of the gesture recognition regions is two or less.

6. (canceled)

7. (canceled)

8. (canceled)