METHOD AND SYSTEM FOR RECOGNIZING HAND GESTURE USING SELECTIVE ILLUMINATION

• US 20140185872A1
• Filed: 12/19/2013
• Published: 07/03/2014
• Est. Priority Date: 12/28/2012
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Sung Un, Joo, Sihyun
• Granted Patent: US 9,373,026 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 5/002 Denoising; Smoothing noise processing or correction adapted to be used in an image pickup device containing and electronic image sensor H04N23/81, H04N25/60 - H04N25/67
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A method and system that recognize a hand gesture using selective illumination that can reliably perform hand gesture recognition by effectively removing an unnecessary image and noise including static disturbance light and dynamic disturbance light are provided. The method of recognizing a hand gesture includes acquiring, by a controller from an imaging device a hand image, which is a recognition target. A static background image and a dynamic background image are removed by the controller from the hand image. The method further includes recognizing, by the controller, a gesture of the hand by extracting a characteristic point from the hand image in which the dynamic background image is removed.

Claims

1. A method of recognizing a hand gesture, the method comprising:

acquiring, by a controller from an imaging device, a hand image, wherein a hand in the hand image is a recognition target;

removing, by the controller, a static background image from the acquired hand image;

removing, by the controller, a dynamic background image from the hand image in which the static background image is removed; and

recognizing, by the controller, a gesture of the hand by extracting a characteristic point from the hand image in which the dynamic background image is removed.

2. The method of claim 1, wherein the static background image is static disturbance light of an external light source and the dynamic background image is dynamic disturbance light of an external light source.

3. The method of claim 2, wherein the acquiring of a hand image further comprises:

acquiring, by the controller from the imaging device, a hand image turning a lighting device on and off every predetermined frame unit with a predetermined rule.

4. The method of claim 3, wherein the predetermined frame unit is three frame units, the predetermined rule turns on the lighting device in a first frame of the three frame units and turns off the lighting device in a second frame and a third frame of the three frame units.

5. The method of claim 4, wherein the imaging device that is configured to acquire the image of the hand is an infrared camera and the lighting device is an infrared lighting device.

6. The method of claim 5, wherein the removing of a static background image further comprises:

acquiring, by the controller, a static disturbance light removal image by subtracting the second frame from the first frame.

7. The method of claim 6, wherein the removing of a dynamic background image further comprises:

acquiring, by the controller, a dynamic disturbance light image by subtracting the third frame from the second frame; and

acquiring, by the controller, a dynamic disturbance light removal image by removing the dynamic disturbance light image from the static disturbance light removal image based on the acquired dynamic disturbance light image.

8. A system that recognizes a hand gesture, the system comprising:

an imaging device configured to acquire a hand image, which is a recognition target;

a lighting device configured to illuminate light to allow the imaging device to acquire an image of the hand; and

a controller configured to recognize the gesture of the hand by removing a static background image and a dynamic background image from the image of the hand acquired from the imaging device, wherein the controller is configured to;

acquire from the imaging device a hand image, which is a recognition target;

remove a static background image from the acquired hand image;

remove a dynamic background image from the hand image in which the static background image is removed; and

recognize a gesture of the hand by extracting a characteristic point from the hand image in which the dynamic background image is removed,

9. The system of claim 8, wherein the imaging device is an infrared camera and the lighting device is an infrared lighting device configured to illuminate infrared rays.

10. The system of claim 8, wherein the static background image is static disturbance light of an external light source and the dynamic background image is dynamic disturbance light of an external light source.

11. The system of claim 10, wherein the controller is further configured to:

acquire form the imaging device an image of the hand turning a lighting device on and off every predetermined frame unit with a predetermined rule.

12. The system of claim 11, wherein the predetermined frame unit is three frame units, the predetermined rule turns on the lighting device in a first frame of the three frame units and turns off the lighting device in a second frame and a third frame of the three frame units.

13. The system of claim 8, wherein the controller is further configured to:

acquire a static disturbance light removal image by subtracting the second frame from the first frame.

14. The system of claim 13, wherein the controller is further configured to:

acquire a dynamic disturbance light image by subtracting the third frame from the second frame; and

acquire a dynamic disturbance light removal image by removing the dynamic disturbance light image from the static disturbance light removal image based on the acquired dynamic disturbance light image.

15. A system that recognizes a hand gesture, the system comprising:

an imaging device configured to acquire a hand image, which is a recognition target;

a lighting device configured to illuminate light to allow the imaging device to acquire an image of the hand; and

a controller configured to recognize the gesture of the hand by removing a static background image and a dynamic background image from the image of the hand acquired from the imaging device, wherein the controller is configured to;

acquire from the imaging device the hand image;

remove the dynamic background image from the hand image in which the static background image is removed; and

recognize the gesture of the hand by extracting a characteristic point from the hand image in which the dynamic background image is removed.

16. A non-transitory computer readable medium containing program instructions executed by a processor or controller, the computer readable medium comprising:

program instructions that control an imaging device to acquire a hand image, which is a recognition target;

program instructions that control a lighting device configured to illuminate light to allow the imaging device to acquire an image of the hand;

program instructions that acquire from the imaging device a hand image, which is a recognition target;

program instructions remove a static background image from the acquired hand image;

program instructions that remove a dynamic background image from the hand image in which the static background image is removed; and

program instructions that recognize a gesture of the hand by extracting a characteristic point from the hand image in which the dynamic background image is removed.

17. The non-transitory computer readable medium of claim 16, wherein the static background image is static disturbance light of an external light source and the dynamic background image is dynamic disturbance light of an external light source.

18. The non-transitory computer readable medium of claim 17, further comprising:

program instructions that acquire from the imaging device, an image of the hand turning a lighting device on and off every predetermined frame unit with a predetermined rule.

19. The non-transitory computer readable medium of claim 18, wherein the predetermined frame unit is three frame units, the predetermined rule turns on the lighting device in a first frame of the three frame units and turns off the lighting device in a second frame and a third frame of the three frame units.