Gesture recognition apparatus and method

• US 9,349,044 B2
• Filed: 08/27/2014
• Issued: 05/24/2016
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Joo, Sihyun, Oh, Jongmin, Min, Jungsang
• Primary Examiner(s): CHANG, JON CARLTON
• Application Number:
  US14/470,260
• Publication Number:
  US 20150186717A1
• Time in Patent Office: 636 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A gesture recognition apparatus and method are provided. The gesture recognition apparatus includes an imaging device that is configured to photograph a gesture recognition region and generate image information and a distance sensor that is configured to sense a particular object that approaches a gesture start position. A controller is configured to enter a gesture input mode when the particular object is located at the gesture start position for a predetermined time and recognize a gesture by detecting the particular object based on the image information. Further, the controller is configured to provide feedback that indicates whether the particular object is located at the gesture start position and feedback that indicates whether the particular object is located in the gesture recognition region in the input mode.

Claims

1. A gesture recognition apparatus comprising:

an imaging device configured to photograph a gesture recognition region and generate image information;

a distance sensor configured to sense a particular object that approaches a gesture start position;

a controller configured to;

enter a gesture input mode when the particular object is located at the gesture start position for a predetermined time;

recognize a gesture by detecting the particular object based on the image information; and

provide feedback that indicates whether the particular object is located at the gesture start position and feedback that indicates whether the particular object is located in the gesture recognition region in the input mode,

wherein the gesture recognition region is set to be a predetermined area around a gearshift knob and

wherein the gesture start position is spaced apart form an upper portion of the gearshift knob in a vertical direction by a predetermined distance.

2. The gesture recognition apparatus of claim 1, wherein the imaging device includes a camera disposed to face the gearshift knob.

3. The gesture recognition apparatus of claim 1, wherein the distance sensor is disposed at an upper portion of the gearshift knob.

4. The gesture recognition apparatus of claim 1, wherein the feedback device includes one or more air jet devices configured to jet air toward the particular object to provide tactile feedback.

5. The gesture recognition apparatus of claim 4, wherein the air jet devices are disposed separately from each other around the gearshift knob based on a desired size of a jet region where the air is to be jetted.

6. The gesture recognition apparatus of claim 4, wherein a jet amount and a jet period of the air for indicating the gesture start position is different from the jet amount and the jet period of the air for indicating the gesture recognition region.

7. The gesture recognition apparatus of claim 4, wherein the feedback device is configured to jet the air along a moving path of the particular object located in the gesture recognition region.

8. The gesture recognition apparatus of claim 1, further comprising:

a lighting device configured to irradiate light toward the particular object.

9. The gesture recognition apparatus of claim 1, wherein the controller is configured to determine whether the particular object is located at the gesture start position using image information of the imaging device and distance information of the distance sensor.

10. A gesture recognition method, comprising:

photographing, by a controller, a gesture recognition region and generate image information;

sensing, by a sensor, a particular object that approaches a gesture start position;

entering, by the controller, a gesture input mode when the particular object is located at the gesture start position for a predetermined time;

recognizing, by the controller, a gesture by detecting the particular object based on the image information; and

providing, by the controller, feedback that indicates whether the particular object is located at the gesture start position and feedback that indicates whether the particular object is located in the gesture recognition region in the input mode,

wherein the gesture recognition region is set to be a predetermined area around a gearshift knob and

wherein the gesture start position is spaced apart form an upper portion of the gearshift knob in a vertical direction by a predetermined distance.

11. The method of claim 10, further comprising:

jetting, by an air jet device, air toward the particular object to provide tactile feedback.