SYSTEM AND METHOD FOR MANIPULATING USER INTERFACE IN VEHICLE USING FINGER VALLEYS

• US 20140168061A1
• Filed: 09/20/2013
• Published: 06/19/2014
• Est. Priority Date: 12/18/2012
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Sung Un
• Granted Patent: US 9,235,269 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A method for manipulating a user interface within a vehicle using finger valleys includes receiving, by a controller, a captured image and detecting finger valleys from the captured image. In addition a hand gesture is recognized by the controller using the finger valleys and a vehicle equipment operation that corresponds to the recognized hand gesture is selected. Accordingly, the passenger is able to manipulate a vehicle steering wheel with one hand and look forward while operating many in-vehicle electronic devices with simple motions of the other hand, thereby improving passengers'"'"' convenience and driving safety.

Claims

1. A method for manipulating a user interface is within a vehicle using finger valleys, the method comprising:

receiving, by a controller, a captured image;

detecting, by the controller, finger valleys from the captured image;

recognizing, by the controller, a hand gesture using the finger valleys; and

selecting, by the controller, a vehicle equipment operation that corresponds to the recognized hand gesture.

2. The method of claim 1, wherein the detecting of finger valleys from the captured image and recognizing of a hand gesture using the finger valleys includes:

recognizing, by the controller, a hand image from the captured image;

detecting, by the controller, finger valleys from the hand image;

extracting, by the controller, a three-dimensional (3D) posture from the finger valleys;

generating, by the controller, the trajectory of the 3D posture; and

recognizing, by the controller, a hand gesture from the trajectory of the 3D posture.

3. The method of claim 2, wherein the recognizing of a hand gesture from the trajectory of the 3D posture includes:

detecting, by the controller, whether a hand gesture matching the trajectory of the 3D posture is stored in an information database;

in response to detecting a matching hand gesture stored in the information database, recognizing, by the controller, the trajectory of the 3D posture as a hand gesture.

4. The method of claim 1, further comprising:

determining, by the controller, whether a request to use a hand gesture recognition function has been received, prior to the receiving of a captured image; and

in response to determining a request to use the hand gesture recognition function, receiving, by the controller, the captured image.

5. The method of claim 4, further comprising:

determining, by the controller, whether a request to terminate the hand gesture recognition function has been received; and

in response to determining a request to terminate the hand gesture recognition function, terminating, by the controller, the hand gesture recognition function.

6. A system for manipulating a user interface in a vehicle using finger valleys, the system comprising:

an image capture unit configured to capture images; and

a controller configured to;

receive a captured image from the image capture unit;

store the captured image in an image storing unit;

detect finger valleys from the captured image;

recognize a hand gesture using the finger valleys;

select a vehicle equipment operation that corresponds to the recognized hand gesture; and

operate vehicle equipment operations based on an input signal from the image capture unit and accumulated image information stored in the image storage unit.

7. The system of claim 6, wherein the controller is further configured to:

recognize a hand image from the captured image;

detect finger valleys from the hand image;

extract a three-dimensional (3D) posture from the finger valleys;

generate the trajectory of the 3D posture; and

recognize a hand gesture from the trajectory of the 3D posture.

8. The system of claim 7, wherein the controller is further configured to:

detect whether a hand gesture matching the trajectory of the 3D posture is stored in an information database;

recognize the trajectory of the 3D posture as a hand gesture in response to detecting a matching hand gesture stored in the information database.

9. The system of claim 6, wherein the controller is further configured to:

determine whether a request to use a hand gesture recognition function has been received, prior to the receiving of a captured image; and

receive the captured image in response to determining a request to use the hand gesture recognition function.

10. The method of claim 9, wherein the controller is further configured to:

determine whether a request to terminate the hand gesture recognition function has been received; and

terminate the hand gesture recognition function in response to determining a request to terminate the hand gesture recognition function.

11. The method of claim 6, wherein the controller is further configured to:

display the content of the selected vehicle equipment operation via an output unit.

12. A non-transitory computer readable medium containing program instructions executed by controller, the computer readable medium comprising:

program instructions that control an image capture unit to capture images;

program instructions that receive a captured image from the image capture unit;

program instructions that store the captured image in an image storing unit;

program instructions that detect finger valleys from the captured image;

program instructions that recognize a hand gesture using the finger valleys;

program instructions that select a vehicle equipment operation that corresponds to the recognized hand gesture; and

program instructions that operate vehicle equipment operations based on an input signal from the image capture unit and accumulated image information stored in the image storage unit.

13. The non-transitory computer readable medium of claim 12, further comprising:

program instructions that recognize a hand image from the captured image;

program instructions that detect finger valleys from the hand image;

program instructions that extract a three-dimensional (3D) posture from the finger valleys;

program instructions that generate the trajectory of the 3D posture; and

program instructions that recognize a hand gesture from the trajectory of the 3D posture.

14. The non-transitory computer readable medium of claim 13, further comprising:

program instructions that detect whether a hand gesture matching the trajectory of the 3D posture is stored in an information database;

program instructions that recognize the trajectory of the 3D posture as a hand gesture in response to detecting a matching hand gesture stored in the information database.

15. The non-transitory computer readable medium of claim 12, further comprising:

program instructions that determine whether a request to use a hand gesture recognition function has been received, prior to the receiving of a captured image; and

program instructions that receive the captured image in response to determining a request to use the hand gesture recognition function.

16. The non-transitory computer readable medium of claim 15, further comprising:

program instructions that determine whether a request to terminate the hand gesture recognition function has been received; and

program instructions that terminate the hand gesture recognition function in response to determining a request to terminate the hand gesture recognition function.

17. The non-transitory computer readable medium of claim 12, further comprising:

program instructions that display the content of the selected vehicle equipment operation via an output unit.