Device for manipulating vehicle built-in devices

• US 8,538,090 B2
• Filed: 09/04/2009
• Issued: 09/17/2013
• Est. Priority Date: 03/03/2009
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Hyundai Motor Japan R&D Center Incorporated, Kia Motors Corporation (Kia Corp.)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group), Hyundai Motor Japan R&D Center Incorporated, Kia Motors Corporation (Kia Corp.)
• Inventors: Ishii, Kosei
• Primary Examiner(s): Zarka, David
• Assistant Examiner(s): ROWLAND, JHERE M
• Application Number:
  US12/554,844
• Publication Number:
  US 20100226539A1
• Time in Patent Office: 1,474 Days
• Field of Search: None
• US Class Current: 382/116
• CPC Class Codes: E05F 2015/767 using cameras
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

The present invention provides a device for manipulating vehicle built-in devices. The device includes a manipulation unit, a display unit and a manipulation control unit.

Claims

1. A device for manipulating vehicle built-in devices, comprising:

a pad configured to come into contact with a user'"'"'s manipulating hand, the pad formed in a depression so that walls are formed around the depression;

a camera installed beneath the pad and configured to photograph the user'"'"'s fingers on the pad above;

a screen configured to display overlay images of at least one user finger captured by the camera overlaid on a manipulation screen of a vehicular device; and

a processor configured to issue a relevant manipulation instruction by extracting a trajectory formed by the user'"'"'s fingers from a time series of images of at least one user'"'"'s finger captured by the camera and comparing a motion pattern of the user'"'"'s fingers input through the pad and the camera with motion patterns previously registered in memory, wherein each motion pattern is associated with a specific control function of the vehicle built-in devices, and

wherein images taken of the user'"'"'s fingers from below are converted into an image viewed from the bottom so that the image displayed on the screen is a top-side view of the user'"'"'s fingers rather than a bottom side.

2. The device as set forth in claim 1, further comprising an illumination unit configured to emit light to the user'"'"'s hand in order to improve recognizing performance of the camera.

3. The device as set forth in claim 1, processor compares a trajectory drawn by a tip of the finger in contact with a surface of the pad, which is acquired from time series images of the user'"'"'s finger captured by the camera, with the motion patterns previously registered in the memory.

4. The device as set forth in claim 1, wherein the processor issues an instruction indicative of an amount of manipulation depending on a length of a trajectory drawn by a tip of the finger in contact with a surface of the pad, which is acquired from images of the user'"'"'s finger captured by the camera.

5. The device as set forth in claim 1, wherein the pad is provided with a pressure sensor which is transparent and detects a pressing location of the finger in coordinate form.

6. The device as set forth in claim 1, wherein the camera is an infrared camera and the illumination unit.

7. The device as set forth in claim 2, wherein the illumination unit is made up of a plurality of infrared lamps.

8. The device as set forth in claim 3, wherein the manipulation control unit processor issues a manipulation instruction corresponding to the motion pattern to a relevant vehicular device if the trajectory drawn by a tip of the finger is consistent with the motion pattern previously registered in memory.

9. The device as set forth in claim 3, wherein the trajectory is detected as a trajectory of a white portion of a tip of the finger that is presented in images of the user'"'"'s finger captured by the camera when the tip of the user'"'"'s finger is brought into contact with the pad.

10. The device as set forth in claim 3, wherein the trajectory is drawn by a gesture of the hand.

11. The device as set forth in claim 5, wherein the pad is further provided with a load sensor which is transparent and can detect a stronger pressing pressure than the pressure sensor.

12. The device as set forth in claim 7, wherein a vein pattern is checked and then used for biometric authentication.

13. The device as set forth in claim 10, wherein the gesture of the hand comprises at least one of a motion of extending a flexed finger with a tip of the finger in contact with the pad, a motion of flexing an extended finger with a tip of the finger in contact with the pad, a motion of making a flip using two fingers with the fingers simultaneously in contact with the pad, a motion of directly drawing a character using a finger, and a double touch motion of bringing a tip of a finger into light contact with the pad twice, and a motion pattern consistent with the trajectory is registered in memory of the processor so that a manipulation instruction corresponding to a motion based on the trajectory can be output.