OPERATION SYSTEM FOR VEHICLE

• US 20110060499A1
• Filed: 11/30/2009
• Published: 03/10/2011
• Est. Priority Date: 09/04/2009
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Hyundai Motor Japan R&D Center Incorporated, Kia Motors Corporation (Kia Corp.)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group), Hyundai Motor Japan R&D Center Incorporated, Kia Motors Corporation (Kia Corp.)
• Inventors: Suzuki, Ryo
• Granted Patent: US 8,849,506 B2
• Time in Patent Office: Days
• US Class Current: 701/36
• CPC Class Codes: B60R 11/0264 for control means
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The present invention provides an operation system for a vehicle capable of shortening an operation time, reducing an operation load, and improving visibility of a display section. The operation system includes an operation section on which a camera capturing a finger and a touch panel are installed, and a display section installed away from the operation section, and further includes a finger determination processor determining from an image captured by the camera whether or not an object approaching the operation section is a hand, a conversion processor converting a determination signal of the finger determination processor into a display instruction signal and outputting the converted result, and a pop-up processor displaying an operation button or an operation window on the display section before the hand is touched to the touch panel on the basis of the display instruction signal input from the conversion processor.

Claims

1. An operation system for a vehicle including an operation section on which a touch panel and a camera for capturing an image of a vehicle operator'"'"'s finger or fingers are installed and a display section installed integrally with or separately from the operation section, the operation system comprising:

a finger determination processor for determining from an image captured by the camera whether or not an object approaching the operation section is a hand;

a conversion processor for converting a determination signal of the finger determination processor into a display instruction signal and outputting the display instruction signal; and

a pop-up processor for displaying an operation button or an operation window on the display section before the finger or fingers are touched to the touch panel on a basis of the display instruction signal input from the conversion processor.

2. The operation system of claim 1, wherein:

the finger determination processor determines the number of the finger and outputs a determination signal when it is determined that the object approaching the operation section is the hand; and

the pop-up processor synthesizes the operation button or the operation window corresponding to the number of fingers determined by the finger determination processor with a displayed window and displays the synthesized result, or converts the operation button or the operation window into the displayed window and displays the converted result.

3. The operation system of claim 2, further comprising:

an image processor for receiving the image captured by the camera, processing the received image, and outputting an image processing signal of the finger or fingers; and

a synthesizing processor for receiving the image processing signal output from the image processor, synthesizing the image with the displayed window input by the pop-up processor, sending the synthesized result to the display section such that the displayed window with which the image is synthesized is displayed on the display section.

4. The operation system of claim 2, further comprising an image processor for receiving the image captured by the camera, processing the received image, and outputting an image processing signal of the finger or fingers, wherein the finger determination processor receives the image processing signal output from the image processor, and determines from the received image processing signal whether or not the object approaching the operation section is the hand and what the number of fingers is.

5. The operation system of claim 4, wherein the finger determination processor recognizes the object approaching the operation section by a gradual increase in size of an image of the object.

6. The operation system of claim 1, wherein the conversion processor continues to display the operation button or the operation window without elimination when the hand is moved away from the operation section and when a preset driving operation is detected by an electronic control unit.

7. The operation system of claim 6, wherein the conversion processor continues to display the operation button or the operation window without elimination when operation of any one of a turn signal device, a steering wheel, a shift lever, a power window device, and an air conditioner is detected.

8. The operation system of claim 6, wherein the conversion processor outputs an elimination instruction signal to the pop-up processor after a predetermined time has lapsed such that the operation button or the operation window is eliminated, when a condition that the hand of the operator moves away from the operation section and that the operation button or the operation window continues to be displayed is released.

9. The operation system of claim 8, wherein the conversion processor eliminates the operation button or the operation window if the hand is not captured again for a set time when the hand of the operator is moving away from the operation section and when the preset driving operation is detected by the electronic control unit.

10. The operation system of claim 8, wherein the conversion processor eliminates the operation button or the operation window if the hand is not captured again for a set reference time when the hand of the operator is moving away from the operation section and when the preset driving operation is not detected by the electronic control unit.