Vehicular display input apparatus

• US 10,019,069 B2
• Filed: 03/12/2015
• Issued: 07/10/2018
• Est. Priority Date: 03/27/2014
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Naruse, Youichi
• Primary Examiner(s): Sarma, Abhishek
• Application Number:
  US15/128,588
• Publication Number:
  US 20170102774A1
• Time in Patent Office: 1,216 Days
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A vehicular display input apparatus includes a gesture detection unit, a determiner, and a controller. The gesture detection unit detects a gesture made by a hand of the driver. The determiner determines whether a visual line of the driver is directed within a visual line detection area, which is preliminarily defined to include at least partial display region. The controller switches to one of operations listed in an operation menu, which is to be correlated with the gesture, according to a determination result of the determiner. The determination result indicates whether the visual line is directed within the visual line detection area.

Claims

1. A vehicular display input apparatus equipped to a vehicle, wherein the vehicular display input apparatus displays vehicle information in a display region and enables a driver of the vehicle to input an operation among a plurality of operations listed in an operation menu,

the vehicular display input apparatus comprising:

a gesture detection unit detecting a gesture made by a hand of the driver;

a determiner determining whether a visual line of the driver is directed within a visual line detection area, wherein the visual line detection area is preliminarily defined to include at least a part of the display region; and

a controller switching to one of the plurality of operations listed in the operation menu, which is to be correlated with the gesture, according to a determination result of the determiner, wherein the determination result indicates whether the visual line is directed within the visual line detection area, wherein

the operation menu includes a plurality of layers in a hierarchy,

when the determiner determines that the visual line is not directed within the visual line detection area, the controller correlates the gesture with a selection operation defined in a higher layer of the operation menu, and the selection operation is an operation for selecting one of a plurality of options provided in the higher layer, and

when the determiner determines that the visual line is directed within the visual line detection area, the controller correlates the gesture with a changing operation in a lower layer of the operation menu, and the changing operation is an operation for changing a content of the option selected in the higher layer.

2. The vehicular display input apparatus according to claim 1, wherein

the visual line detection area includes a first visual line detection area and a second visual line detection area defined at different locations, and

the determiner has a first determiner determining whether the visual line is directed within the first visual line detection area and a second determiner determining whether the visual line is directed within the second visual line detection area.

3. The vehicular display input apparatus according to claim 2, wherein

the controller correlates the gesture with an incremental changing operation which increases a preset value of the option that is selected under a condition that the visual line is directed within the first visual line detection area, and

the controller correlates the gesture with a decremental changing operation which decreases the preset value of the option that is selected under a condition that the visual line is directed within the second visual line detection area.

4. The vehicular display input apparatus according to claim 2, wherein

the first visual line detection area and the second visual line detection area are defined at the different locations which are aligned side by side in a horizontal direction of the display region.

5. The vehicular display input apparatus according to claim 2, wherein

the first visual line detection area and the second visual line detection area are defined at the different locations which are spaced apart from one another.

6. The vehicular display input apparatus according to claim 1, wherein

the display region has a content display portion located within the visual line detection area, and the content display portion displays a content of the changing operation when the visual line is directed within the visual line detection area.

7. The vehicular display input apparatus according to claim 1, wherein

the controller continues a control which correlates the gesture with the changing operation for a predetermined period of time under a condition that the visual line is directed within the visual line detection area.

8. The vehicular display input apparatus according to claim 1, wherein

the display region has a menu display portion located outside of the visual line detection area, and the menu display portion notifies the driver of the option selected in the higher layer.

9. The vehicular display input apparatus according to claim 1, further comprising:

a luminous region located within the visual line detection area, wherein the luminous region becomes luminous under a condition that the visual line is directed within the visual line detection area.

10. The vehicular display input apparatus according to claim 1, wherein

the gesture detection unit detects the gesture within a gesture detection area preliminarily defined to include a rim portion of a steering wheel of the vehicle.

11. The vehicular display input apparatus according to claim 1, further comprising:

a visual line detection unit detecting the visual line of the driver; and

a visual line detection indicator notifying whether the visual line is detected by the visual line detection unit.

12. The vehicular display input apparatus according to claim 1, further comprising:

a gesture detection indicator notifying the driver of whether the hand of the driver is detected by the gesture detection unit.