Human machine interface apparatus for vehicle and methods of controlling the same
First Claim
1. A vehicle having a human machine interface (HMI) apparatus configured to output an operation command of a user to at least one of a plurality of electronic devices, the HMI apparatus comprising:
- a storage unit configured to store position information of a plurality of regions, operation commands of the plurality of electronic devices positioned in the plurality of regions, and gesture information of the operation commands;
a recognition unit configured to recognize a gesture of the user; and
a control unit configured to identify electronic devices installed in a region adjacent to a boundary region when the gesture is recognized in the boundary region of the plurality of regions, determine adjustment possibilities of the identified electronic devices based on at least one of operation information and pre-stored operation patterns of the identified electronic devices, traveling information of the vehicle, and environmental information of the vehicle, and control the operation command corresponding to the gesture to be output to an electronic device having a highest adjustment possibility among the determined adjustment possibilities, whereinwhen an operation of the identified electronic devices is controlled by the operation command corresponding to the recognized gesture, the control unit is further configured to determine whether the operation of any of the identified electronic devices deviates from the pre-stored operation patterns and determine an electronic device which operates within the pre-stored operation patterns as the electronic device having the highest adjustment possibility,the control unit is further configured to identify the electronic devices corresponding to the gesture according to each adjacent region, identify values of functions corresponding to the respective operation patterns of the identified electronic devices, compare the identified values of functions corresponding to the respective operation patterns of the identified electronic devices with values of functions corresponding to respective current operation information of the identified electronic devices, and based on the comparison, determine an electronic device with the largest difference as the electronic device having the highest adjustment possibility, andthe boundary region includes a region within a given range at a position at which at least two regions of the plurality of regions are adjacent to each other.
1 Assignment
0 Petitions
Accused Products
Abstract
A human machine interface (HMI) minimizing the number of gestures for operation control in which user-intended operation commands are accurately recognized by dividing a vehicle interior into a plurality of regions. The HMI receives an input of a gesture according to each region, and controls any one device according to the gesture. Convenience of a user is improved because the gesture may be performed in a state in which region restriction is minimized by identifying an operation state and an operation pattern of an electronic device designated according to each region to recognize the user'"'"'s intention when the user performs the gesture in a boundary portion between two regions or even in multiple regions.
38 Citations
15 Claims
-
1. A vehicle having a human machine interface (HMI) apparatus configured to output an operation command of a user to at least one of a plurality of electronic devices, the HMI apparatus comprising:
-
a storage unit configured to store position information of a plurality of regions, operation commands of the plurality of electronic devices positioned in the plurality of regions, and gesture information of the operation commands; a recognition unit configured to recognize a gesture of the user; and a control unit configured to identify electronic devices installed in a region adjacent to a boundary region when the gesture is recognized in the boundary region of the plurality of regions, determine adjustment possibilities of the identified electronic devices based on at least one of operation information and pre-stored operation patterns of the identified electronic devices, traveling information of the vehicle, and environmental information of the vehicle, and control the operation command corresponding to the gesture to be output to an electronic device having a highest adjustment possibility among the determined adjustment possibilities, wherein when an operation of the identified electronic devices is controlled by the operation command corresponding to the recognized gesture, the control unit is further configured to determine whether the operation of any of the identified electronic devices deviates from the pre-stored operation patterns and determine an electronic device which operates within the pre-stored operation patterns as the electronic device having the highest adjustment possibility, the control unit is further configured to identify the electronic devices corresponding to the gesture according to each adjacent region, identify values of functions corresponding to the respective operation patterns of the identified electronic devices, compare the identified values of functions corresponding to the respective operation patterns of the identified electronic devices with values of functions corresponding to respective current operation information of the identified electronic devices, and based on the comparison, determine an electronic device with the largest difference as the electronic device having the highest adjustment possibility, and the boundary region includes a region within a given range at a position at which at least two regions of the plurality of regions are adjacent to each other. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A vehicle having a plurality of electronic devices, the vehicle comprising:
-
a plurality of detection units arranged in a plurality of regions; and a human machine interface (HMI) apparatus configured to output an operation command of a user to the plurality of electronic devices arranged in the plurality of regions, wherein the HMI apparatus includes; a storage unit configured to store position information of the plurality of regions, operation commands of the plurality of electronic devices arranged in the plurality of regions, and gesture information of the operation commands; a recognition unit configured to recognize a gesture of the user; and a control unit configured to identify a region in which a detection unit recognizing the gesture is arranged when the gesture is identically recognized in the plurality of detection units, identify electronic devices installed in the identified region, determine adjustment possibilities of the identified electronic devices based on at least one of operation information and pre-stored operation patterns of the identified electronic devices, traveling information of the vehicle, and environmental information of the vehicle, and control the operation command corresponding to the gesture to be output to an electronic device having a highest adjustment possibility among the determined adjustment possibilities, when an operation of the identified electronic devices is controlled by the operation command corresponding to the recognized gesture, the control unit is further configured to determine whether the operation of any of the identified electronic devices deviates from the pre-stored operation patterns and determine an electronic device which operates within the pre-stored operation patterns as the electronic device having the highest adjustment possibility, and the control unit is further configured to identify the electronic devices corresponding to the gesture according to each adjacent region, identify values of functions corresponding to the respective operation patterns of the identified electronic devices, compare the identified values of functions corresponding to the respective operation patterns of the identified electronic devices with values of functions corresponding to respective current operation information of the identified electronic devices, and based on the comparison, determine an electronic device with the largest difference as the electronic device having the highest adjustment possibility.
-
-
7. A control method of a vehicle having a plurality of electronic devices and an HMI apparatus configured to output an operation command of a user to at least one of the plurality of electronic devices, the control method comprising the steps of:
-
detecting an object; recognizing a detection region and a gesture of the detected object; identifying electronic devices installed in a region adjacent to a boundary region when it is determined that the gesture is recognized in the boundary region of a plurality of regions; determining adjustment possibilities of the identified electronic devices based on at least one of operation information and pre-stored operation patterns of the identified electronic devices, traveling information of the vehicle, and environmental information of the vehicle; when an operation of the identified electronic devices is controlled by the operation command corresponding to the recognized gesture, determining whether the operation of any of the identified electronic devices deviates from the pre-stored operation patterns; determining an electronic device which operates within the pre-stored operation patterns as an electronic device having a highest adjustment possibility among the determined adjustment possibilities; and outputting the operation command corresponding to the electronic device having the highest adjustment possibility, wherein the boundary region includes a region within a given range at a position at which at least two regions of the plurality of regions are adjacent to each other, and the determining adjustment possibilities of the identified electronic devices comprises; identifying the electronic devices corresponding to the gesture according to each adjacent region, identifying values of functions corresponding to the respective operation patterns of the identified electronic devices, comparing the identified values of functions corresponding to the respective operation patterns of the identified electronic devices with values of functions corresponding to respective current operation information of the identified electronic devices, and based on the comparison, determining an electronic device with the largest difference as the electronic device having the highest adjustment possibility. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A human machine interface (HMI) apparatus comprising:
-
a storage unit configured to store position information of a plurality of regions, information of a plurality of electronic devices arranged in the plurality of regions, and gesture information of a user corresponding to operation commands of the plurality of electronic devices; a recognition unit configured to recognize a gesture of the user; a control unit configured to identify electronic devices corresponding to a gesture according to each recognized detection region when the number of recognized detection regions is at least two, determine adjustment possibilities of the electronic devices based on current operation information of the identified electronic devices, determine adjustment possibilities of the identified electronic devices based on at least one of operation information of the identified electronic devices, pre-stored operation patterns of the identified electronic devices, and environmental information, and output an operation command corresponding to the gesture to an electronic device having a highest adjustment possibility among the determined adjustment possibilities; and an output unit connected to each of the plurality of electronic devices and configured to output the operation command to at least one electronic device, wherein when an operation of the identified electronic devices is controlled by the operation command corresponding to the recognized gesture, the control unit is further configured to determine whether the operation of any of the identified electronic devices deviates from the pre-stored operation patterns and determine an electronic device which operates within the pre-stored operation patterns as the electronic device having the highest adjustment possibility, and the control unit is further configured to identify the electronic devices corresponding to the gesture according to each adjacent region, identify values of functions corresponding to the respective operation patterns of the identified electronic devices, compare the identified values of functions corresponding to the respective operation patterns of the identified electronic devices with values of functions corresponding to respective current operation information of the identified electronic devices, and based on the comparison, determine an electronic device with the largest difference as the electronic device having the highest adjustment possibility. - View Dependent Claims (14, 15)
-
Specification