VEHICLE AND METHOD OF CONTROLLING THE SAME

• US 20200130674A1
• Filed: 07/10/2019
• Published: 04/30/2020
• Est. Priority Date: 10/29/2018
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Motors Corporation (Kia Corp.)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Youn, Seok-young, Han, Jimin, Lee, Jia, Kim, Kye Yoon, Woo, Seunghyun
• Granted Patent: US 11,364,894 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/741 Instruments adapted for user detection
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/65 Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 30/025 related to comfort of drivers or passengers
• CPC Class Codes: B60W 40/02 related to ambient conditions
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/34 illuminated
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A vehicle includes at least one speaker, a camera configured to obtain a passenger'"'"'s image, and a controller. The controller is configured to identify the passenger, to search for the identified passenger and emotion tag information related to a sound source output through the at least one speaker, and to control the at least one speaker or obtain passenger'"'"'s emotional information according to the search result.

Claims

1. A vehicle comprising:

at least one speaker;

a camera configured to obtain a passenger image of a passenger; and

a controller configured to

identify the passenger,

search for the identified passenger and emotion tag information related to a sound source output through the at least one speaker, and

control the at least one speaker or obtain passenger emotional information according to a search result of the search.

2. The vehicle according to claim 1, wherein the controller is configured to identify a passenger position of the passenger when the emotion tag information is detected, and to control an output size or an output direction of the at least one speaker based on the passenger position and the detected emotion tag information.

3. The vehicle according to claim 1, wherein the controller is configured to:

obtain, when the emotion tag information is not detected, the passenger emotional information for a predetermined time after the sound source is output and determine a passenger position of the passenger; and

control an output size or an output direction of the at least one speaker based on the obtained passenger emotional information and the passenger position.

4. The vehicle according to claim 3, wherein the controller is configured to extract an emotion factor from the obtained passenger emotional information, and to control the output size or the output direction of the at least one speaker so that the emotion factor is increased or decreased.

5. The vehicle according to claim 3, wherein the controller is configured to generate the emotion tag information based on the controlled output size of the at least one speaker or the controlled output direction of the at least one speaker corresponding to the obtained passenger emotional information, and to add the generated emotion tag information to the output sound source.

6. The vehicle according to claim 3, wherein the controller is configured to extract a passenger facial expression from the passenger image obtained for the predetermined time after the sound source is output, and to obtain the passenger emotional information based on the extracted passenger facial expression.

7. The vehicle according to claim 1, wherein the controller is configured to:

identify, when there is a plurality of the passengers, the plurality of passengers and a position of each of the plurality of passengers;

search for a plurality of emotion tag information related to each of the plurality of passengers; and

control the at least one speaker or obtain the emotion information of each of the plurality of passengers according to the search result.

8. The vehicle according to claim 7, wherein the controller is configured to control the output size or the output direction of the at least one speaker based on the detected plurality of emotion tag information and the position of each of the plurality of passengers when the plurality of emotion tag information related to each of the plurality of passengers is detected.

9. The vehicle according to claim 7, wherein the controller is configured to:

obtain, when the plurality of emotion tag information related to each of the plurality of passengers is not detected, the emotion information of each of the plurality of passengers for the predetermined time after the sound source is output; and

control the output size or the output direction of the at least one speaker based on the obtained emotion information of each of the plurality of passengers and the position of each of the plurality of passengers.

10. The vehicle according to claim 9, wherein the controller is configured to generate the plurality of emotion tag information based on the controlled output size of the at least one speaker or the controlled output direction of the at least one speaker corresponding to the obtained emotion information of each of the plurality of passengers, and to add the generated plurality of emotion tag information to the output sound source.

11. A method of controlling a vehicle, the method comprising:

outputting a sound source through at least one speaker;

obtaining, by a camera, a passenger image of a passenger, and identifying, by a controller, the passenger and a passenger position of the passenger;

searching for, by the controller, the identified passenger and emotion tag information related to the output sound source; and

controlling, by the controller, the at least one speaker or obtaining, by the controller, passenger emotional information of the passenger according to a search result of the searching.

12. The method according to claim 11, further comprising:

controlling, by the controller, an output size or an output direction of the at least one speaker based on the passenger position and the detected emotion tag information when the emotion tag information is detected.

13. The method according to claim 11, further comprising:

obtaining, by the controller, the passenger emotional information for a predetermined time after the sound source is output when the emotion tag information is not detected; and

controlling, by the controller, an output size or an output direction of the at least one speaker based on the obtained passenger emotional information and the passenger position.

14. The method according to claim 13, wherein the controlling of the output size or the output direction of the at least one speaker further comprises:

extracting an emotion factor from the obtained passenger emotional information; and

controlling the output size or the output direction of the at least one speaker so that the emotion factor is increased or decreased.

15. The method according to claim 13, further comprising:

generating, by the controller, the emotion tag information based on the controlled output size or output direction of the at least one speaker corresponding to the obtained passenger emotional information; and

adding, by the controller, the generated emotion tag information to the output sound source.

16. The method according to claim 13, further comprising:

extracting, by the controller, the passenger facial expression for the predetermined time after the sound source is output; and

obtaining, by the controller, the passenger emotional information based on the extracted passenger facial expression.

17. A method of controlling a vehicle, the method comprising:

outputting a sound source through at least one speaker;

obtaining, by a camera, images for a plurality of passengers, and identifying, by a controller, the plurality of passengers and a position of each of the plurality of passengers;

searching for, by the controller, a plurality of emotion tag information related to each of the plurality of passengers and the output sound source; and

controlling, by the controller, the at least one speaker or obtaining emotion information of each of the plurality of passengers according to a search result of the searching.

18. The method according to claim 17, further comprising:

controlling, by the controller, an output size or an output direction of the at least one speaker based on the detected plurality of emotion tag information and the position of each of the plurality of passengers when the plurality of emotion tag information related to each of the plurality of passengers is detected.

19. The method according to claim 17, further comprising:

obtaining, by the controller, the emotion information of each of the plurality of passengers for a predetermined time after the sound source is output when the plurality of emotion tag information related to each of the plurality of passengers is not detected; and

controlling, by the controller, an output size or an output direction of the at least one speaker based on the obtained emotion information of each of the plurality of passengers and the position of each of the plurality of passengers.

20. The method according to claim 19, further comprising:

generating, by the controller, the plurality of emotion tag information based on the controlled output size of the at least one speaker or the controlled output direction of the at least one speaker corresponding to the obtained emotion information of each of the plurality of passengers; and

adding, by the controller, the generated plurality of emotion tag information to the output sound source.