VEHICLE INCLUDING COMMUNICATION SYSTEM FOR DISABLED PERSON AND CONTROL METHOD OF COMMUNICATION SYSTEM FOR DISABLED PERSON

• US 20190315227A1
• Filed: 10/09/2018
• Published: 10/17/2019
• Est. Priority Date: 04/17/2018
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Motors Corporation (Kia Corp.)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Motors Corporation (Kia Corp.)
• Inventors: Kim, Jong Won, Lee, Seong Hyeon, Kwon, Oh Sol, Lee, Joo Hwan, Park, Hyeong Jun, Jung, Ji In, Kwon, Jun Young
• Granted Patent: US 10,926,635 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1464 3D-gesture
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/741 Instruments adapted for user detection
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/265 Voice
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/50 Instruments characterised by their means of attachment to or integration in the vehicle B60K35/231 takes precedence
• CPC Class Codes: B60K 35/65 Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: B60K 35/656 the user being a passenger
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments
• CPC Class Codes: B60K 35/90 Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 : Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 : Execution procedure of a spoken command

Abstract

A vehicle including a communication system for a disabled person may include: a motion capture unit that recognizes sign language of a passenger of the vehicle; an input unit that receives a voice or characters from the passenger; a database that stores sign language information; a control unit that is communicatively coupled to the motion capture unit and the input unit, the control unit being configured to translate the sign language recognized by the motion capture unit using the sign language information stored in the database, and to convert a voice received through the input unit into characters; and an output unit that is communicatively coupled to the control unit, the output unit being configured to output the sign language translated by the control unit as a voice or characters, and to output the voice converted by the control unit as characters.

Claims

1. A vehicle including a communication system for a disabled person, the vehicle comprising:

a motion capture unit that recognizes sign language of a passenger of the vehicle;

an input unit that receives a voice or characters from the passenger;

a database that stores sign language information;

a control unit that is communicatively coupled to the motion capture unit and the input unit, the control unit being configured to translate the sign language recognized by the motion capture unit using the sign language information stored in the database, and to convert a voice received through the input unit into characters; and

an output unit that is communicatively coupled to the control unit, the output unit being configured to output the sign language translated by the control unit as a voice or characters, and to output the voice converted by the control unit as characters.

2. The vehicle of claim 1, further comprising a terminal including:

a terminal motion capture unit that recognizes the sign language of the passenger, a terminal input unit that receives the voice or characters from the passenger, and a terminal output unit that outputs the voice or characters.

3. The vehicle of claim 2, wherein the terminal is a mobile terminal of the passenger and is communicatively coupled to the control unit.

4. The vehicle of claim 3, wherein the control unit translates sign language recognized by the terminal using the sign language information stored in the database and converts a voice input through the terminal into characters.

5. The vehicle of claim 4, wherein the control unit outputs sign language recognized and translated by the terminal as a voice or characters through the output unit.

6. The vehicle of claim 4, further comprising a plurality of terminals,

wherein the control unit controls the output unit so as to output sign language recognized and translated by one terminal among the plurality of terminals as a voice or characters.

7. The vehicle of claim 4, wherein the control unit controls the terminal so as to output a voice or characters input through the input unit as characters.

8. The vehicle of claim 4, further comprising a plurality of terminals,

wherein the control unit controls the output unit so as to output a voice recognized and converted by one terminal among the plurality of terminals as a voice or characters.

9. The vehicle of claim 3, further comprising a plurality of terminals,

wherein the control unit communicates with one or more specific terminals among the plurality of terminals.

10. The vehicle of claim 1, further comprising a malfunction sensing unit that senses whether there is a malfunction in the vehicle.

11. The vehicle of claim 10, wherein, when the malfunction sensing unit senses the malfunction, the control unit controls the output unit so as to visually output information of the malfunction.

12. A method of controlling a communication system for a disabled person in a vehicle, the method comprising:

recognizing, by a motion capture unit of the vehicle or a mobile terminal of the passenger, sign language of a passenger of the vehicle;

receiving, by an input unit of the vehicle or the mobile terminal, a voice or characters from the passenger;

translating, by a control unit of the vehicle, the sign language using sign language information stored in a database;

converting, by the control unit, the received voice into characters;

outputting, by an output unit of the vehicle or the mobile terminal, the translated sign language as a voice or characters; and

outputting, by the output unit or the mobile terminal, the converted voice as characters.