Speech recognition-based vehicle control method

• US 10,446,152 B2
• Filed: 12/07/2017
• Issued: 10/15/2019
• Est. Priority Date: 10/13/2017
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Motors Corporation (Kia Corp.)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Sim, HyunChul
• Primary Examiner(s): Patel, Shreyans A
• Application Number:
  US15/834,678
• Publication Number:
  US 20190115017A1
• Time in Patent Office: 677 Days
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04L 63/0853 using an additional device, e.g. smartcard, SIM or a different communication terminal cryptographic mechanisms or cryptographic arrangements for entity authentication involving additional secure or trusted devices H04L9/3234
• CPC Class Codes: H04L 63/0876 based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/44 for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

A speech recognition based vehicle control method includes transmitting a speech command to a first server through a first path via a speech recognition service apparatus in response to a generation of the speech command, transmitting authentication data of a portable device and the speech command to the first server through a second path via the portable device in response to the generation of the speech command, and performing, by the first server, authentication of the portable device on the basis of the authentication data, and recognizing the speech command as a valid speech command when the authentication of the portable device is completed.

Claims

1. A vehicle control method, the method comprising:

detecting a gesture event in a portable device;

transmitting a speech command to a first server through a first path via a speech recognition service apparatus in response to the occurrence of the gesture event;

transmitting authentication data of the portable device and the speech command to the first server through a second path via the portable device in response to the occurrence of the gesture event; and

performing, by the first server, authentication of the portable device on the basis of the authentication data, and recognizing the speech command as a valid speech command when the authentication of the portable device is completed.

2. The method according to claim 1, further comprising comparing the speech command transmitted through the first path and the speech command transmitted through the second path to determine validity of the speech command, and determining whether the speech commands are identical.

3. The method according to claim 1, further comprising transmitting the speech command to the second server when the speech command is determined to be valid so that control corresponding to the speech command is performed.

4. The method according to claim 3, wherein:

the second server is a telematics server; and

the control through the speech command is for controlling a vehicle registered in the telematics server.

5. The method according to claim 1, wherein the speech recognition service apparatus is an Internet of things (IoT) device for providing a speech recognition secretarial service.

6. The method according to claim 1, wherein the portable device is a wearable device having at least one function of speech input and gesture recognition.

7. A speech recognition method, the method comprising:

detecting a gesture event in a portable device;

transmitting a speech command to a first server through a first path via a speech recognition service apparatus in response to the occurrence of the gesture event;

transmitting authentication data of the portable device and gesture event data to the first server through a second path via the portable device in response to the occurrence of the gesture event; and

performing, by the first server, authentication of the portable device on the basis of the authentication data, and recognizing the speech command as a valid speech command when the authentication of the portable device is completed.

8. The method according to claim 7, wherein only a speech signal input within a preset time after the occurrence of the gesture event is recognized as a speech command.

9. The method according to claim 7, wherein a motion of a part of a body of a user of the portable device is sensed through a motion sensor to detect that the gesture event occurred.

10. The method according to claim 9, wherein the motion sensor is at least one of a gyro sensor, a vision sensor and an optical sensor, which are provided to sense the motion of the part of the body of the user.

11. The method according to claim 7, further comprising transmitting the speech command to the second server when the speech command is determined to be valid so that a control corresponding to the speech command is performed.

12. The method according to claim 11, wherein:

the second server is a telematics server; and

the control through the speech command controls a vehicle registered in the telematics server.

13. The method according to claim 7, wherein the speech recognition service apparatus is an Internet of things (IoT) device for providing a speech recognition secretarial service.

14. The method according to claim 7, wherein the portable device is a wearable device having at least one function of speech input and gesture recognition.