Remote control system for a locomotive using voice commands

• US 6,697,716 B2
• Filed: 08/16/2002
• Issued: 02/24/2004
• Est. Priority Date: 09/01/2000
• Status: Expired due to Term

• Current Assignee: Cattron North America, Inc. (Cattron Holdings, Inc.)
• Original Assignee: CANAC Incorporated
• Inventors: Horst, Folkert
• Primary Examiner(s): ARTHUR JEANGLAUDE, GERTRUDE
• Application Number:
  US10/222,560
• Publication Number:
  US 20020193918A1
• Time in Patent Office: 557 Days
• Field of Search: 701/19, 701/20, 701/29, 246/187.A, 246/187.C, 704/275, 340/825.69, 340/825.72
• US Class Current: 701/19
• CPC Class Codes: B61C 17/12 Control gear; Arrangements for controlling locomotives from remote points in the train or when operating in multiple units control from points outside the train B61L3/00; fluid-actuated telemotors, servomotors F15B; control devices in general G05
• CPC Class Codes: B61L 17/00 Switching systems for classification yards
• CPC Class Codes: B61L 3/127 for remote control of locomotives remote control of locomotives within a train consist B61C17/12
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A remote control system for a locomotive. The remote control system includes a lead controller and follower controller connected to one another over a wireless communication link. The lead controller issues commands over the wireless communication link and those commands are implemented by the follower controller mounted on-board the locomotive. The lead controller is responsive to voice commands uttered by the operator.

Claims

1. A controller for a locomotive, comprising:

a) an input for receiving a signal derived from a spoken utterance;

b) a processing unit operative to process the signal to derive data indicative of at least one recognition result that is a potential match to the spoken utterance;

c) said processing unit being operative to transmit a control signal derived at least in part on the basis of the at least one recognition result when a validation data element derived from a validation signal provided by a human operator confirms that the data indicative of at least one recognition result is a match to the spoken utterance, said control signal being indicative of a command to be executed by the locomotive.

2. A controller as described in claim 1, further comprising a communication link interface operative to transmit over a communication link the control signal indicative of a command to be executed by the locomotive to a follower controller onboard the locomotive.

3. A controller as defined in claim 2, wherein the communication link interface is operative to maintain a wireless communication link with a follower controller in the locomotive.

4. A controller as defined in claim 1, wherein said input is further adapted to receive the validation signal conveying the validation data element.

5. A controller as defined in claim 4, wherein the validation signal conveying the validation data element is derived from a spoken utterance.

6. A controller as defined in claim 1, wherein said input is a first input, said controller further comprising a second input for receiving validation signal conveying the validation data element.

7. A controller as defined in claim 1, wherein said processing unit includes a speech recognition engine to generate data indicative of the at least one recognition result that is a potential match to the spoken utterance, the at least one recognition result being at least one vocabulary item.

8. A controller as defined in claim 7, wherein the data indicative of the at least one vocabulary item is an orthographic representation of the at least one vocabulary item.

9. A controller as defined in claim 7, wherein said processing unit includes a speech recognition dictionary including a plurality of vocabulary items, said speech recognition engine being coupled to said speech recognition dictionary and being operative to select amongst the plurality of vocabulary items at least one vocabulary item as being a potential match to the spoken utterance.

10. A controller as defined in claim 9, wherein said processing unit is operative to communicate to a human operator the at least one vocabulary item.

11. A controller as defined in claim 10, wherein said processing unit is operative to audibly communicate to the human operator the at least one vocabulary item.

12. A controller as defined in claim 1, wherein said processing unit includes a speaker verification module, said speaker verification module being operative to process the signal derived from a spoken utterance to generate speaker confirmation data, the speaker confirmation data being indicative of whether the spoken utterance belongs to an authorized user, said processing unit being operative to transmit the control signal indicative of the command to be executed by the locomotive when the validation data element derived from the validation signal provided by a human operator confirms that the data indicative of at least one recognition result is a match to the spoken utterance and when the speaker confirmation data confirms that the spoken utterance belongs to an authorized user.

13. A control system for a locomotive, comprising:

a) a lead controller remote from the locomotive;

b) a follower controller;

c) said lead controller and said follower controller being operative to establish a communication link therebetween for transporting data from one of said controllers to the other of said controllers;

d) said lead controller including;

i) an input for receiving a signal derived from a spoken utterance;

ii) a processing unit operative to process the signal to derive data indicative of at least one recognition result that is a potential match to the spoken utterance;

iii) said processing unit being operative to transmit a control signal derived at least in part on the basis of the at least one recognition result when a validation data element derived from a validation signal provided by a human operator confirms that the data indicative of at least one recognition result is a match to the spoken utterance, said control signal being indicative of a command to be executed by the locomotive;

e) said follower controller being responsive to the control signal indicative of a command to be executed by the locomotive for generating local signals for application to the locomotive to cause the locomotive to execute the command.

14. A control system as defined in claim 13, wherein said lead controller further comprises a communication link interface operative to transmit over a communication link the control signal indicative of a command to the follower controller onboard the locomotive.

15. A control system as defined in claim 14, wherein the communication link interface is operative to maintain a wireless communication link with the follower controller in the locomotive.

16. A control system as defined in claim 13, wherein the input of said lead controller is further adapted to receive the validation signal conveying the validation data element.

17. A control system as defined in claim 16, wherein the validation signal conveying the validation data element is derived from a spoken utterance.

18. A control system as defined in claim 13, wherein the input of said lead controller is a first input, said lead controller further comprising a second input for receiving the validation signal conveying the validation data element.

19. A remote control system for a locomotive as defined in claim 13, wherein the processing unit of said lead controller includes a speech recognition engine to generate data indicative of at least one recognition result that is a potential match to the spoken utterance, the at least one recognition result being at least one vocabulary item.

20. A remote control system for a locomotive as defined in claim 19, wherein the data indicative of the at least one vocabulary item is an orthographic representation of the at least one vocabulary item.

21. A remote control system for a locomotive as defined in claim 19, wherein said processing unit includes a speech recognition dictionary including a plurality of vocabulary items, said speech recognition engine being coupled to said speech recognition dictionary and being operative to select from amongst the plurality of vocabulary items at least one vocabulary item that is a potential match to the spoken utterance.

22. A remote control system for a locomotive as defined in claim 21, wherein said processing unit is operative to communicate to a human operator the at least one vocabulary item selected by the speech recognition engine as being a potential match to the spoken utterance.

23. A remote control system for a locomotive as defined in claim 22, wherein said processing unit is operative to audibly communicate to the human operator the at least one vocabulary item.

24. A remote control system for a locomotive as defined in claim 23, wherein said processing unit is operative to generate a signal conveying the at least one vocabulary item in synthetic speech form.

25. A controller for a locomotive, comprising:

a) means for receiving a signal derived from a spoken utterance;

b) means for processing the signal to derive data indicative of at least one recognition result that is a potential match to the spoken utterance;

c) means for transmitting a control signal derived at least in part on the basis of the at least one recognition result when a validation data element derived from a validation signal provided by a human operator confirms that the data indicative of at least one recognition result is a match to the spoken utterance, said control signal being indicative of a command to be executed by the locomotive.

26. A method for remotely controlling a locomotive, said method comprising:

a) receiving a first signal derived from a spoken utterance;

b) processing the first signal to derive data indicative of at least one recognition result that is a potential match to the spoken utterance;

c) communicating to a human operator the at least one recognition result;

d) transmitting a control signal derived at least in part on the basis of the at least one recognition result when a validation data element derived from a validation signal provided by the human operator confirms that the data indicative of at least one recognition result is a match to the spoken utterance, said control signal being indicative of a command to be executed by the locomotive.

27. A controller for a locomotive, comprising:

a) an input for receiving a signal derived from a spoken utterance;

b) a speaker verification module operative to process the signal derived from a spoken utterance to generate data being indicative of whether the spoken utterance belongs to an authorized user;

c) a processing unit operative to transmit a control signal indicative of a command to be executed by the locomotive when the speaker verification unit confirms that the spoken utterance belongs to an authorized user, the control signal being derived at least in part from the signal derived from the spoken utterance.

28. A controller as described in claim 27, further comprising:

a) a processing unit operative to process the signal to derive data indicative of at least one vocabulary item that is a potential match to the spoken utterance;

b) said processing unit being operative to transmit a control signal derived at least in part on the basis of the at least one vocabulary item when a validation data element derived from a validation signal provided by a human operator confirms that the data indicative of at least one vocabulary item is a match to the spoken utterance, and when the speaker confirmation data confirms that the spoken utterance belongs to an authorized user, said control signal being indicative of a command to be executed by the locomotive.

29. A controller as described in claim 27, further comprising a communication link interface operative to transmit over a communication link the control signal indicative of a command to be executed by the locomotive to a follower controller onboard the locomotive.

30. A controller as defined in claim 29, wherein the communication link interface is operative to maintain a wireless communication link with a follower controller in the locomotive.

31. A controller as defined in claim 28, wherein said input is further adapted to receive the validation signal conveying the validation data element.

32. A controller as defined in claim 31, wherein the validation signal conveying the validation data element is derived from a spoken utterance.

33. A controller as defined in claim 28, wherein said input is a first input, said controller further comprising a second input for receiving the validation signal conveying the validation data element.

34. A controller as defined in claim 28, wherein said processing unit includes a speech recognition engine to generate data indicative of the at least one vocabulary item that is a potential match to the spoken utterance.

35. A controller as defined in claim 34, wherein the data indicative of the at least one vocabulary item is an orthographic representation of the at least one vocabulary item.

36. A controller as defined in claim 34, wherein said processing unit includes a speech recognition dictionary including a plurality of vocabulary items, said speech recognition engine being coupled to said speech recognition dictionary and being operative to select amongst the plurality of vocabulary items at least one vocabulary item as being a potential match to the spoken utterance.

37. A controller as defined in claim 36, wherein said processing unit is operative to communicate to a human operator the at least one vocabulary item.

38. controller as defined in claim 37, wherein said processing unit is operative to audibly communicate to the human operator the at least one vocabulary item.

39. A method for remotely controlling a locomotive, comprising:

a) receiving a signal derived from a spoken utterance;

b) processing the signal derived from a spoken utterance to generate speaker confirmation data, the speaker confirmation data being indicative of whether the spoken utterance belongs to an authorized user;

c) transmitting a control signal derived at least in part from the signal derived from the spoken utterance indicative of a command to be executed by the locomotive when the speaker confirmation data confirms that the spoken utterance belongs to an authorized user.

40. A method as described in claim 39, wherein the signal derived from a spoken utterance is a first signal, said method further comprising:

a) processing the first signal to derive data indicative of at least one vocabulary item that is a potential match to the spoken utterance;

b) communicating to a human operator the at least one vocabulary item;

c) receiving a second signal indicative of a validation data element;

d) transmitting the signal indicative of a command to be executed by the locomotive when the second signal confirms that the data indicative of at least one vocabulary item is a match to the spoken utterance and when the speaker confirmation data confirms that the spoken utterance belongs to an authorized user.

41. A method as defined in claim 40, wherein the second signal indicative of a validation data element is derived from a spoken utterance.

42. A method as defined in claim 41, said method comprising audibly communicating to the human operator the at least one vocabulary item.

43. A method as defined in claim 40, said method comprising generating a signal conveying the at least one vocabulary item in synthetic speech form.