System, Method, and Apparatus for Detecting Vehicle Operator Conduct

• US 20170355378A1
• Filed: 06/08/2016
• Published: 12/14/2017
• Est. Priority Date: 06/08/2016
• Status: Active Grant

• Current Assignee: Westinghouse Air Brake Technologies Corporation
• Original Assignee: Westinghouse Air Brake Technologies Corporation
• Inventors: Swiderski, Frank J.
• Granted Patent: US 9,840,258 B1
• Time in Patent Office: Days
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: B61L 15/0072 On-board train data handling
• CPC Class Codes: B61L 15/009 On-board display devices
• CPC Class Codes: B61L 23/00 Control, warning or like safety means along the route or between vehicles or trains
• CPC Class Codes: B61L 27/20 Trackside control of safe travel of vehicle or train, e.g. braking curve calculation
• CPC Class Codes: B61L 27/40 Handling position reports or trackside vehicle data
• CPC Class Codes: B61L 27/57 for vehicles or trains, e.g. trackside supervision of train conditions

Abstract

A monitoring system for detecting a condition in a vehicle, including at least one imaging device having a field of view including at least a portion of an interior cabin of the vehicle occupied by an operator of the vehicle during operation, a data storage medium configured to store parameter data in a database, the parameter data including control parameter data for the interior cabin of the vehicle, and at least one processor in communication with the at least one imaging device and the data storage medium. The at least one processor is programmed or configured to receive operational image data from the at least one imaging device, generate operational parameter data from the operational image data, compare the operational parameter data to the control parameter data, and determine if at least one operator is absent from the interior cabin and/or if at least one unauthorized display device is present in the vehicle.

Claims

1. A monitoring system for detecting the presence of unauthorized display devices in a cabin of a vehicle, comprising:

(a) at least one imaging device having a field of view including an interior of the cabin occupied by an operator of the vehicle during operation;

(b) a data storage medium configured to store parameter data in a database, the parameter data comprising control parameter data for the interior of the cabin; and

(c) at least one processor in communication with the at least one imaging device and the data storage medium, the at least one processor programmed or configured to;

(i) receive operational image data from the at least one imaging device;

(ii) generate operational parameter data from the operational image data;

(iii) compare the operational parameter data to the control parameter data; and

(iv) determine if at least one unauthorized display device is present in the cabin based at least partially on the comparison between the operational parameter data and the control parameter data.

2. The monitoring system of claim 1, wherein at least one of the following:

the parameter data, the control parameter data, the operational parameter data, or any combination thereof comprises information or data representative of at least one of the following;

thermal intensity, object luminance, background luminance, object location, object pixel count, object pixel geometry, object movement, or any combination thereof.

3. The monitoring system of claim 2, wherein the at least one imaging device is configured with a polarized filter, wherein the operational parameter data comprises data representative of lower object luminance relative to background luminance, the lower object luminance representative of the at least one unauthorized display device emitting polarized light with a device polarization approximately perpendicular in axis to an imaging polarization.

4. The monitoring system of claim 1, wherein the at least one processor is further programmed or configured to generate or edit the control parameter data stored in the database based on initial image data received from the at least one imaging device while the cabin is unoccupied, wherein the control parameter data comprises a representation of or information identifying at least one authorized display device.

5. The monitoring system of claim 1, wherein the at least one processor is further programmed or configured to periodically receive the operational image data from the at least one imaging device and generate the operational parameter data from the operational image data while the vehicle is in operation, and wherein the control parameter data is generated based on a portion of the operational parameter data corresponding to a prior time or time period, and wherein the comparison between the control parameter data and the operational parameter data comprises a comparison between the portion of the operational parameter data from the prior time or time period to a portion of the operational parameter data from a subsequent time or time period.

6. The monitoring system of claim 1, further comprising at least one alert device programmed or configured to communicate a notification or message to the operator in the cabin in response to determining that the at least one unauthorized display device is present in the cabin.

7. The monitoring system of claim 6, wherein the at least one alert device comprises at least one of the following:

a display screen, a speaker, a vibration motor, an indicator light, or any combination thereof.

8. The monitoring system of claim 6, wherein the at least one alert device substantially continuously communicates the notification or message that the at least one unauthorized display device has been detected until the at least one processor determines that the at least one unauthorized display device is no longer detected.

9. The monitoring system of claim 6, wherein the at least one processor is further programmed or configured to receive a response from the operator confirming or denying that the at least one unauthorized display device has been present in the cabin.

10. The monitoring system of claim 1, further comprising at least one communication device located on or associated with the vehicle and configured to communicate, to a remote back office system or monitoring station, a notification or message that the at least one unauthorized display device was detected.

11. The monitoring system of claim 10, wherein the remote back office system or monitoring station comprises at least one processor programmed or configured to, in response to receiving the notification or message that the at least one unauthorized display device was detected, implement or cause to be implemented at least one of the following:

cause the vehicle to alter an aspect or parameter of its operation, notify the operator in the cabin that the at least one unauthorized display device was detected, record detection event data corresponding to detecting the at least one unauthorized display device, or any combination thereof.

12. The monitoring system of claim 11, wherein the at least one processor of the remote back office system or monitoring station is further programmed or configured to:

cause the vehicle to stop responding to the operator'"'"'s control;

communicate to the operator that the at least one unauthorized display device was detected; and

return control to the operator in response to the remote back office system or monitoring station receiving a notification or message that the at least one unauthorized display device is no longer detected.

13. The monitoring system of claim 1, further comprising an event database, associated with the vehicle or a remote back office system or monitoring station, configured to store data representative of unauthorized display device detection events, the data comprising at least one of the following:

time data, vehicle identification data, operator identification data, or any combination thereof.

14. The monitoring system of claim 13, wherein the data further comprises at least a portion of the operational image data received from the at least one imaging device from a time period during which the at least one unauthorized display device was detected.

15. The monitoring system of claim 1, wherein the vehicle is a train and the at least one processor comprises an on-board computer positioned on the train.

16. A method for detecting the presence of unauthorized display devices in a cabin of a vehicle, wherein the cabin comprises at least one imaging device having a field of view including at least a portion of an interior of the cabin, the method comprising:

receiving operational image data from the at least one imaging device while the vehicle is being operated by an operator;

generating, with at least one processor, operational parameter data from the operational image data based on at least one of the following;

thermal intensity, a region of luminance, an object luminance, a background luminance, or any combination thereof;

comparing, with at least one processor, the operational parameter data to control parameter data for the cabin stored in at least one data storage device;

determining, with at least one processor, if at least one unauthorized display device is present in the cabin based on the comparison between the operational parameter data and the control parameter data; and

in response to determining that at least one unauthorized display device is present in the cabin, generating an alert with at least one processor.

17. The method of claim 16, wherein the at least one imaging device is configured with a polarized filter, wherein the operational parameter data comprises data representative of lower object luminance relative to background luminance, the lower object luminance representative of the at least one unauthorized display device emitting polarized light with a device polarization approximately perpendicular in axis to an imaging polarization.

18. The method of claim 16, wherein the control parameter data comprises parameter data that is predefined or generated from previous image data.

19. The method of claim 18, wherein the control parameter data is generated from the previous image data, the method further comprising:

receiving the previous image data from the at least one imaging device while the vehicle is not in operation and the cabin is unoccupied; and

generating the control parameter data based on the previous image data and at least one authorized display device present in the unoccupied cabin,

wherein determining if the at least one unauthorized display device is present in the cabin comprises determining whether the operational parameter data comprises a region of luminance that does not correspond to the at least one authorized display device.

20. The method of claim 16, further comprising periodically receiving the operational image data from the at least one imaging device, wherein the operational parameter data is generated from the operational image data while the vehicle is in operation, wherein the control parameter data is generated based on a portion of the operational parameter data corresponding to a prior time or time period, and wherein the comparison between the control parameter data and the operational parameter data comprises a comparison between the portion of the operational parameter data from the prior time or time period to a portion of the operational parameter data from a subsequent time or time period.

21. The method of claim 16, further comprising causing at least one alert device to communicate a notification or message to the operator in the cabin that the at least one unauthorized display device has been detected, wherein the at least one alert device comprises at least one of the following:

a display screen, a speaker, a vibration motor, an indicator light, or any combination thereof.

22. The method of claim 21, wherein the at least one alert device substantially continuously communicates the notification or message that the at least one unauthorized display device has been detected until the at least one processor determines that the at least one unauthorized display device is no longer detected.

23. The method of claim 21, further comprising receiving a response from the operator confirming or denying that the at least one unauthorized display device has been present in the cabin.

24. The method of claim 16, further comprising communicating a notification or message to a remote back office system or monitoring station that the at least one unauthorized display device has been detected.

25. The method of claim 24, further comprising, in response to receiving a communication from the remote back office system or monitoring station, implementing or causing the implementation of at least one of the following:

causing the vehicle to alter an aspect or parameter of its operation, notifying the operator that the at least one unauthorized display device was detected in the cabin, recording detection event data corresponding to detecting the at least one unauthorized display device, or any combination thereof.

26. The method of claim 16, further comprising storing, in a database, unauthorized display device detection events comprising at least one of the following:

time data, vehicle identification data, operator identification data, or a combination thereof.

27. The method of claim 26, wherein the unauthorized display device detection events stored in the database further comprise at least a portion of the operational image data received from the at least one imaging device from a time period during which the at least one unauthorized display device was detected.

28. An apparatus for detecting the presence of unauthorized display devices in a cabin of a vehicle, wherein the cabin comprises at least one imaging device having a field of view including at least a portion of an interior of the cabin, the apparatus comprising at least one non-transitory computer-readable medium having program instructions stored thereon that, when executed by at least one processor, cause the at least one processor to:

receive operational image data from the at least one imaging device while the vehicle is being operated;

generate operational parameter data from the operational image data based on at least one of the following;

thermal intensity, a region of luminance, an object luminance, a background luminance, or any combination thereof;

compare the operational parameter data to control parameter data for the cabin stored in at least one data storage device;

determine if at least one unauthorized display device is present in the cabin based on the comparison between the operational parameter data and the control parameter data; and

generate an alert in response to determining that at least one unauthorized display device is present in the cabin.

29. A monitoring system for detecting a condition in a locomotive cab of a train, comprising:

(a) at least one imaging device having a field of view including at least a portion of an interior of the locomotive cab occupied by an operator of the train during operation;

(b) a data storage medium configured to store parameter data in a database, the parameter data comprising control parameter data for the interior of the locomotive cab; and

(c) at least one processor in communication with the at least one imaging device and the data storage medium, the at least one processor programmed or configured to;

(i) receive operational image data from the at least one imaging device;

(ii) generate operational parameter data from the operational image data;

(iii) compare the operational parameter data to the control parameter data; and

(iv) determine, based at least partially on the comparison between the operational parameter data and the control parameter data, at least one of the following;

if at least one operator of the train is absent from the interior of the locomotive cab, if at least one unauthorized display device is present in the locomotive cab, or any combination thereof.

30. The system of claim 29, wherein the at least one imaging device is configured with a polarized filter, wherein the operational parameter data comprises data representative of lower object luminance compared to background luminance, the lower object luminance representative of the at least one unauthorized display device emitting polarized light with a device polarization approximately perpendicular in axis to an imaging polarization.

31. The system of claim 29, wherein the at least one processor is further programmed or configured to generate the control parameter data based on initial image data received from the at least one imaging device while the interior of the locomotive cab is unoccupied.

32. The monitoring system of claim 29, wherein the at least one processor is further programmed or configured to periodically receive the operational image data from the at least one imaging device, generate operational parameter data from the operational image data while the train is in operation, and edit the database to update the control parameter data of the interior of the locomotive cab, wherein the control parameter data is generated based on a portion of the operational parameter data corresponding to a prior time or time period, and wherein the comparison between the control parameter data and the operational parameter data comprises a comparison between the portion of the operational parameter data from the prior time or time period to a portion of the operational parameter data from a subsequent time or time period.

33. The monitoring system of claim 29, further comprising at least one alert device programmed or configured to communicate a notification or message within the locomotive cab in response to determining that the at least one unauthorized display device is present in the locomotive cab or that the at least one operator of the train is absent from the interior of the locomotive cab.

34. The monitoring system of claim 33, wherein the at least one alert device comprises at least one of the following:

a display screen, a speaker, a vibration motor, an indicator light, or any combination thereof.

35. The monitoring system of claim 33, wherein the at least one alert device substantially continuously communicates the notification or message within the locomotive cab that the at least one unauthorized display device has been detected or that the at least one operator of the train is absent from the interior of the locomotive cab until the at least one processor determines that the at least one unauthorized display device is no longer detected or that the at least one operator of the train is present in the interior of the locomotive cab.

36. The monitoring system of claim 29, further comprising at least one communication device located on or associated with the train and configured to communicate, to a remote back office system or monitoring station, a notification or message that the at least one unauthorized display device was detected or that the at least one operator of the train is absent from the interior of the locomotive cab.

37. The monitoring system of claim 36, wherein the remote back office system or monitoring station comprises at least one processor programmed or configured to, in response to receiving the notification or message that the at least one unauthorized display device was detected or that the at least one operator of the train is absent from the interior of the locomotive cab, implement or cause to be implemented at least one of the following:

cause the train to alter an aspect or parameter of its operation, notify the operator in the locomotive cab that the at least one unauthorized display device was detected, communicate a notification or message within the locomotive cab that the at least one operator of the train is absent from the interior of the locomotive cab, record event data corresponding to detecting the at least one unauthorized display device, or any combination thereof.

38. The monitoring system of claim 36, wherein the at least one processor of the remote back office system or monitoring station is further programmed or configured to:

cause the train to stop responding to the operator'"'"'s control; and

return control to the operator in response to the remote back office system or monitoring station receiving the notification or message that the at least one unauthorized display device is no longer detected or that the at least one operator is present.

39. The monitoring system of claim 29, further comprising a database, associated with the train or a remote back office system or monitoring station, configured to store data representative of unauthorized display device detection events or unoccupied locomotive cab detection events, the data comprising at least one of the following:

time data, train identification data, operator identification data, or any combination thereof.

40. The monitoring system of claim 39, wherein the data further comprises at least a portion of the operational image data received from the at least one imaging device from a time period during which the at least one unauthorized display device or the absence of the at least one operator was detected.

41. The monitoring system of claim 29, wherein the at least one processor comprises an on-board computer positioned on the train.