SYSTEM AND METHOD FOR COMMUNICATING WITH AN OPERATOR OF THE SYSTEM

• US 20170178485A1
• Filed: 03/02/2016
• Published: 06/22/2017
• Est. Priority Date: 12/18/2015
• Status: Active Grant

• Current Assignee: GE Global Sourcing LLC (Westinghouse Air Brake Technologies Corporation)
• Original Assignee: General Electric Company
• Inventors: Tan, Huan, Al Assad, Omar, Patrick, Romano, Holovashchenko, Viktor, Theurer, Charles Burton, Kannan, Balajee, Gefen, Yonatan, Forman, Douglas, Lizzi, John Michael
• Granted Patent: US 9,799,198 B2
• Time in Patent Office: Days
• CPC Class Codes: B25J 9/1602 characterised by the control system, structure, architecture
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 19/048 Monitoring; Safety
• CPC Class Codes: G05B 2219/14006 Safety, monitoring in general
• CPC Class Codes: G05B 2219/23227 Environment conditions affect execution of program
• CPC Class Codes: G05B 2219/40099 Graphical user interface for robotics, visual robot user interface
• CPC Class Codes: G05B 2219/40414 Man robot interface, exchange of information between operator and robot
• CPC Class Codes: G08B 21/18 Status alarms G08B21/02 takes precedence
• CPC Class Codes: G08B 7/06 using electric transmission , e.g. involving audible and visible signalling through the use of sound and light sources

Abstract

Method includes executing a dynamic decision-making process that includes (a) receiving environmental data and (b) determining a fused ensemble based on the environmental data and a state parameters of a current state of a machine assembly. The fused ensemble includes communications from a system interface to the operator for the state parameters. The communications inform an operator about the state parameters and includes at least one of a visual signal, an audible signal, or a tactile signal from the system interface. The decision-making process also includes (c) communicating the fused ensemble to the operator through the system interface and (d) repeating (a)-(c) while the machine assembly is in the current state. The fused ensemble is configured to change based on changes in the environmental data.

Claims

1. A method comprising:

determining a designated task to perform using a machine assembly of a control system, the control system including a system interface for communicating with an operator;

receiving a current state of the machine assembly while the designated task is being performed by the machine assembly, the current state being associated with plural pre-defined state parameters;

executing a dynamic decision-making process comprising;

(a) receiving environmental data;

(b) determining a fused ensemble based on the environmental data and the state parameters of the current state, the fused ensemble including communications for the state parameters from the system interface to the operator, the communications informing the operator about the state parameters and including at least one of a visual signal, an audible signal, or a tactile signal from the system interface;

(c) communicating the fused ensemble to the operator through the system interface;

(d) repeating (a)-(c) while the machine assembly is in the current state, the fused ensemble configured to change based on changes in the environmental data.

2. The method of claim 1, wherein the fused ensemble changes by modifying a degree of at least one of the communications, replacing at least one of the communications with a different communication, or adding a communication to the fused ensemble that redundantly informs the operator about one of the state parameters.

3. The method of claim 1, wherein the fused ensemble changes by at least one of:

(1) changing a frequency at which a series of audible signals is communicated to the operator;

(2) changing a volume of an audible signal;

(3) replacing an audible signal with at least a visual signal;

(4) replacing a visual signal with at least an audible signal;

(5) changing an amount of illuminance from a light source;

(6) changing a frequency at which a series of flashes is visually communicated to the operator;

(7) changing a color of light that is visually communicated to the operator;

or (8) communicating another type of signal to the operator in addition to the original signal for a state parameter.

4. The method of claim 1, wherein determining the fused ensemble includes re-prioritizing the state parameters based on the environmental data.

5. The method of claim 1, wherein at least some of the state parameters are assigned weights that are based on the environmental data, the state parameters being assigned new weights when the environmental data changes, wherein a subsequent determining the fused ensemble is based on the new weights.

6. The method of claim 1, wherein determining the fused ensemble may be superseded by a pre-defined urgent interaction based on the environmental data.

7. The method of claim 6, wherein the pre-defined urgent interaction includes warning the operator of possible danger to the operator or the machine assembly.

8. The method of claim 6, wherein the machine assembly automatically pauses or aborts the designated task in response to the pre-defined urgent interaction.

9. The method of claim 1, wherein the system interface includes at least two of a user display, a light source, or an audio-generating instrument.

10. The method of claim 1, further comprising, after determining the designated task, planning plural sub-operations to perform the designated task, wherein the machine assembly is in the current state for at least one of the sub-operations.

11. The method of claim 1, further comprising receiving a new current state of the machine assembly and repeating the dynamic decision-making process with the new current state, the new current state having a different grouping of state parameters.

12. The method of claim 1, wherein the method is performed in a rail yard.

13. The method of claim 1, wherein the designated task is a brake-bleeding task.

14. The method of claim 1, wherein at least one of the state parameters is communicated to the operator with multiple different communications.

15. A system comprising:

a machine assembly;

a control system configured to control the machine assembly to perform a designated task, the control system including a system interface for communicating with an operator, wherein the control system includes one or more processors that are configured to;

receive a current state of the machine assembly while the designated task is being performed by the machine assembly, the current state being associated with plural pre-defined state parameters;

execute a dynamic decision-making process comprising;

(a) receiving environmental data;

(b) determining a fused ensemble based on the environmental data and the state parameters of the current state, the fused ensemble including communications for the state parameters from the system interface to the operator, the communications informing the operator about the state parameters and including at least one of a visual signal, an audible signal, or a tactile signal from the system interface;

(c) communicating the fused ensemble to the operator through the system interface;

(d) repeating (a)-(c) while the machine assembly is in the current state, the fused ensemble configured to change based on changes in the environmental data.

16. The system of claim 15, wherein the fused ensemble is changed by modifying a degree of at least one of the communications, replacing at least one of the communications with a different communication, or adding a communication to the fused ensemble that redundantly informs the operator about one of the state parameters.

17. The system of claim 15, wherein the fused ensemble changes by at least one of:

(1) changing a frequency at which a series of audible signals is communicated to the operator;

(2) changing a volume of an audible signal;

(3) replacing an audible signal with at least a visual signal;

(4) replacing a visual signal with at least an audible signal;

(5) changing an amount of illuminance from a light source;

(6) changing a frequency at which a series of flashes is visually communicated to the operator;

(7) changing a color of light that is visually communicated to the operator;

or (8) communicating another type of signal to the operator in addition to the original signal for a state parameter.

18. The system of claim 15, wherein determining the fused ensemble includes re-prioritizing the state parameters based on the environmental data.

19. The system of claim 15, wherein at least some of the state parameters are assigned weights that are based on the environmental data, the state parameters being assigned new weights when the environmental data changes, wherein a subsequent determining the fused ensemble is based on the new weights.

20. A method comprising:

determining a designated task to perform using a machine assembly of a control system, the control system including a system interface for communicating with an operator;

receiving a current state of the machine assembly while the designated task is being performed by the machine assembly, the current state being associated with plural pre-defined state parameters;

determining a fused ensemble based on the environmental data and the state parameters of the current state, the fused ensemble including a communication from the system interface to the operator for the state parameters, the communications informing the operator about the state parameters and including at least one of a visual signal, an audible signal, or a tactile signal from the system interface, wherein the fused ensemble includes at least two types of signals.