RC/Autonomous Machine Mode Indication

• US 20140214187A1
• Filed: 01/31/2013
• Published: 07/31/2014
• Est. Priority Date: 01/31/2013
• Status: Abandoned Application

• Current Assignee: Caterpillar Incorporated
• Original Assignee: Caterpillar Incorporated
• Inventors: Funke, Brian G., Redenbo, Seth J.
• Application Number:
  US13/755,810
• Publication Number:
  US 20140214187A1
• Time in Patent Office: Days
• US Class Current: 700/83
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera

Abstract

A method and system for displaying machine mode information to a remote operator of a plurality of machines includes collecting video data from each of the machines, collecting machine sensor information from each of the machines, collecting machine alert information with respect to each of the machines, and collecting machine operating mode data with respect to each of the machines. A machine display is then provided at a remote control center including one or more screen regions corresponding to the video of one or more machines. The machine display further includes a machine mode and alert indicator including machine areas associated with each of the machines, wherein each machine area including a graphical mode indicator denoting an operating mode of the associated machine.

Claims

1. A method for displaying machine mode information to an operator at a remote control center with respect to a plurality of machines, the method comprising:

collecting video data from each of the plurality of machines, the video data for each machine showing at least a portion of an environment of the machine;

collecting machine sensor information from each of the plurality of machines;

generating machine alert information with respect to each of the plurality of machines;

collecting machine operating mode data indicative of an operating mode with respect to each of the plurality of machines; and

providing a machine display at the remote control center, the machine display including one or more screen regions, each of the one or more screen region displaying video data collected from an associated one of the plurality of machines, the machine display further including a machine mode and alert indicator including a plurality of machine areas, each machine area being associated with one of the plurality of machines, and each machine area including a graphical mode indicator visually denoting the operating mode of the associated machine.

2. The method for displaying machine mode information to an operator at a remote control center according to claim 1, wherein the one or more screen regions display video data collected from a single one of the plurality of machines, and wherein the operator is able to toggle the one or more screen regions to display video from any one of the plurality of machines.

3. The method for displaying machine mode information to an operator at a remote control center according to claim 1, wherein the operating modes include one or more of an autonomous mode wherein the machine operates autonomously, a remote control mode wherein the machine operates by remote control, an autonomous paused mode wherein the machine is paused and its most recent operating mode was the autonomous mode, and a remote control paused mode wherein the machine is paused and its most recent operating mode was the remote control mode.

4. The method for displaying machine mode information to an operator at a remote control center according to claim 1, wherein at least one graphical mode indicator is selectable to alter the operating mode of the associated machine.

5. The method for displaying machine mode information to an operator at a remote control center according to claim 1, wherein at least a subset of the machine areas further contain a graphical health level indicator identifying a health level of the associated machine.

6. The method for displaying machine mode information to an operator at a remote control center according to claim 5, wherein the appearance of each health level indicator is determined based on the health level of the associated machine.

7. The method for displaying machine mode information to an operator at a remote control center according to claim 6, wherein each health level indicator is rendered in a color and wherein the color is determined based on the health level of the associated machine.

8. The method for displaying machine mode information to an operator at a remote control center according to claim 6, wherein at least one of the health level indicators is dynamically varied based on the health level of the associated machine.

9. The method for displaying machine mode information to an operator at a remote control center according to claim 5, wherein at least one of the health level indicators is associated with the emission of an operator-audible tone.

10. The method for displaying machine mode information to an operator at a remote control center according to claim 1, wherein each machine area further includes a graphical wireless link indicator visually indicative of a status of a wireless link between the associated machine and the remote control center.

11. A method for displaying machine mode information to an operator at a remote control station for a plurality of machines, the method comprising:

displaying video data gathered from at least one of the plurality of machines to the operator via a video display screen, the video data showing at least a portion of an environment of the associated machine; and

displaying a machine mode and alert indicator to the remote operator, the machine mode and alert indicator including a plurality of machine areas, each machine area being associated with one of the plurality of machines, and each machine area including a graphical mode indicator visually denoting an operating mode of the associated machine.

12. The method for displaying machine mode information to an operator at a remote control station according to claim 11, wherein the operating modes include one or more of an autonomous mode wherein the machine operates autonomously, a remote control mode wherein the machine operates by remote control, an autonomous paused mode wherein the machine is paused and its most recent operating mode was the autonomous mode, and a remote control paused mode wherein the machine is paused and its most recent operating mode was the remote control mode.

13. The method for displaying machine mode information to an operator at a remote control station according to claim 11, wherein at least one of the graphical mode indicators is selectable to alter the operating mode of the associated machine.

14. The method for displaying machine mode information to an operator at a remote control station according to claim 11, wherein at least a subset of the machine areas further contain a graphical health level indicator identifying a health level of the associated machine.

15. The method for displaying machine mode information to an operator at a remote control station according to claim 14, wherein the appearance of each health level indicator is determined based on the health level of the associated machine.

16. The method for displaying machine mode information to an operator at a remote control station according to claim 15, wherein at least one of the health level indicators is associated with the emission of an operator-audible tone.

17. The method for displaying machine mode information to an operator at a remote control station according to claim 11, wherein each machine area further includes a graphical wireless link indicator visually indicative of a status of a wireless link between the associated machine and the remote control center.

18. The method for displaying machine mode information to an operator at a remote control station according to claim 11, wherein displayed video data includes, at any time, only video data collected from a single one of the plurality of machines, and wherein displaying video data gathered from at least one of the plurality of machines further comprises presenting to the operator an option to toggle the displayed video data to correspond to video from an alternative one of the plurality of machines.

20. The system for displaying an operating mode associated with each of a plurality of machines according to claim 18, wherein each operating mode is selected from the group consisting of an autonomous mode wherein the machine operates autonomously, a remote control mode wherein the machine operates by remote control, an autonomous paused mode wherein the machine is paused and its most recent operating mode was the autonomous mode, and a remote control paused mode wherein the machine is paused and its most recent operating mode was the remote control mode.

19. A system for displaying an operating mode for each of a plurality of machines to an operator situated at a remote control center that is located remotely from the plurality of machines, the system comprising:

a wireless link at the remote control center configured to wirelessly gather data from each of the plurality of machines; and

a processor at the remote control center configured to generate the operating mode for each of the plurality of machines based on the gathered data and to generate a display comprising a machine mode and alert indicator having a plurality of adjacent machine areas, each machine area being associated with one of the plurality of machines, and each machine area including a graphical mode indicator visually denoting the operating mode of the associated machine.