REAL TIME VIDEO FEED CONFIGURATION FOR REMOTE VISION

• US 20140300826A1
• Filed: 04/04/2013
• Published: 10/09/2014
• Est. Priority Date: 04/04/2013
• Status: Abandoned Application

• Current Assignee: Caterpillar Incorporated
• Original Assignee: Caterpillar Incorporated
• Inventors: Funke, Brian, Redenbo, Seth, Dunn, Daniel, Smallenberger, Jason L.
• Application Number:
  US13/856,800
• Publication Number:
  US 20140300826A1
• Time in Patent Office: Days
• US Class Current: 348/734
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method and system for providing remote vision to a remote operator with respect to one or more machines includes a remote vision system and a wireless transmitter/receiver for communicating with each of the one or more machines. One or more video feeds are available from each machine upon demand. A controller console linked to the remote vision system receives machine data from each of the one or more machines and selects one or more video feeds for display based on the received machine data. The controller console also specifies a resolution for each selected video feed based on the received machine data, such that the transmission of the selected video feeds does not exceed the available bandwidth. The controller console may modify the video selection or resolution specification during operation of the one or more machines based on additional received machine data.

Claims

1. A system for providing remote vision to a remote operator with respect to one or more machines, the system comprising:

a remote vision system including one or more display screens;

a wireless transmitter/receiver for communicating with each of the one or more machines, wherein the wireless transmitter/receiver is adapted to receive one or more video feeds from each machine upon demand via a wireless channel having an available bandwidth;

a controller console linked to the remote vision system and configured to receive machine data from each of the one or more machines and select one or more video feeds from at least one of the one or more machines for display on the one or more display screens based on the received machine data, and to specify a resolution for each selected video feed based on the received machine data, such that the transmission of the selected video feeds at the specified resolution requires a first bandwidth that does not exceed the available bandwidth, the controller console being further configured to modify the video selection or resolution specification during operation of the one or more machines based on additional received machine data.

2. The system in accordance with claim 1, wherein the machine data includes a machine location for each of the one or more machines.

3. The system in accordance with claim 2, wherein the controller console is further configured to select the one or more video feeds and specify the resolution for each selected video feed by identifying one or more particular machines that are within a predetermined distance of another machine and enhancing the resolution of any selected video feeds associated with the one or more particular machines.

4. The system in accordance with claim 2, wherein the controller console is further configured to select the one or more video feeds and specify the resolution for each selected video feed by identifying one or more particular machines that are within a predetermined distance of a known obstacle and enhancing the resolution of any selected video feeds associated with the one or more particular machines.

5. The system in accordance with claim 2, wherein the controller console is further configured to select the one or more video feeds and specify the resolution for each selected video feed by identifying one or more particular machines that are within a predetermined priority zone and enhancing the resolution of any selected video feeds associated with the one or more particular machines.

6. The system in accordance with claim 5, wherein the predetermined priority zone includes at least one of a crest region and a slot end region.

7. The system in accordance with claim 1, wherein the machine data includes a machine operation and cycle data for each of the one or more machines.

8. The system in accordance with claim 7, wherein the operation and cycle data includes an identification that one or more particular machines are in a high priority position in a cycle and wherein the controller console is further configured to select the one or more video feeds and specify the resolution for each selected video feed by enhancing the resolution of any selected video feeds associated with the one or more particular machines.

9. The system in accordance with claim 7, wherein the operation and cycle data includes an identification of one or more implement positions and implement pressures associated with each machine, and wherein the controller console is further configured to identify one or more particular machines as high priority based on the implement positions and implement pressures associated with the particular machines, and wherein the controller console is further configured to enhance the resolution of video feeds associated with the one or more particular machines.

10. The system in accordance with claim 7, wherein the operation and cycle data includes an identification of a machine load associated with each machine, and wherein the controller console is further configured to identify one or more particular machines as high priority based on the machine loads associated with the particular machines, and wherein the controller console is further configured to enhance the resolution of video feeds associated with the one or more particular machines.

11. The system in accordance with claim 1, wherein the machine data includes an indication of machine speed and direction for each of the one or more machines.

12. The system in accordance with claim 11, wherein the controller console is further configured to associate identify one or more particular machines as high priority based on the machine speed and direction associated with the particular machines, and wherein the controller console is further configured to enhance the resolution of video feeds associated with the one or more particular machines.

13. A method of providing remote vision to an operator of a plurality of machines, the method comprising:

receiving machine data from each of the plurality of machines at an operator center via a wireless link between the operator center and the plurality of machines;

at a computing device associated with the operator center, automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data;

at the computing device associated with the operator center, selecting video feeds to receive at the operator center from each machine and specifying a resolution of each selected video feed based on the prioritization; and

transmitting instructions to each machine from the operator center via the wireless link instructing each machine to transmit, at the specified resolution, the selected video feeds associated with that machine.

14. The method of providing remote vision in accordance with claim 13, wherein the received machine data includes a machine location for each of the plurality of machines, and wherein automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data includes automatically identifying one or more particular machines that are within a predetermined distance of another machine as having a high priority.

15. The method of providing remote vision in accordance with claim 13, wherein the received machine data includes a machine location for each of the plurality of machines, and wherein automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data includes automatically identifying one or more particular machines that are within a predetermined distance of a known obstacle as having a high priority.

16. The method of providing remote vision in accordance with claim 13, wherein the received machine data includes a machine location for each of the plurality of machines, and wherein automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data includes automatically identifying one or more particular machines that are within a predetermined priority zone.

17. The method of providing remote vision in accordance with claim 13, wherein the received machine data includes an identification of one or more implement positions and implement pressures associated with each machine, and wherein automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data includes automatically identifying the video feeds of one or more particular machines as high priority based on their implement positions and implement pressures.

18. The method of providing remote vision in accordance with claim 13, wherein the received machine data includes an identification of a machine load associated with each machine, and wherein automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data includes automatically identifying the video feeds of one or more particular machines as high priority based on their respective machine loads.

19. The method of providing remote vision in accordance with claim 13, wherein the received machine data includes an indication of machine speed and direction for each of the one or more machines, and wherein automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data includes automatically identifying the video feeds of one or more particular machines as high priority based on their respective machine speeds and directions.

20. A non-transitory computer readable medium having thereon computer-executable instructions for providing remote vision to an operator of a plurality of machines, the computer-executable instructions comprising:

instructions for receiving machine data from each of the plurality of machines at an operator center via a wireless link between the operator center and the plurality of machines;

instructions for automatically prioritizing video feeds available from each of the plurality of machines based on the received machine data;

instructions for selecting video feeds to receive at the operator center from each machine and for specifying a resolution of each selected video feed based on the prioritization; and

instructions for commanding each machine to transmit, at the specified resolution, the selected video feeds associated with that machine.