Method for the video-assisted remote control of machines, especially vehicles, and device for the implementation of this method

• US 6,304,290 B1
• Filed: 09/12/1995
• Issued: 10/16/2001
• Est. Priority Date: 09/27/1994
• Status: Expired due to Fees

• Current Assignee: Societe M5
• Original Assignee: Societe M5
• Inventors: Bailly, Michel
• Primary Examiner(s): Britton, Howard
• Application Number:
  US08/527,334
• Time in Patent Office: 2,226 Days
• Field of Search: H04/N.718, 348/148, 348/159, 348/153, 348/143, 348/144, 348/158, 348/150, 348/113, 348/114, 348/118, 348/119, 348/36, 348/38, 348/82, 348/83, 348/84, 348/564, 348/584, 348/588
• US Class Current: 348/119
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: H04N 5/2627 for providing spin image effect, 3D stop motion effect or temporal freeze effect 2D image animation in general G06T13/80
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

The video-assisted remote control device disclosed comprises a remote control station and a station on board the machine to be remote controlled. The latter comprises a real-time mixing unit, a video and audio transmitter and a remote control receiver. The control station comprises several monitors, a video and audio receiver and a remote control transmitter. Application to the remote control of public works machines.

Claims

1. A method for video-assisted remote control of a machine in order to enable real-time viewing of an environment of said machine wherein said machine includes a plurality of cameras and wherein a remote control station is positioned separate from said machine with communication between said remote control station and said machine being accomplished by one of wire links and radiowaves, said method comprising the steps of:

mixing, in said machine, video signals from at least two of said plurality of cameras to form a wide-field image encompassing a wider field of view than the field of view of any one of the plural cameras and outputting a resultant signal including said wide-field image;

transmitting said resultant signal from said machine to said remote control station on a single transmission channel;

viewing said resultant signal at said control station on at least one display device; and

transmitting remote control commands from said remote control station to said machine and to said plurality of cameras.

2. A method according to claim 1, wherein the mixing further includes overlaying at least one image from another one of the plural cameras onto the wide-field image provided from the at least two of said plurality of cameras.

3. A method according to claim 1, wherein the remote control commands for the cameras include commands for their orientation in elevation and/or in bearing.

4. A method according to claim 1, wherein the commands for the remote control of the cameras include commands to control their focal distance.

5. A device for video-assisted remote control of a machine to enable real-time viewing of an environment of said machine, said device comprising:

a remote control center including a transmitter of remote control data, a video and audio receiver and at least one video monitor; and

wherein said machine includes a video and audio transmitter, a remote control receiver, a plurality of video cameras and a video mixing device, and

wherein the transmitter on board the machine is connected to a GPS type localizing device.

6. A system for video-assisted remote control of a machine to enable real-time viewing of an environment of said machine, said system comprising:

a remote control center including a transmitter of remote control data, a video and audio receiver and at least one video monitor; and

wherein said machine includes a video and audio transmitter, a remote control receiver, a plurality of video cameras and a video mixing device configured to receive inputs from at least two of said plurality of cameras and to provide a wide-field image encompassing a wider field of view than the field of view of any one of the plural cameras as a resultant signal, said video mixing device being connected to said video and audio transmitter which is configured to transmit the resultant signal to the video and audio receiver which is connected to the at least one video monitor with a resulting display of the wide-field image.

8. A device according to claim 6, wherein at least one of the cameras comprise orientation control devices and/or focal distance control devices connected to the remote control receiver on board the machine.

9. A device according to claim 6, wherein the transmitter on board the machine is connected to at least one microphone.

7. A device for video-assisted remote control of a machine to enable real-time viewing of an environment of said machine, said device comprising:

a remote control center including a transmitter of remote control data, a video and audio receiver and at least one video monitor; and

wherein said machine includes a video and audio transmitter, a remote control receiver, a plurality of video cameras and a video mixing device, and

wherein said plurality of cameras and fragile electronic instruments on board the machine include devices for damping vibrations.