Human engineered remote driving system

• US 4,855,822 A
• Filed: 01/26/1988
• Issued: 08/08/1989
• Est. Priority Date: 01/26/1988
• Status: Expired due to Fees

• Current Assignee: Honeywell Incorporated (Honeywell International Inc.)
• Original Assignee: Honeywell Incorporated (Honeywell International Inc.)
• Inventors: Graf, Carl P., Fant, Karl M., Narendra, Patrenahalli M.
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/148,531
• Time in Patent Office: 560 Days
• Field of Search: 358/103, 358/105, 358/136, 340/728, 364/424, 901/1, 901/46, 901/47
• US Class Current: 348/114
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: H04N 7/122 involving expansion and subsequent compression of a signal segment, e.g. a frame, a line
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

Methods and apparatus are provided for driving a vehicle from a remote control station achieving tele-operation of the vehicle. A television sensor mounted on the vehicle provides video image information which is reduced in bandwidth by a factor of approximately 1000:1 for transmission by narrow band RF data link to a remote control station. The large bandwidth reduction is accomplished by first sampling the video output of the sensor at a reduced frame rate and then compressing the data further by standard data compression techniques. Vehicle position and attitude data which may be derived from the vehicle'"'"'s on board inertial reference unit are also transmitted via narrow band data link to the control station. At the control station, the data is first reconstructed by a technique which is the complement of the compression technique, and the instantaneous position and attitude data are used to compute transform coefficients that are used by a pipeline processor to extrapolate the frame data to generate a real time video display that enables an operator to drive the vehicle by transmitting appropriate control signals to the vehicle.

Claims

1. A system for driving from a remote control station a vehicle comprising:

a sensor on the vehicle for providing snapshot images from the vehicle of an environment in which the vehicle is operating;

motion detecting means on the vehicle for providing information describing the motion of the vehicle;

transmitting means on the vehicle for transmitting the snapshot images and the information describing the motion of the vehicle to the remote control station; and

image generation means at the remote control station for combining the snapshot images and the information describing the motion of the vehicle into a display that can be utilized for driving the vehicle from the remote control station.

2. The system as recited in claim 1 wherein the motion detecting means includes an inertial reference unit supplying vehicle position and attitude data.

3. The system as recited in claim 2 wherein the sensor is a television camera mounted on the vehicle further comprising a pan and tilt mechanism on which the camera is mounted, the pan and tilt mechanism being referenced to said inertial reference unit for providing instantaneous position and attitude data.

4. The system recited in claim 1 wherein the transmitting means includes a narrow band communications link.

5. The system as recited in claim 4 wherein the sensor includes a television camera providing a video output.

6. The system as recited in claim 5 wherein the transmitting means includes data compression means for compressing the video output for transmission by the narrow band communication link.

7. The system as recited in claim 6 wherein the data compression means includes sampling means for sampling the video output to provide frame-by-frame images for transmission.

8. The system as recited in claim 7 wherein the data compression means includes means for compressing the video data in the frame images.

9. A system for driving a vehicle from a remote control station comprising:

a television sensor on the vehicle for providing video images from the vehicle of an environment in which the vehicle is operating;

sampling means on the vehicle for sampling the video images at a reduced frame rate, thereby providing video image data at a reduced bandwidth;

data compression means on the vehicle for further reducing the bandwidth of the video image data;

inertial means on the vehicle for providing instantaneous vehicle position and attitude data at a low data rate for transmission to the control station;

a narrow band radio frequency data link for transmitting the reduced bandwidth video data and low data rate position and attitude data to the control station;

receiving means at the control station for receiving the reduced bandwidth video data and low data rate position and attitude data transmitted from the vehicle;

decompression means at the control station for reproducing the video images at the reduced frame rate;

memory means at the control station for temporarily storing the reproduced video images;

coefficient generation means at the control station for receiving the low data rate position and attitude data and computing the coefficients required to transform images in said memory means into real time video images;

image generation means responsive to said coefficients for transforming images in said memory means into real time video images; and

display means for displaying the real time video images to assist an operator in remotely controlling the vehicle.

10. A method for driving a vehicle from a remote control station comprising the steps of:

sensing images from the vehicle at a low frame rate to produce a series of snapshots of an environment in which the vehicle is operating;

determining the instantaneous position and attitude of the vehicle;

transmitting the snapshots and position and attitude to the remote control station;

temporarily storing the snapshots at the remote control station and extrapolating between snapshots based on the vehicle position and attitude to generate a continuous real time image of the vehicle environment; and

displaying the continuous real time image to assist an operator in controlling the vehicle.

11. A method for transmitting and receiving video data in a television format comprising the steps of:

sampling video data from a camera at a reduced frame rate;

sensing instantaneous position and attitude information of the camera;

using the instantaneous position and attitude information to extrapolate between sampled video data to generate real time video image data; and

displaying the generate real time video image data.