Method and a Device For Remotely Controlling an On-Board Camera in a Mobile Station

• US 20110211084A1
• Filed: 08/18/2009
• Published: 09/01/2011
• Est. Priority Date: 08/20/2008
• Status: Abandoned Application

• Current Assignee: EADS Secure Networks
• Original Assignee: Eads France, EADS Secure Networks
• Inventors: Sturzel, Marc
• Application Number:
  US13/058,837
• Publication Number:
  US 20110211084A1
• Time in Patent Office: Days
• US Class Current: 348/211.99
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

The invention is in the field of remote control of a device on board a mobile vehicle and concerns more specifically a method and a device for controlling, from a remote station, a camera on board a mobile station.

According to the invention,

• the remote station estimates the period of latency L between the despatch of a command from the mobile station and the execution of the said command by the said mobile station,
• the mobile station transmits to the remote station a first image acquired by the said camera at an instant T-L,
• the remote station transmits to the mobile station a position of the target object in the said first image,
• the mobile station compares the position of the target object in the first image with the position of the said object in at least a second image acquired after the said first image, and determines in real time, independently, the trajectory of a target object in the said second image, and then controls the on-board camera in real time to accomplish the tracking of the target object in the predicted trajectory.

Claims

1. A method for controlling, from a remote station, a camera on board a mobile station transmitting to the remote station images including at least one target object to be located in a zone explored by the camera, the method comprising:

estimating, with the remote station, a period of latency L between the despatch of a command from the mobile station and the execution of the said command by the mobile station;

transmitting, with the mobile station, a first image acquired by the camera at an instant T-L to the remote station,;

transmitting, with the remote station, a position of the target object in the said-first image to the mobile station; and

comparing, with the mobile station, the position of the target object in the first image with the position of the target object in at least a second image acquired after the first image, wherein if the compared positions are identical in the two images realigned in relation to one another the mobile station transmits the position to the remote station for validation,

and wherein if the compared positions are not identical in the two images, the mobile station determines, in real time, independently, a predicted trajectory of the target object in the second image, and controls the on-board camera in real time in order to track the target object over the predicted trajectory.

2. A method according to claim 1, in which the trajectory of the target object in the second image is determined by a predictive computation according to a position and movement vector of the target object at an instant T-L.

3. A method according to claim 2, characterised in that it also includes the further comprising:

in the remote station;

realigning the first image and the second image;

determining the position and speed vector of all objects moving in the scene observed by the camera;

determining the position and speed vector of the target object in the first image, either among the moving objects, or among background elements;

calculating a prediction of the position and speed of the target object at instant T+L;

transmitting a designated position, the predicted position and the predicted speed vector of the target object to the mobile station.

4. A method according to claim 3, further comprising readjustment of the first image and of the second image by estimation of the a transient homography.

5. A method according to claim 4, further comprising recording the transient homographies, image by image, and an overall position of the mobile objects from instant T-L to instant T+L in the mobile station.

6. A method according to claim 1, in which the latency time L is estimated by time-stamping of data and by synchronization of the said-remote and mobile stations.

7. A method according to claim 1, in which the target object is fixed or mobile.

8. A method according to claim 7, in which if the target object is mobile and if its trajectory leaves the field of view of the camera'"'"'s field of view at an instant t between T-L and T+L, the position of the said-target object is estimated in the mobile station by a predictive calculation according to its position and its speed vector at instant t.

9. A method according to claim 1, in which the camera is on board a drone.

10. A method according to claim 1, in which the target object is an individual, a vehicle, or an aircraft.

13. A method according to claim 2, in which the camera is on board a drone.

14. A method according to claim 3, in which the camera is on board a drone.

15. A method according to claim 4, in which the camera is on board a drone.

16. A method according to claim 5, in which the camera is on board a drone.

17. A method according to claim 6, in which the camera is on board a drone.

18. A method according to claim 7, in which the camera is on board a drone.

19. A method according to claim 8, in which the camera is on board a drone.

11. A device for controlling, from a remote station, a camera on board a mobile station transmitting to the remote station images including at least one target object to be located in a zone explored by the camera, the device comprising:

means for estimating the period of latency L between the despatch of a command from the mobile station, and the execution of the command by the said mobile station;

wherein the mobile station comprises;

means for comparing a position of the target object in a first image acquired by the camera at an instant T-L with the position of the object in at least a second image acquired after the first image,

means for predictive calculation, wherein the means for predictive calculation is configured to determine, in real time, a predicted trajectory of the target object in the second image,

means for controlling, in real time, the on-board camera to the target object in the predicted trajectory.

12. A computer program product recorded on a non-transitory recording medium and including instructions to control, when it is executed on a computer, a camera on board a mobile station from a remote station, where the mobile station transmits to the remote station images including at least one target object to be located in a zone explored by the camera,

the computer program product comprising:

a first executable module in the remote station comprising;

computer-readable instructions causing the first executable module to estimate the period of latency L between the despatch of a command from the mobile station and the execution of the command by the mobile station,

computer-readable instructions causing the first executable module to determine the movement from one image to another of the fixed objects and of the mobile objects in order to facilitate the designation of the target object,

a second executable module in the mobile station including;

computer-readable instructions causing the second executable module to compare a position of the target object in a first image acquired by the camera at an instant T-L with the position of the object in at least a second image acquired after the first image,

computer-readable instructions causing the second executable module to determine in real time a predicted trajectory of the target object in the second image, and

computer-readable instructions causing the second executable module to control, in real time, the on-board camera to track the target object in the predicted trajectory.