Method for assisting an automated video tracking system in reaquiring a target

• US 7,173,650 B2
• Filed: 03/28/2001
• Issued: 02/06/2007
• Est. Priority Date: 03/28/2001
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Trajkovic, Miroslav, Cohen-Solal, Eric, Lyons, Damian M
• Primary Examiner(s): PHILIPPE, GIMS S
• Application Number:
  US09/819,971
• Publication Number:
  US 20020140814A1
• Time in Patent Office: 2,141 Days
• Field of Search: 348135-137, 348139-142, 348143-144, 348151-159, 348/161, 348/172, 348/150, 386/123, 700/237, 700/231
• US Class Current: 348/172
• CPC Class Codes: G01S 3/785 using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system
• CPC Class Codes: G01S 3/7865 using correlation of the live video image with a stored image

Abstract

A method for reacquiring a target in an automated video tracking system is provided. The method includes the steps of: selecting a desired target to be tracked; switching the automated video tracking system to an automatic mode to initiate a tracking sequence to automatically track the selected desired target; switching the automated video tracking system from an automatic mode to a manual mode if the automated video tracking system encounters a period of difficulty in tracking the desired target; reacquiring the desired target in manual mode; and switching the automated video tracking system to the automatic mode for automatic tracking of the reacquired desired target without initiating a new tracking sequence. An apparatus and automated video tracking system for carrying out the methods of the present invention are also provided.

Claims

1. A method for reacquiring a target in an automated video tracking system, the method comprising the steps of:

(a) selecting a desired target to be tracked;

(b) constructing a computer model of the selected target;

(c) switching the automated video tracking system to an automatic track mode to initiate a tracking sequence to automatically track the selected desired target based on correlation between a video image of the selected, tracked target and the previously constructed computer model;

(d) during said automatic track mode, the automated video tracking system calculating a confidence value indicating a degree of correlation between the tracked video image of the target and the previously constructed computer model of said tracked target;

(e) during said automatic track mode, the automated video tracking system providing a warning to a user indicating that said automatic track mode is about to fail whenever said calculated confidence value falls below a pre-determined threshold confidence value;

(f) if the automated video tracking system encounters a period of difficulty in tracking the tracked selected desired target, manually guiding tracking the selected target until the selected target is reacquired and said period of difficulty has passed; and

(g) switching the automated video tracking system to the automatic mode for automatic tracking of the reaquired selected desired target based on the previously constructed computer model without constructing a new computer model.

2. The method of claim 1, wherein step (a) comprises centering the desired target in a display of a scene including the desired target.

3. The method of claim 1, wherein step (c) comprises releasing control of an input device used to select the desired target.

4. The method of claim 1, wherein step (d) comprises controlling an input device used to select the desired target.

5. The method of claim 1, wherein step (e) comprises centering the desired target in a display of a scene including the desired target.

6. The method of claim 1, wherein step (f) comprises releasing control of an input device to indicate that the desired target has been reacquired and to recommence automatic tracking based on the previously built computer model.

7. An apparatus for reacquiring a target in an automated video tracking system, the apparatus comprising:

selecting means for selecting a desired target to be tracked and causing a computer model of the selected target to be built;

mode switching means for switching the automated video tracking system between an automatic mode to automatically track the selected desired target based on a correlation between the video image of the tracked target and the previously built computer model and a manual mode;

calculation means for calculating a confidence value indicating a degree of correlation between the video image of the tracked target and the previously built computer model of said tracked target;

warning means for providing a warning to a user indicating that said calculated confidence value has fallen below a pre-determined threshold confidence value to prompt a user to enter the manual mode and manually track the selected target until the selected target has been reacquired with above the predetermined threshold confidence value;

the selected target has been manually reacquired, recommencing tracking in the automatic mode based on the correlation between the tracked video image and the previously built computer model without constructing a new video model.

8. The apparatus of claim 7, wherein the selecting means comprises an input device for centering the selected desired target in a display of a scene including the selected desired target.

9. The apparatus of claim 8, further comprising:

a video camera for capturing video image data of a scene including the video image of the tracked target;

pan and tilt camera motors for controlling a pan and tilt, respectively of the video camera; and

a video display for displaying the video image data;

wherein the input device is a joystick operatively connected to the pan and tilt motors such that movement of the joystick controls the movement of the camera through the pan and tilt motors in the manual mode.

10. An apparatus for reacquiring a target in an automated video tracking system, the apparatus comprising:

selecting means for selecting a desired target to be tracked;

mode selecting means for switching the automated video tracking system to and from one of an automatic mode to initiate a tracking sequence after target selection to automatically track the selected desired target and a manual mode, the mode selecting means including;

an input device where the automated video tracking system is switched to automatic mode by controlling an input device used to select the desired target and the automated video tracking system is switched to manual mode by releasing control of the input device;

calculation means for calculating a confidence value indicating a degree of correlation between the video image of the tracked target and a previously constricted computer model of said tracked target;

warning means for providing a warning to a user indicating that said automatic track mode is about to fail whenever said calculated confidence value falls below a pre-determined threshold confidence value;

reacquiring means for reacquiring the desired target in manual mode in response to and during the automated video tracking system encountering a period of difficulty in tracking the desired target;

wherein after reacquiring the desired target the automated video tracking system is switched back to automatic mode without initiating a new tracking sequence.

11. The apparatus of claim 10, further comprising:

a video camera for capturing video image data of a scene including the desired target;

pan and tilt camera motors for controlling a pan and tilt, respectively of the video camera; and

a video display for displaying the video image data;

wherein the input device is a joystick operatively connected to the pan and tilt motors such that movement of the joystick controls the movement of the camera trough the pan and tilt motors.

12. The apparatus of claim 10, wherein the input device for manually centering the selected tracked target in a video display of a scene including the video image of the tracked target.

13. The apparatus of claim 12, further comprising:

a video camera for capturing video image data of a scene including the video image of the tracked target;

pan and tilt camera motors for controlling a pan and tilt, respectively of the video camera; and

a video display for displaying the captured video scene;

wherein the input device includes a joystick operatively connected to the pan and tilt motors in the manual mode such that movement of the joystick manually controls the movement of the camera through the pan and tilt motors.

14. An automated video tracking system for backing and reacquiring a target, the automated video tracking system comprising:

a video camera for capturing video image data of a scene including a desired target;

pan and tilt camera motors for controlling a pan and tilt respectively, of the video camera;

a video display for displaying the video image data selecting means for selecting the desired target to be tracked;

mode switching means for switching the automated video tracking system to and from one of an automatic mode to initiate a tracking sequence after target selection to automatically track the selected desired target and a manual mode;

calculation means for calculating a confidence value indicating a degree of correlation between the video images of the tracked target and a previously constructed computer model of said tracked target;

warning means for providing a warning to a user indicating that said automatic track mode is about to fail whenever said calculated confidence value falls below a pre-determined threshold confidence value;

reacquiring means for reacquiring the desired target in manual mode in response to and during the automated video tracking system encountering a period of difficulty in tracking the desired target;

wherein after reacquiring the desired target the automated video tracking system is switched back to automatic mode without initiating a new tracking sequence.

15. The automated video tracking system of claim 14, wherein the selecting means comprises an input device for centering the desired target in the display.

16. The automated video tracking system of claim 15, wherein the input device is a joystick operatively connected to the pan and tilt motors such that movement of the joystick controls the movement of the camera through the pan and tilt motors.

17. The apparatus of claim 14 wherein the selecting means and the reacquiring means includes:

an input device through which a user (a) manually controls the pan and tile motors, (b) designates the desired target to be tracked and causes a computer model of the selected target to be constructed, (c) manually controls the pan and tilt motors when the confidence value falls below the predetermined confidence value, and (d) causes the automated tracking system to switch back to the automatic mode to recommence tracking based on the previously constructed computer model.

18. The automated video tracking system of claim 17, wherein the input device includes the selecting switch through which the automated video tracking system is switched to automatic mode and manual mode.

19. The automated video tracking system of claim 18, wherein the input device is a joystick operatively connected to the pan and tilt motors such that movement of the joystick controls the movement of the camera through the pan and tilt motors.

20. The automated video tracking system of claim 17, wherein the input device centers the desired target in the display of the scene to select the target to be tracked.

21. The automated video tracking system of claim 20, wherein

the input device is a joystick operatively connected to the pan and tilt motors such that movement of the joystick controls the movement of the camera through the pan and tilt motors.