METHOD FOR TARGET GEO-REFERENCING USING VIDEO ANALYTICS

• US 20100092033A1
• Filed: 10/15/2008
• Published: 04/15/2010
• Est. Priority Date: 10/15/2008
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Miezianko, Roland, Krishnaswamy, Kailash, Susca, Sara
• Granted Patent: US 8,103,056 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: F41G 3/02 using an independent line of sight
• CPC Class Codes: F41G 3/06 with rangefinder rangefinders per se G01C

Abstract

A method to geo-reference a target between subsystems of a targeting system is provided. The method includes receiving a target image formed at a sender subsystem location, generating target descriptors for a first selected portion of the target image, sending target location information and the target descriptors from a sender subsystem of the targeting system to a receiver subsystem of the targeting system, pointing an optical axis of a camera of the receiver subsystem at the target based on the target location information received from the sending subsystem, forming a target image at a receiver subsystem location when the optical axis is pointed at the target, and identifying a second selected portion of the target image formed at the receiver subsystem location that is correlated to the first selected portion of the target image formed at the sender subsystem location.

Claims

1. A method to geo-reference a target between subsystems of a targeting system, the method comprising:

receiving a target image formed at a sender subsystem location;

generating target descriptors for a first selected portion of the target image responsive to receiving the target image;

sending target location information and the target descriptors from a sender subsystem of the targeting system to a receiver subsystem of the targeting system;

pointing an optical axis of a camera of the receiver subsystem at the target based on the target location information received from the sending subsystem;

forming a target image at a receiver subsystem location when the optical axis is pointed at the target; and

identifying a second selected portion of the target image formed at the receiver subsystem location that is correlated to the first selected portion of the target image formed at the sender subsystem location, the identification being based on the target descriptors received from the sending subsystem.

2. The method of claim 1, further comprising:

determining a target distance between the sender subsystem location and a target location; and

implementing a scene rendering function at the sender subsystem responsive to receiving the target image formed at the sender subsystem location, the implementation being based on relative positions of the sender subsystem at a first location, the receiver subsystem at a second location, and the target at the target location, wherein the generating target descriptors is based on output from the scene rendering function.

3. The method of claim 2, wherein implementing a scene rendering function comprises:

segmenting the first selected portion of the target image formed at the sender subsystem location;

geo-reference ranging segments of the first selected portion of the target image formed at the sender subsystem location; and

determining a plane and a plane-orientation for each geo-reference ranged segment.

4. The method of claim 3, wherein implementing a scene rendering function comprises:

combining a shape descriptor and a texture descriptor to generate the target descriptor for at least one feature of the first selected portion of the target image.

5. The method of claim 1, further comprising:

determining a bandwidth of a communication link between the sender subsystem and the receiver subsystem; and

when the determined bandwidth is less than a selected bandwidth,

reducing the first selected portion of the target image formed at a sender subsystem location to a subset image of the first selected portion of the image target;

generating target descriptors only for the subset image of the first selected portion of the target image; and

sending one of the target descriptors for the subset image or a gray-scale image of the subset image, whichever requires less bandwidth to send.

6. The method of claim 1, further comprising determining a target location.

7. The method of claim 6, wherein determining the target location comprises:

receiving information indicative of the sender subsystem location;

determining a target distance between the sender subsystem and the target;

determining an angle of elevation between the sender subsystem and the target; and

determining the target location based on the sender subsystem location and the determined distance and angle.

8. The method of claim 1, further comprising:

recognizing the target is moving at a velocity;

sending information indicative of the velocity of the target from the sender subsystem to the receiver subsystem.

9. The method of claim 1, further comprising:

selecting the first selected portion of the target image from the target image formed at the sender subsystem location.

10. The method of claim 9, further comprising:

indicating the second selected portion of the target image formed at the receiver subsystem location that is correlated to the first selected portion of the target image formed at the sender subsystem location.

11. A targeting system to geo-reference a target location, the system comprising:

a sender subsystem at a first location; and

a receiver subsystem at a second location, the receiver subsystem communicatively coupled to the sender subsystem, wherein

the sender subsystem includes,

a first camera to form a target image,

a first processor operable to receive information indicative of the target image and further operable to generate target descriptors for a first selected portion of the target image and to generate a target location, and

a transmitter to send the target descriptors and the target location to the receiver subsystem,

and wherein the receiver subsystem includes,

a receiver to receive the target descriptors and the target location;

a second processor operable to direct an optical axis of a second camera toward the target location and further operable to identify the portion of the target that is correlated to the first selected portion of the target image based on the received target descriptors.

12. The targeting system of claim 11, further comprising:

a first camera platform communicatively coupled to the first processor, wherein an orientation of the first camera platform is controlled by the first processor.

13. The targeting system of claim 11, further comprising:

a storage medium to hold a video analytics function executable by the first processor to generate target descriptors within the first selected portion of the target image.

14. The targeting system of claim 13, wherein the storage medium additionally holds a scene rendering function executable by the first processor, wherein output from the scene rendering function is used by the video analytics function to generate the target descriptors.

15. The targeting system of claim 11, further comprising:

a first global positioning system receiver in the sender subsystem, the first global positioning system receiver communicatively coupled to send a first location to the first processor; and

a second global positioning system receiver in the receiver subsystem, the second global positioning system receiver communicatively coupled to send a second location to the second processor.

16. The targeting system of claim 11, further comprising:

a first range finder in the sender subsystem, the first range finder communicatively coupled to send a target range to the first processor; and

a second range finder in the receiver subsystem, the second range finder communicatively coupled to send a target range to the second processor.

17. The targeting system of claim 11, further comprising:

a first display in the sender subsystem, the first display operable to display the target image of the target viewed at the first location, the first display being communicatively coupled to send information indicative of the first selected portion of the target image to the first processor; and

a second display in the receiver subsystem, the second display operable to display the target image of the target viewed at the second location in which the second selected portion of the target image is indicated by an icon.

18. A targeting system to accurately share a precise location of a target, comprising:

means for selecting a portion of a target image formed at a first location of the targeting system;

means for generating target descriptors for the selected portion;

means for sending target location information and the target descriptors from a sender subsystem of the targeting system to a receiver subsystem of the targeting system;

means for forming a target image at a second location of the targeting system; and

means for identifying a selected portion of the target image formed at second location that is correlated to the selected portion of the target image formed at the sender subsystem location.

19. The targeting system of claim 18, further comprising:

means for segmenting the selected portion into segments; and

means for determining a plane and a plane orientation for each segment.

20. The targeting system of claim 19, further comprising:

means for determining bandwidth; and

means for reducing the information sent by the means for sending based on output from the means for determining bandwidth.