Image processing apparatus and method

• US 9,042,602 B2
• Filed: 08/01/2014
• Issued: 05/26/2015
• Est. Priority Date: 07/22/1997
• Status: Expired due to Fees

• Current Assignee: Image Processing Technologies, LLC (General Patent Corporation), Southern District of Florida
• Original Assignee: Image Processing Technologies, LLC (General Patent Corporation)
• Inventors: Pirim, Patrick
• Primary Examiner(s): Bitar, Nancy
• Application Number:
  US14/449,817
• Publication Number:
  US 20140355833A1
• Time in Patent Office: 298 Days
• Field of Search: None
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

A method and apparatus for localizing an area in relative movement and for determining the speed and direction thereof in real time is disclosed. Each pixel of an image is smoothed using its own time constant. A binary value corresponding to the existence of a significant variation in the amplitude of the smoothed pixel from the prior frame, and the amplitude of the variation, are determined, and the time constant for the pixel is updated. For each particular pixel, two matrices are formed that include a subset of the pixels spatially related to the particular pixel. The first matrix contains the binary values of the subset of pixels. The second matrix contains the amplitude of the variation of the subset of pixels. In the first matrix, it is determined whether the pixels along an oriented direction relative to the particular pixel have binary values representative of significant variation, and, for such pixels, it is determined in the second matrix whether the amplitude of these pixels varies in a known manner indicating movement in the oriented direction. In each of several domains, histogram of the values in the first and second matrices falling in such domain is formed. Using the histograms, it is determined whether there is an area having the characteristics of the particular domain. The domains include luminance, hue, saturation, speed (V), oriented direction (D1), time constant (CO), first axis (x(m)), and second axis (y(m)).

Claims

1. A process of tracking a target provided in an input signal received by an image processing system, the image processing system being configured for receiving the input signal, which input signal includes data regarding a succession of frames, and each frame including a plurality of pixels, a portion of the plurality of pixels including the target, the process comprising:

calculating a histogram boundary for an area defined within the portion of the plurality of pixels containing the target;

analyzing the calculated histogram boundary to determine whether the area contains the target in its entirety;

adjusting the histogram boundary for the area defined within the portion of the plurality of pixels containing the target until the adjusted histogram boundary contains the target in its entirety; and

setting the calculated histogram boundary based on predefined criteria,

wherein the predefined criteria includes coordinates (Xmin, Ymin) and (Xmax, Ymax), and wherein calculating the histogram boundary comprises;

calculating an x histogram dimension for pixels from Xmin to Xmax;

calculating a y histogram dimension for pixels from Ymin to Ymax; and

analyzing the calculated x and y histograms dimension to determine whether the x and y histogram dimensions contain target information,

wherein analyzing the x and y histogram dimensions comprises performing a thresholding operation,

wherein the area defined by the histogram boundary is defined by coordinates (Xmin, Ymin) and (Xmax, Ymax), and wherein adjusting the location of the center comprises defining a new center of the histogram boundary at coordinate ((Xmin+Xmax)/2, (Ymin+Ymax)/2).

2. The process of claim 1, wherein the adjusted histogram boundary is adapted to a size of the target.

3. The process of claim 1, wherein the adjusted histogram boundary is defined to be successively larger.

4. The process of claim 1, wherein analyzing the calculated histogram boundary further comprises determining a location of a center of the calculated histogram boundary, and adjusting the histogram boundary further comprises adjusting the location of the center of the histogram boundary.

5. The process of claim 1, further comprising repeating the steps of calculating a histogram boundary, analyzing the calculated histogram, and adjusting the histogram boundary for a subsequent, second frame so as to track the target in the second frame.

6. The process of claim 1, wherein the pixels containing the target are received from a camera, and wherein adjusting the location of the center includes moving the camera so as to move the location of the center.

7. The process of claim 1, further comprising displaying a targeting box around the target on a monitor.

8. A target tracking system for determining, according to an initial area including a target to be tracked in an image captured by a camera, a targeting box surrounding a starting position of a frame, the target tracking system comprising:

an x histogram unit for forming a histogram based on predetermined x pixels of the targeting box;

a y histogram unit for forming a histogram based on predetermined y pixels of the targeting box; and

a controller for specifying dimensions of the targeting box bounded by the predetermined x pixels and y pixels, the controller adjusting the dimensions of the targeting box starting with the initial area and, in accordance with the histogram formed by the x and y histogram units, adjusting the dimensions until the target tracking system detects at least one edge of the target,

wherein the targeting box is defined by coordinates (Xmin, Ymin) and (Xmax, Ymax), such that

the x histogram unit calculates an x histogram dimension based on pixels from Xmin to Xmax, and

the y histogram unit calculates a y histogram dimension based on pixels from Ymin to Ymax, and

wherein the controller is configured to analyze the calculated x and y histogram dimensions to determine whether the x and y histogram dimensions contain target information,

wherein the controller is configured to analyze the calculated x and y histogram dimensions by performing a thresholding operation.

9. The target tracking system of claim 8, wherein the controller adjusts the dimensions of the targeting box by defining successively larger areas surrounding the starting position.

10. The target tracking system of claim 8, wherein the controller is configured to analyze the calculated x and y histogram dimensions by performing a thresholding operation.

11. The target tracking system of claim 10, wherein the area defined by the targeting box is bounded by coordinates (Xmin, Ymin) and (Xmax, Ymax), and wherein adjusting the location of the center of the targeting box includes defining a new center of the targeting box at coordinate ((Xmin+Xmax)/2, (Ymin+Ymax)/2).

12. The target tracking system of claim 8, further comprising a camera that provides the x and y pixels of the targeting box, and wherein adjusting the location of the center of the targeting box includes moving the camera so as to move the location of the center of the targeting box.

13. The target tracking system of claim 8, further comprising a monitor for displaying the targeting box relative to the initial area.

14. The target tracking system of claim 12, further comprising a servomotor for adjusting an orientation of the camera in accordance with the calculated x and y histogram dimensions.