Image processing apparatus and method

• US 9,196,043 B2
• Filed: 04/23/2015
• Issued: 11/24/2015
• Est. Priority Date: 07/26/1996
• Status: Expired due to Fees

• Current Assignee: Image Processing Technologies, LLC (General Patent Corporation)
• Original Assignee: Image Processing Technologies, LLC (General Patent Corporation)
• Inventors: Pirim, Patrick
• Primary Examiner(s): Seth, Manav
• Application Number:
  US14/694,594
• Publication Number:
  US 20150302607A1
• Time in Patent Office: 215 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

A method and apparatus for localizing an area in relative movement and for determining the speed and direction thereof in real time is disclosed. Each pixel of an image is smoothed using its own time constant. A binary value corresponding to the existence of a significant variation in the amplitude of the smoothed pixel from the prior frame, and the amplitude of the variation, are determined, and the time constant for the pixel is updated. For each particular pixel, two matrices are formed that include a subset of the pixels spatially related to the particular pixel. The first matrix contains the binary values of the subset of pixels. The second matrix contains the amplitude of the variation of the subset of pixels. In the first matrix, it is determined whether the pixels along an oriented direction relative to the particular pixel have binary values representative of significant variation, and, for such pixels, it is determined in the second matrix whether the amplitude of these pixels varies in a known manner indicating movement in the oriented direction. In each of several domains, histogram of the values in the first and second matrices falling in such domain is formed. Using the histograms, it is determined whether there is an area having the characteristics of the particular domain. The domains include luminance, hue, saturation, speed (V), oriented direction (D1), time constant (CO), first axis (x(m)), and second axis (y(m)).

Claims

1. An object identification system for tracking a moving object in an image frame by analysis of an input signal, based upon user specified criteria for identifying such moving object, the object identification system comprising:

an image processing system for generating a first output signal including information related to the user specified criteria regarding the moving object, the image processing system including a temporal processing unit for smoothing the input signal and, in turn, generating a first interim signal, a memory associated with the temporal processing unit, a delay unit for introducing a delay to the first interim signal, a spatial processing unit for receiving the first interim signal with the delay from the delay unit and producing a second interim signal, and a sequencing unit for processing the second interim signal and generating the first output signal; and

a histogram processor for processing the first output signal, received from the image processing system, and generating a second output signal containing information about the object in the image frame, the histogram processor including a histogram forming portion configured for receiving the first output signal and forming a histogram therefrom, a classifier for selecting the user specified criteria of a given pixel within the image frame for which the histogram is to be formed, a validation block for determining whether the given pixel within the image frame will be used in forming the histogram, and a key characteristics unit for computing key characteristics for the histogram, wherein the histogram forming portion receives the first output signal and, in cooperation with the classifier, the validation block, and the key characteristics unit, generates the second output signal identifying the moving object in the image frame.

2. The object identification system of claim 1, wherein the validation block generates a validation signal for each given pixel within the image frame, to indicate whether the histogram forming portion should utilize that pixel in forming the histogram.

3. The object identification system of claim 1,

wherein the classifier enables only pixels having user specified criteria to be considered further, and

wherein the validation block includes a register block associated with at least one of the user specified criteria such that, using the classifier in combination with the validation unit, the histogram processor only processes data points satisfying user specified criteria.

4. The object identification system of claim 1,

wherein the key characteristics unit computes at least one attribute of the histogram selected from the group consisting of a minimum of the histogram, a maximum of the histogram, number of points in the histogram, position of the maximum of the histogram within the image frame, and number of points at the maximum of the histogram.

5. The object identification system of claim 4,

wherein the position of the maximum of the histogram is used in identifying the moving object in the image frame.

6. The object identification system of claim 1,

wherein the histogram for each of the user specified criteria is generated in real time.

7. The object identification system of claim 1,

wherein the histogram processor generates the second output signal, identifying the moving object meeting the user specified criteria in the image frame, in real time.

8. The object identification system of claim 1,

wherein the second output signal is a visual signal.

9. The object identification system of claim 1,

wherein the second output signal is an audible signal.

10. The object identification system of claim 1,

wherein the user specified criteria includes at least one of luminance, speed, oriented direction, time constant, hue, saturation, first axis, and second axis.

11. The object identification system of claim 1,

further comprising a bus for communicating signals between the image processing system and the histogram processor.

12. An object identification system for tracking a moving object in an image frame by analysis of an input signal, based upon user specified criteria for identifying such moving object, the object identification system comprising:

an image processing system for generating a first output signal including information related to the user specified criteria regarding the moving object,

the image processing system being configured for performing temporal and spatial processing of the input signal for pixels in the image frame; and

a histogram processor for processing the first output signal, received from the image processing system, and generating a second output signal containing information about the object in the image frame, the histogram processor including

a histogram forming portion configured for receiving the first output signal and forming a histogram therefrom,

a classifier for selecting the user specified criteria of a given pixel within the image frame for which the histogram is to be formed,

a validation block for determining whether the given pixel within the image frame will be used in forming the histogram, and

a key characteristics unit for computing key characteristics for the histogram,

wherein the histogram forming portion receives the first output signal and, in cooperation with the classifier, the validation block, and the key characteristics unit, generates the second output signal identifying the moving object in the image frame.

13. The object identification system of claim 12, wherein the validation block generates a validation signal for each given pixel within the image frame, to indicate whether the histogram forming portion should utilize that pixel in forming the histogram.

14. The object identification system of claim 12,

wherein the classifier enables only pixels having user specified criteria to be considered further, and

wherein the validation block includes a register block associated with at least one of the user specified criteria such that, using the classifier in combination with the validation unit, the histogram processor only processes data points satisfying user specified criteria.

15. The object identification system of claim 12,

wherein the key characteristics unit computes at least one attribute of the histogram selected from the group consisting of a minimum of the histogram, a maximum of the histogram, number of points in the histogram, position of the maximum of the histogram within the image frame, and number of points at the maximum of the histogram.

16. The object identification system of claim 15,

wherein the position of the maximum of the histogram is used in identifying the moving object in the image frame.

17. The object identification system of claim 12,

wherein the histogram for each of the user specified criteria is generated in real time.

18. The object identification system of claim 12,

wherein the histogram processor generates the second output signal, identifying the moving object meeting the user specified criteria in the image frame, in real time.

19. The object identification system of claim 12,

wherein the user specified criteria includes at least one of luminance, speed, oriented direction, time constant, hue, saturation, first axis, and second axis.

20. The object identification system of claim 12,

further comprising a bus for communicating signals between the image processing system and the histogram processor.