Image processing based on visual attention and reduced search based generated regions of interest

• US 8,542,875 B2
• Filed: 09/17/2010
• Issued: 09/24/2013
• Est. Priority Date: 09/17/2010
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Eswara, Lalitha M.
• Primary Examiner(s): Lu, Tom Y
• Application Number:
  US12/885,171
• Publication Number:
  US 20120070075A1
• Time in Patent Office: 1,103 Days
• Field of Search: 382/103, 382/104, 382/106
• US Class Current: 382/103
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]

Abstract

A system for complexity reduction in images involving concepts of visual attention based most probable region detection for object presence and perspective-view based reduced scale-search approaches. Visual attention concept in context uses gradient and contrast of an image. A pixel meeting certain criteria for gradient or contrast values may be further processed for object presence. Limiting image processing to such regions may reduce the complexity of digitized images. Post processing the outcome using morphological operations like dilation and erosion appropriately may help retain some of the missed object pixels in the resultant image. Typically image blocks at different scales are searched for object presence. Reduced-scale search involves removing certain scales during search. As object size in image varies with its location scales within a given scale-range if searched, may lead to higher chances of object presence. This is implemented using relative heights and widths estimation using the perspective view concept.

Claims

1. An approach for reducing complexity of digitized images by using visual attention, comprising:

determining a gradient image of an input image;

determining a YUV image of the input image;

evaluating gradient pixels of the gradient image;

processing the gradient pixels having values meeting an adaptive threshold;

evaluating Y-channel pixels of the YUV image as contrast pixels;

processing contrast pixels having values meeting an adaptive threshold; and

merging processed gradient and contrast pixels into an output image.

2. The approach of claim 1, further comprising a post-processor to minimize missed pixels of an object in the output image where there are no processed pixels using morphological operations like erosion and dilation.

3. The approach of claim 1, wherein:

a contrast image comprises evaluated pixels of a Y-channel of the YUV image; and

the evaluated pixels of a Y-channel image are contrast pixels.

4. The approach of claim 3, further comprising:

determining a mean and standard deviation of values of the pixels of the Y-channel image; and

checking whether a value of a pixel of the Y-channel image is <

(M′

s*S′

) or >

(M′

+s*S′

); and

wherein;

M′

represents the mean;

S′

represents the standard deviation;

s represents a multiplication factor; and

the adaptive threshold is <

(M′

s*S′

) or >

(M′

+s*S′

).

5. The approach of claim 4, wherein:

if a value of a pixel of the Y-channel image is <

(M′

s*S′

) or >

(M′

+s*S′

), then the pixel is processed; and

if a value of a pixel of the Y-channel image is not <

(M′

s*S′

) or >

(M′

+s*S′

), then the pixel is not processed.

6. The approach of claim 1, further comprising:

determining a minimum and a maximum of values of the gradient pixels of the gradient image; and

checking whether a value of a gradient pixel is <

(S*m) or >

(S*M); and

wherein;

M represents the maximum;

m represents the minimum;

S represents a scale factor; and

the adaptive threshold is <

(S*m) or >

(S*M).

7. The approach of claim 6, wherein:

if a value of a gradient pixel is <

(S*m) or >

(S*M), then the pixel is processed; and

if a value of a gradient pixel is not <

(S*m) or >

(S*M), then the pixel is not processed.

8. A system for reducing complexity of digital images, comprising:

an image source module;

a gradient pixel selection module connected to the image source module;

a contrast pixel selection module connected to the image source module; and

a pixel merger module connected to the gradient pixel selection module and to the contrast pixel selection module; and

wherein;

the gradient pixel selection module comprises a gradient detector connected to the image source module and a gradient pixel evaluator connected to the gradient pixel selection module and the pixel merger module, the gradient pixel evaluator finding minimum and maximum values, and selecting a scale factor for a gradient of an image; and

if a gradient pixel has a value less than a product of a scale factor and the minimum value or greater than a product of the scale factor and the maximum value, then the gradient pixel is processed as part of an output image; and

if the gradient pixel does not have a value less than a product of the scale factor and the minimum value or greater than a product of the scale factor and the maximum value, then the gradient pixel is not processed as part of an output image.

9. The system of claim 8, wherein the contrast pixel selection module comprises:

a Color Component detector connected to the image source module; and

a contrast pixel evaluator connected to the color component detector and the pixel merger module.

10. The system of claim 8, wherein the pixel merger module comprises:

an image pixel screener or selector;

a post processor; and

a binary image output module connected to the post processor.

11. A system for reducing complexity of digital images, comprising:

an image source module;

a gradient pixel selection module connected to the image source module;

a contrast pixel selection module connected to the image source module; and

a pixel merger module connected to the gradient pixel selection module and to the contrast pixel selection module;

wherein the gradient pixel selection module comprises a gradient detector connected to the image source module and a gradient pixel evaluator connected to the gradient pixel selection module and the pixel merger module; and

wherein the contrast pixel evaluator finds a mean, a standard deviation and selects a multiplication factor for a Y-channel image.

12. The system of claim 11, wherein:

if a Y-channel pixel has a value less than the mean minus a product of the multiplication factor and the standard deviation or greater than the mean plus the product of the multiplication factor and the standard deviation, then the pixel is processed; and

if the Y-channel pixel does not have a value less than the mean minus a product of the multiplication factor and the standard deviation or greater than the mean plus the product of the multiplication factor and the standard deviation, then the pixel is not processed as part of an output image.