Methods and Systems for Detecting Pictorial Regions in Digital Images

• US 20070206857A1
• Filed: 06/15/2006
• Published: 09/06/2007
• Est. Priority Date: 03/02/2006
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Matsuda, Toyohisa, Campbell, Richard John, Chen, Lawrence Shao-hsien, Ferman, Ahmet Mufit
• Granted Patent: US 8,630,498 B2
• Time in Patent Office: Days
• US Class Current: 382/171
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

Embodiments of the present invention comprise systems, methods and devices for detection of pictorial regions in an image using a masking condition, an entropy measure, and region growing.

Claims

1. A method for detecting a pictorial region in a digital image, said method comprising:

a) calculating a masked entropy value for each of a plurality of pixels in a digital image;

b) determining a confidence level for each of said plurality of pixels based on said masked entropy values;

c) determining a seed region based on said masked entropy values wherein said seed region comprises seed-region pixels from said plurality of pixels; and

d) growing said seed region based on said confidence levels thereby producing a pictorial region wherein said pictorial region comprises pictorial-region pixels from said plurality of pixels.

2. A method as described in claim 1 further comprising refining said pictorial region thereby producing a refined pictorial region.

3. A method as described in claim 2 wherein said refining comprises filling at least one of holes and concave boundary regions in said pictorial region.

4. A method as described in claim 1 further comprising verifying said pictorial region thereby producing a verified pictorial region.

5. A method as described in claim 4 wherein said verifying said pictorial region comprises determining at least one of the size of said pictorial region, the shape of said pictorial region, the area of said pictorial region within a first bounding shape, and the distribution of said pictorial region with a second bounding shape.

6. A method as described in claim 1 wherein said determining said seed region further comprises:

a) determining a first confidence-level threshold value; and

b) identifying a target pixel from said plurality of pixels as one of said seed-region pixels if said confidence level for said target pixel is greater than said first confidence-level threshold value.

7. A method as described in claim 1 wherein said growing further comprises:

a) determining a second confidence-level threshold value; and

b) identifying a candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is connected to said seed region and said confidence level for said candidate pixel is greater than said second confidence-level threshold value.

8. A method as described in claim 6 wherein said first confidence-level threshold is based on the range of said confidence levels.

9. A method as described in claim 7 further comprising:

a) obtaining a labeled background map for said digital image; and

b) identifying said candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is less than said second confidence-level threshold value and said candidate pixel is labeled as pictorial content in said labeled background map.

10. A system for detecting a pictorial region in a digital image, said system comprising:

a) a calculator for calculating a masked entropy value for each of a plurality of pixels in a digital image;

b) a first determiner for determining a confidence level for each of said plurality of pixels based on said masked entropy values;

c) a second determiner for determining seed regions based on said masked entropy values; and

d) a region grower for growing said regions based on said confidence levels.

11. A system as described in claim 10 further comprising a refiner for refining said pictorial region thereby producing a refined pictorial region.

12. A system as described in claim 11 wherein said refining comprises filling at least one of holes and concave boundary regions in said pictorial region.

13. A system as described in claim 10 further comprising a verifier for verifying said pictorial region thereby producing a verified pictorial region.

14. A system as described in claim 13 wherein said verifier comprises at least one of a size determiner for determining the size of said pictorial region, a shape determiner for determining the shape of said pictorial region, an area determiner for determining the area of said pictorial region within a first bounding shape, and a distribution determiner for determining the distribution of said pictorial region within a second bounding shape.

15. A system as described in claim 10 wherein said second determiner for determining said seed region further comprises:

a) a first-confidence-level-threshold determiner for determining a first confidence-level threshold value; and

b) a seed-region-pixel identifier for identifying a target pixel from said plurality of pixels as one of said seed-region pixels if said confidence level for said target pixel is greater than said first confidence-level threshold value.

16. A system as described in claim 10 wherein said growing further comprises:

a) a second-confidence-level-threshold determiner for determining a second confidence-level threshold value; and

b) a first pictorial-region-pixel identifier for identifying a candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is connected to said seed region and said confidence level for said candidate pixel is greater than said second confidence-level threshold value.

17. A system as described in claim 15 wherein said first confidence-level threshold is based on the range of said confidence levels.

18. A system as described in claim 16 further comprising:

a) an obtainer for obtaining a labeled background map for said digital image; and

b) a second pictorial-region-pixel identifier for identifying said candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is less than said second confidence-level threshold value and said candidate pixel is labeled as pictorial content in said labeled background map.

19. A method for detecting a pictorial region in a digital image, said method comprising:

a) calculating a masked entropy value for each of a plurality of pixels in a digital image;

b) determining a confidence level for each of said plurality of pixels based on said masked entropy values;

c) determining a seed region based on said masked entropy values wherein said seed region comprises seed-region pixels from said plurality of pixels;

d) obtaining a labeled background map for said digital image wherein said labeled background map comprises a label corresponding to pictorial content; and

e) growing said seed region based on said confidence levels and said labeled background map thereby producing a pictorial region wherein said pictorial region comprises pictorial-region pixels from said plurality of pixels.

f) refining said pictorial region thereby producing a refined pictorial region; and

g) verifying said refined pictorial region thereby producing a verified pictorial region.

20. The method as described in claim 19 further comprising:

a) determining a first confidence-level threshold value;

b) identifying a target pixel from said plurality of pixels as one of said seed-region pixels if said confidence level for said target pixel is greater than said first confidence-level threshold value;

c) determining a second confidence-level threshold value;

d) identifying a candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is connected to said seed region and said confidence level for said candidate pixel is greater than said second confidence-level threshold value; and

e) identifying said candidate pixel from said plurality of pixels as a pictorial-region pixel if said candidate pixel is less than said second confidence-level threshold value and said candidate pixel is labeled as pictorial content in said labeled background map.