Method and apparatus for detecting objects in an image

• US 8,098,936 B2
• Filed: 11/08/2007
• Issued: 01/17/2012
• Est. Priority Date: 01/12/2007
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Guerzhoy, Michael, Zhou, Hui
• Primary Examiner(s): Desire, Gregory M
• Application Number:
  US11/936,865
• Publication Number:
  US 20080170784A1
• Time in Patent Office: 1,531 Days
• Field of Search: 345/441, 345/619, 345/629, 382/181, 382/190, 382/199, 382/286
• US Class Current: 382/181
• CPC Class Codes: G06T 2207/10008 from scanner, fax or copier
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/143 involving probabilistic approaches, e.g. Markov random field [MRF] modelling
• CPC Class Codes: G06T 7/181 involving edge growing; involving edge linking

Abstract

A method of detecting generally rectangular objects in an image comprises determining candidate rectangles in the image based on detected corners in the image, ranking the candidate rectangles on the basis of a set of differentiating factors and detecting objects in the images based on the ranked candidate rectangles.

Claims

1. A method of detecting generally rectangular objects in an image comprising using a processing unit to:

determine candidate rectangles in the image based on detected corners in the image;

rank the candidate rectangles on the basis of a set of differentiating factors;

detect objects in said images based on the ranked candidate rectangles

estimate a background color of said image;

detect edges delimiting the objects on the basis of the estimated background color;

examine the edges to detect intersecting edges representing corners; and

group corners that define vertices of a rectangle thereby to determine the candidate rectangles.

2. The method of claim 1 further comprising, prior to said ranking, discarding selected candidate rectangles.

3. The method of claim 2 wherein selected candidate rectangles are discarded when they overlap with higher ranked candidate rectangles by more than a threshold amount.

4. The method of claim 3 further comprising, prior to said ranking, merging proximate candidate rectangles.

5. The method of claim 4 wherein said set of differentiating factors is based at least on edge and color information associated with pixels proximate the candidate rectangles.

6. The method of claim 4 further comprising, prior to said ranking, adjusting boundaries of the candidate rectangles.

7. The method of claim 6 wherein during said adjusting, the positions of the corners defining the candidate rectangles are adjusted within neighborhoods surrounding the candidate rectangles.

8. The method of claim 1 further comprising, prior to said ranking, adjusting boundaries of the candidate rectangles.

9. The method of claim 8 further comprising, prior to said ranking, discarding selected candidate rectangles.

10. The method of claim 9 wherein selected candidate rectangles are discarded when they overlap with higher ranked candidate rectangles by more than a threshold amount.

11. The method of claim 10 further comprising, prior to said ranking merging proximate candidate rectangles.

12. A tangible, non-transitory computer readable medium embodying a computer program comprising program code for carrying out the method of claim 1 when executed by a computer.

13. An apparatus for detecting generally rectangular objects in an image comprising:

memory for storing the image; and

a processing unit communicating with said memory, said processing unit processing the image to;

determine candidate rectangles based on detected corners in the image;

rank the candidate rectangles on the basis of a set of differentiating factors;

determine objects in the images from the ranked candidate rectangles;

estimate a background color of said image;

detect edges delimiting the objects on the basis of the estimated background color;

examine the edges to detect intersecting edges representing corners; and

group corners that define vertices of a rectangle thereby to determine the candidate rectangles.

14. An apparatus according to claim 13 wherein said processing unit, prior to said ranking, further processes the image to at least one of discard selected candidate rectangles, merge proximate candidate rectangles and adjust candidate rectangles.

15. An apparatus according to claim 14 wherein said processing unit processes the image to discard selected candidate rectangles, merge proximate candidate rectangles and adjust candidate rectangles.