METHODS AND APPARATUS TO DETERMINE THE DIMENSIONS OF A REGION OF INTEREST OF A TARGET OBJECT FROM AN IMAGE USING TARGET OBJECT LANDMARKS

• US 20170293819A1
• Filed: 09/07/2016
• Published: 10/12/2017
• Est. Priority Date: 04/11/2016
• Status: Active Grant

• Current Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Original Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Inventors: Deng, Kevin
• Granted Patent: US 10,235,585 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/147 Determination of region of interest
• CPC Class Codes: G06V 30/19007 Matching; Proximity measures
• CPC Class Codes: G06V 30/19067 Matching configurations of points or features, e.g. constellation matching
• CPC Class Codes: G06V 30/19173 Classification techniques
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

Methods and apparatus to determine the dimensions of a region of interest of a target object and a class of the target object from an image using target object landmarks are disclosed herein. An example method includes identifying a landmark of a target object in an image based on a match between the landmark and a template landmark; classifying a target object based on the identified landmark; projecting dimensions of the template landmark based on a location of the landmark in the image; and determining a region of interest based on the projected dimensions, the region of interest corresponding to text printed on the target object.

Claims

1. A method comprising:

identifying a landmark of a target object in an image based on a match between the landmark and a template landmark;

projecting dimensions of the template landmark based on a location of the landmark in the image;

determining a region of interest based on the projected dimensions, the region of interest corresponding to text printed on the target object.

2. The method of claim 1, further including comparing the landmark to a plurality of template landmarks.

3. The method of claim 1, wherein the template landmark is transformed to correspond to the size and orientation of the landmark.

4. The method of claim 3, wherein the projecting of the dimensions of the template landmark is based the size and the orientation.

5. The method of claim 1, further including:

generating a left side search area, the left side search area being a region including a first edge of the template landmark;

determining a first landmark edge by analyzing first transition points in the left side search area;

generating a right side search area, the right side search area being a region including a second edge of the template landmark;

determining a second landmark edge by analyzing second transition points in the right side search area;

determining a first corner of the region of interest based on a first intersection between a third edge of the template landmark and the first landmark edge; and

determining a second corner of the region of interest based on a second intersection between the third edge of the template landmark and the second landmark edge.

6. The method of claim 5, further including determining a left side edge of the target object and a right side edge of the target object, the left side edge corresponding to the first landmark edge and the right side edge corresponding to the second landmark edge.

7. The method of claim 6, wherein the left side edge and the right side edge of the target object has a restricted range in direction and area.

8. The method of claim 6, further including determining text lines within a region, the region corresponding to the third edge of the template landmark, the left side edge, the right side edge, and a bottom image line corresponding to a bottom of the image.

9. The method of claim 8, further including:

determining a third corner of the region of interest based on a third intersection between the left side edge and a text line closed to the bottom image line; and

determining a fourth corner of the region of interest based on a fourth intersection between the right side edge and the text line closed to the bottom image line.

10. The method of claim 9, wherein the first, second, third, and fourth corners of the region of interest improve an accuracy of text recognition techniques.

11. The method of claim 1, further including determining a class of the target object based on the matched template landmark.

12. An apparatus comprising:

a landmark detector to identify a landmark of a target object in an image based on a match between the landmark and a template landmark; and

a corner determiner to;

project dimensions of the template landmark based on a location of the landmark in the image; and

determine a region of interest based on the projected dimensions, the region of interest corresponding to text printed on the target object.

13. The apparatus of claim 12, wherein the landmark detector is to compare the landmark to a plurality of template landmarks.

14. The apparatus of claim 12, wherein the corner determiner is to transform the template landmark to match the size and orientation of the landmark.

15. The apparatus of claim 14, wherein the projecting of the dimensions of the template landmark is based the size and the orientation.

16. The apparatus of claim 12, wherein the corner determiner is to:

generate a left side search area, the left side search area being a region including a first edge of the template landmark;

determine a first landmark edge by analyzing first transition points in the left side search area;

generate a right side search area, the right side search area being a region including a second edge of the template landmark;

determine a second landmark edge by analyzing second transition points in the right side search area;

determine a first corner of the region of interest based on a first intersection between a third edge of the template landmark and the first landmark edge; and

determine a second corner of the region of interest based on a second intersection between the third edge of the template landmark and the second landmark edge.

17. The apparatus of claim 16, wherein the corner determiner is to determine a left side edge of the target object and a right side edge of the target object, the left side edge corresponding to the first landmark edge and the right side edge corresponding to the second landmark edge.

18. The apparatus of claim 17, wherein the left side edge and the right side edge of the target object has a restricted range in direction and area.

19. The apparatus of claim 17, wherein the corner determiner is to determine text lines within a region, the region corresponding to the third edge of the template landmark, the left side edge, the right side edge, and a bottom image line corresponding to a bottom of the image.

20. (canceled)

21. (canceled)

22. (canceled)

23. A computer readable storage medium comprising instructions which, when executed, cause a machine to at least:

identify a landmark of a target object in an image based on a match between the landmark and a template landmark;

project dimensions of the template landmark based on a location of the landmark in the image; and

determine a region of interest based on the projected dimensions, the region of interest corresponding to text printed on the target object.

24. (canceled)

25. (canceled)

26. (canceled)

27. (canceled)

28. (canceled)

29. (canceled)

30. (canceled)

31. (canceled)

32. (canceled)

33. (canceled)