Identification of a graphical symbol by identifying its constituent contiguous pixel groups as characters

• US 8,023,725 B2
• Filed: 04/12/2007
• Issued: 09/20/2011
• Est. Priority Date: 04/12/2007
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Shenhav, Tom, Schwartzberg, Yoav
• Primary Examiner(s): Mehta; Bhavesh
• Assistant Examiner(s): Drennan; Barry
• Application Number:
  US11/783,854
• Publication Number:
  US 20080253656A1
• Time in Patent Office: 1,622 Days
• Field of Search: None
• US Class Current: 382/154
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G06V 30/10 Character recognition

Abstract

A method for identifying a predefined graphic symbol having a plurality of graphical characters. The method comprises the following steps: a) receiving a digital image having a plurality of pixels depicting a scene, b) identifying a plurality of first groups of contiguous pixels in the proximity of one another, members of each one the first group having a first common pixel defining property, and c) identifying at least one of the plurality of first groups as one of the plurality of graphical characters, thereby detecting the predefined graphic symbol in the digital image.

Claims

1. A computerized method for identifying and animating a predefined graphic symbol having a plurality of graphical characters using a processor, said method comprising:

a) providing a predefined graphic symbol having a plurality of graphical characters;

b) receiving a digital image having a plurality of pixels depicting a real world scene with containing said predefined graphic symbol;

c) identifying, using the processor, a plurality of first groups of contiguous pixels in the proximity of one another, members of each one said first group having a first common pixel defining property;

d) identifying at least one of said plurality of first groups as one of the plurality of graphical characters of said predefined graphic symbol, thereby detecting, using the processor, the predefined graphic symbol in said digital image;

e) calculating, using the processor, a virtual plane according to a plurality of reference points of said plurality of first groups; and

f) augmenting at least one virtual object, on said virtual plane, in a presentation of said digital image according to the location of said predefined graphic symbol in said real world scene.

2. The method of claim 1, further comprising identifying a second group of contiguous pixels, said second group having a second common pixel defining property, wherein said plurality of first groups is in the proximity of said second group.

3. The method of claim 2, wherein said identifying said second group of contiguous pixels comprises substantially enclosing said plurality of first groups in a second bounding-box, said second bounding-box being used during step d).

4. The method of claim 3, further comprising generating a binary map image based on said second bounding-box, said identifying of step c) being performed according to said binary map.

5. The method of claim 4, wherein said generating comprises a step of applying a color property threshold on the color property of the plurality of pixels.

6. The method of claim 5, wherein said color property threshold is a member of the following group:

a constant threshold, a dynamic threshold, and a Niblack threshold.

7. The method of claim 1, further comprising identifying an order of said plurality of first groups in relation to the position of each one of them in said digital image, said identifying of step d) being performed according to the place of said at least one of said plurality of first groups in said order.

8. The method of claim 7, further comprising identifying a line that approximately intersects the geometric center of each said first group, said order being determined according to a relative position of each said first group along said line.

9. The method of claim 8, wherein said line is a regression line.

10. The method of claim 7, further comprising detecting and removing outlier groups from said plurality of first groups.

11. The method of claim 1, wherein said identifying of step c) comprises a step of substantially enclosing each said first group in a respective first bounding-box, said first bounding-boxes being used during step d).

12. The method of claim 1, further comprising:

identifying a homography matrix according to at least one of said identified plurality of first groups; and

using said homography matrix for augmenting a virtual object with said digital image.

13. The method of claim 12, wherein said homography matrix is calculated according to at least four reference points of said identified plurality of first groups.

14. The method of claim 13, each three of said at least four references are non-collinear.

15. The method of claim 1, wherein said identifying of step c) comprises a step of finding connected components, each said connected component being tagged as one of said plurality of first groups.

16. The method of claim 1, wherein said identifying of step c) comprising a step of removing members of said plurality of first groups that do not comply with a set of predefined geometric characteristics.

17. The method of claim 16, wherein said set of predefined geometric characteristics comprises a member of the following group:

a predefined aspect ratio between the width and the height, having an area in a predefined range, having an area in a predefined range in relation to an area that encloses said first group, having an area in a predefined range in relation at least a portion of said plurality of first groups.

18. The method of claim 1, wherein said providing comprises using an imaging device for capturing said digital image and rendering said digital image with said digital image and said at least one augmented virtual object on a display.

19. The method of claim 18, wherein said rendering is performed according to the position of the imaging device.