Method, system and apparatus for processing an image

• US 10,255,512 B2
• Filed: 12/17/2015
• Issued: 04/09/2019
• Est. Priority Date: 12/22/2014
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Pham, Quang Tuan, Taylor, Geoffrey Richard
• Primary Examiner(s): Liew, Alex Kok S
• Application Number:
  US14/972,771
• Publication Number:
  US 20160180547A1
• Time in Patent Office: 1,209 Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/68 of symmetry
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/34 Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
• CPC Class Codes: G06V 10/42 Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method of determining a vertical medial axis of an object in an input image, is disclosed. A measure of horizontal symmetry is determined for each pixel of the image. First and second vertical bounds within the image are determined. A continuous path between the first and second vertical bounds is determined based on the horizontal symmetry measure, the continuous path representing the vertical medial axis of the object.

Claims

1. A method of determining a boundary of an object in an input image, the method comprising:

determining a set of vertical medial axes of the object in the input image, at least a portion of at least one of the vertical medial axes being curved following a shape of the object;

determining an edge response image for the input image using the vertical medial axes; and

determining a continuous path on at least one side of the vertical medial axes, at least one vertical medial axis of the vertical medial axes and the continuous path extending at least from a first vertical bound to a second vertical bound, and the continuous path summing up to a maximum total edge response and representing at least a portion of the boundary of the object.

2. The method according to claim 1, further comprising determining a foreground mask of the object using the boundary.

3. The method according to claim 1, further comprising determining a foreground confidence mask of the object using a confidence score.

7. The method according to claim 1, wherein a maximum-cost path represents at least a portion of the boundary of the object.

8. The method according to claim 1, wherein at least one portion of the boundary of the object on at least one side of the vertical medial axis and the continuous path extend from the first vertical bound to the second vertical bound.

9. The method according to claim 1, wherein at least a portion of the boundary of the object extends between the vertical medial axis and a second vertical medial axis of the object.

10. The method according to claim 1, wherein the continuous path, the vertical medial axis of the object and at least a portion of the boundary of the object extend at least from the first vertical bound to the second vertical bound.

11. The method according to claim 1, wherein the object is located between the first vertical bound and the second vertical bound.

4. A system for determining a boundary of an object in an input image, the system comprising:

a memory for storing data and a computer program;

a processor coupled to the memory for executing the computer program, the computer program comprising instructions for;

determining a set of vertical medial axes of the object in the input image, at least a portion of at least one of the vertical medial axes being curved following a shape of the object;

determining an edge response image for the input image using the vertical medial axes; and

determining a continuous path on at least one side of the vertical medial axes, at least one vertical medial axis of the vertical medial axes and the continuous path extending at least from a first vertical bound to a second vertical bound, and the continuous path summing up to a maximum total edge response and representing at least a portion of the boundary of the object.

5. An apparatus for determining a boundary of an object in an input image, the apparatus comprising:

means for determining a set of vertical medial axes of the object in the input image, at least a portion of at least one of the vertical medial axes is curved following a shape of the object;

means for determining an edge response image for the input image using the vertical medial axes; and

means for determining a continuous path on at least one side of the vertical medial axes, at least one vertical medial axis of the vertical medial axes and the continuous path extending at least from a first vertical bound to a second vertical bound, and the continuous path summing up to a maximum total edge response and representing at least a portion of the boundary of the object.

6. A non-transitory computer readable medium having stored thereon at least one computer program for causing a processor to execute a method for determining a boundary of an object in an input image, the method comprising:

determining a set of vertical medial axes of the object in the input image, at least a portion of at least one of the vertical medial axes is curved following a shape of the object;

determining an edge response image for the input image using the vertical medial axes; and

determining a continuous path on at least one side of the medial axes, at least one vertical medial axis of the vertical medial axes and the continuous path extending at least from a first vertical bound to a second vertical bound, and the continuous path summing up to a maximum total edge response and representing at least a portion of the boundary of the object.