Data processing apparatus and control method thereof

• US 8,891,877 B2
• Filed: 07/14/2011
• Issued: 11/18/2014
• Est. Priority Date: 07/21/2010
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Natori, Ryoko, Shiraga, Shinji
• Primary Examiner(s): Bali, Vikkram
• Assistant Examiner(s): WOLDEMARIAM, AKLILU K
• Application Number:
  US13/183,012
• Publication Number:
  US 20120020567A1
• Time in Patent Office: 1,223 Days
• Field of Search: 382/195, 382/209, 382/203, 382/100, 382/181, 382/223, 382/240, 382/260
• US Class Current: 382/195
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion

Abstract

A data processing apparatus that executes determining processing, using a plurality of stages, for determining whether or not a partial image sequentially extracted from an image of each frame of a moving image corresponds to a specific pattern, assigns a plurality of discriminators to each stage such that a plurality of partial images are processed in parallel. The data processing apparatus divides an image into a plurality of regions, and, for the image of each region, calculates a passage rate or accumulated passage rate from a ratio between the number of partial images input to a stage and the number of partial images determined to correspond to the specific pattern. The assignment of the discriminators to each stage is changed based on the passage rate or accumulated passage rate of the image processed immediately of a region to which the partial image extracted from the image being processed belongs.

Claims

1. A data processing apparatus for processing one or more partial images extracted from a frame image of a moving image that contains a plurality of frame images, comprising:

a memory; and

a processor in communication with the memory, the processor configured to provide;

a plurality of discriminators, wherein each discriminator is assigned to any of a plurality of stages, wherein each stage comprises identification processing, and in a case where it has been determined that an image that has been processed by a stage corresponds to a specific pattern at that stage, the stage outputs that image to a subsequent stage to cause that image to be processed in the subsequent stage, and

wherein each discriminator determines whether or not a partial image extracted from the frame image of the moving image corresponds to a specific pattern by identification processing according to the stage to which that discriminator is assigned;

an assignment unit that assigns the discriminators to the stages such that a plurality of partial images are processed in parallel;

a calculation unit that calculates a passage rate or an accumulated passage rate for each of a plurality of regions in the frame image, said calculation unit calculating the passage rate or accumulated passage rate for a given region from a ratio of a number of partial images of that region input to a stage to a number of partial images of that region determined to correspond to the specific pattern, and said calculation unit holding the calculated passage rate or accumulated passage rate for each region on a stage basis in a holding unit; and

a changing unit that causes said assignment unit to change assignment of the discriminators to the stages for each region in the frame image in the moving image respectively, based at least in part on the passage rate or the accumulated passage rate held in the holding unit for a corresponding region in a previous frame image, the corresponding region in the previous frame image being determined by the position of each pixel being moved back by an amount of movement indicated by a motion vector corresponding to that pixel, and the passage rate or accumulated passage rate of a region to which the moved position belongs being used as the passage rate or accumulated passage rate for the corresponding region in the previous frame image.

2. The apparatus according to claim 1, wherein said changing unit, based on the passage rate or the accumulated passage rate held in the holding unit, calculates a data amount to be processed in each stage, decides a number of discriminators to be assigned to each stage based on a ratio of the data amounts between stages, and changes the assignment of the discriminators to each stage accordingly.

3. The apparatus according to claim 1,

wherein, with respect to each of the plurality of stages, a processing time required by each discriminator to process the partial image is stored in said memory, and

wherein said changing unit calculates a data amount to be processed in each stage based on the passage rate or the accumulated passage rate, and decides, with respect to each stage, a number of discriminators to be assigned to each stage such that a maximum value of an average processing time of each stage obtained from the data amount, the processing time, and the number of discriminators distributed to the stage is minimized.

4. The apparatus according to claim 1, wherein said changing unit monitors whether or not processing by each discriminator has finished, and when a number of assigned discriminators are different between adjacent stages, connects a discriminator of a preceding one of the adjacent stages to a discriminator of a subsequent one of the adjacent stages on which processing has finished in an order in which the processing of the discriminator in the preceding stage finishes.

5. The apparatus according to claim 1,

wherein said processor is further configured to provide a detecting unit that detects a motion vector of each pixel based on movement of an object between frames, and

wherein said changing unit moves a position of each pixel back by an amount of movement indicated by a corresponding motion vector, acquires, from the holding unit, the passage rate or the accumulated passage rate of a region to which the moved position belongs, and causes said assignment unit to change the assignment of the discriminators to each stage based on the acquired passage rate or the accumulated passage rate.

6. A control method of a data processing apparatus that includes a plurality of discriminators, the control method comprising steps of:

assigning discriminators of the apparatus to any of a plurality of stages of processing such that a plurality of partial images are processed in parallel, wherein each stage comprises identification processing, and in a case where it has been determined that an image that has been processed by a stage corresponds to a specific pattern at that stage, the stage outputs that image to a subsequent stage to cause that image to be processed in the subsequent stage, and wherein each discriminator determines whether or not a partial image extracted from a frame image a moving image that contains plural frame images corresponds to the specific pattern by identification processing according to the stage to which that discriminator is assigned;

calculating a passage rate or an accumulated passage rate for each of a plurality of regions in the frame image, the passage rate or accumulated passage rate for a given region being calculated from a ratio of a number of partial images of that region input to a stage to a number of partial images of that region determined to correspond to the specific pattern, and holding the calculated passage rate or accumulated passage rate for each region on a stage basis in a holding unit; and

changing assignment of the discriminators to the stages for each region in the frame image in the moving image respectively, based at least in part on the passage rate or the accumulated passage rate held in the holding unit for a corresponding region in a previous frame image, the corresponding region in the previous frame image being determined by the position of each pixel being moved back by an amount of movement indicated by a motion vector corresponding to that pixel, and the passage rate or accumulated passage rate of a region to which the moved position belongs being used as the passage rate or accumulated passage rate for the corresponding region in the previous frame image.