Information processing apparatus and method for registering moving objects as metadata of an image

• US 8,634,589 B2
• Filed: 04/14/2010
• Issued: 01/21/2014
• Est. Priority Date: 05/13/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Shimizu, Tomoyuki
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): MOYER, ANDREW M
• Application Number:
  US12/760,138
• Publication Number:
  US 20100290671A1
• Time in Patent Office: 1,378 Days
• Field of Search: None
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

An association degree evaluation unit acquires pieces of position information of an image sensing apparatus at respective times within an adjacent time range to an imaging time of a designated image of those sensed by the image sensing apparatus. Furthermore, the association degree evaluation unit acquires pieces of position information of a moving object at the respective times within the adjacent time range. Then, the association degree evaluation unit calculates a similarity between routes of the image sensing apparatus and moving object based on the acquired position information group, and decides a degree of association between the designated image and moving object based on the calculated similarity. An associating unit registers information indicating the degree of association in association with the designated image.

Claims

1. An information processing apparatus comprising:

a first acquisition unit which acquires a plurality of pieces of position information of an image sensing apparatus at times adjacent to an imaging time of an image by the image sensing apparatus;

a second acquisition unit which acquires, for each of a plurality of moving objects, a plurality of pieces of position information of the moving object at the adjacent times;

a calculation unit which calculates, for each of the plurality of moving objects, a similarity between a route of the image sensing apparatus and a route of the moving object based on the plurality of pieces of position information of the image sensing apparatus and the plurality of pieces of position information of the moving object, wherein the similarity indicates a difference between the plurality of pieces of position information of the image sensing apparatus and the plurality of pieces of position information of the moving object, and the similarity is higher as the difference is smaller; and

a registration unit which registers, as metadata of the image, information used to specify the moving object for which the similarity is higher than a pre-set threshold even if the moving object for which the similarity is higher than the pre-set threshold is not included in the image, and

wherein the first acquisition unit, the second acquisition unit, the calculation unit and the registration unit are implemented by a processor.

2. The apparatus according to claim 1, further comprising:

a first management unit which manages a plurality of pieces of position information of the image sensing apparatus for respective times; and

a second management unit which manages a plurality of pieces of position information of the moving object for respective times,

wherein said first acquisition unit acquires the plurality of pieces of position information of the image sensing apparatus at the adjacent times to the imaging time of the image by the image sensing apparatus from the plurality of pieces of position information managed by said first management unit, and

said second acquisition unit acquires the plurality of pieces of position information of the moving object at the adjacent times from the plurality of pieces of position information managed by said second management unit.

3. The apparatus according to claim 2, wherein said first management unit manages position information of the image sensing apparatus at the imaging time by the image sensing apparatus.

4. The apparatus according to claim 2, wherein said first management unit manages pieces of position information of the image sensing apparatus, which are measured periodically.

5. The apparatus according to claim 1, wherein said calculation third acquisition unit acquires the similarity using an average value and a variance value of distances between the plurality of pieces of position information acquired by said first acquisition unit and the plurality of pieces of position information acquired by said second acquisition unit.

7. The apparatus according to claim 1, wherein said registration unit registers, in addition to the information used to specify the moving object for which the similarity is higher than the pre-set threshold, a degree of condition sharing, being based on closeness of the routes defined by the similarity, between a photographer of the image and the moving object for which the similarity is higher than the pre-set threshold, as the metadata of the image.

8. The apparatus according to claim 5, wherein said registration unit registers, as metadata of the image, information used to specify the moving object for which the variance is smaller than a pre-set threshold.

9. The apparatus according to claim 1, further comprising:

an accuracy calculation unit which calculates an accuracy when an object included in the image is recognized as the moving object; and

a correction unit which corrects the accuracy based on the similarity.

10. A non-transitory computer-readable storage medium storing a computer program for making a computer function as respective units included in an information processing apparatus according to claim 1.

6. An information processing method implemented by a processor executing:

a first acquisition step of acquiring a plurality of pieces of position information of an image sensing apparatus at times adjacent to an imaging time of an image by the image sensing apparatus;

a second acquisition step of acquiring, for each of a plurality of moving objects, a plurality of pieces of position information of the moving object at the adjacent times;

a calculation step of calculating, for each of the plurality of moving objects, a similarity between a route of the image sensing apparatus and a route of the moving object based on the plurality of pieces of position information of the image sensing apparatus and the plurality of pieces of position information of the moving object, wherein the similarity indicates a difference between the plurality of pieces of position information of the image sensing apparatus and the plurality of pieces of position information of the moving object, and the similarity is higher as the difference is smaller; and

a registration step of registering, as metadata of the image, information used to specify the moving object for which the similarity is higher than a pre-set threshold even if the moving object for which the similarity is higher than the pre-set threshold is not included in the image.