Image processing apparatus, method and program for facilitating retrieval of an individual group using a list of groups, a list of selected group members and a list of members of the groups excluding the selected group members

• US 8,285,008 B2
• Filed: 09/16/2009
• Issued: 10/09/2012
• Est. Priority Date: 10/01/2008
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Ishii, Akiyoshi
• Primary Examiner(s): Repko, Jason M
• Assistant Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US12/560,912
• Publication Number:
  US 20100080423A1
• Time in Patent Office: 1,119 Days
• Field of Search: 382/118, 382/218
• US Class Current: 382/118
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks

Abstract

The image processing apparatus displays a list of individual information from which individual information selected by the individual information selecting unit and individual information lapped over the individual information included in the retrieved individual groups are excluded from individual information included in individual groups retrieved by the individual group retrieval unit, and the individual group retrieval unit narrows down individual groups to be retrieved by adding on individual information designated from the individual information displayed in the list.

Claims

1. An image processing apparatus comprising:

an image detection unit configured to detect whether an image matching a predetermined conditions exists in input video;

an image analyzing unit configured to acquire a feature data that is indicative of a feature of an image from the image detected by said image detection unit;

an image identifying unit configured to compare the feature data of a plurality of images detected by said image detection unit and identifying whether the images are images in which the same individual is shot;

a storage unit configured to store individual information of an individual identified by said image identifying unit and

a combination of a plurality of individual information as an individual group;

an individual information selecting unit configured to select individual information from among a plurality of individual information;

an individual group retrieval unit configured to retrieve one or a plurality of individual groups that include the individual information selected by said individual information selecting unit; and

an interface unit configured to display a first list comprised of the one of the plurality of individual groups retrieved by said individual group retrieval unit,

a second list including individual information selected by said individual information selecting unit, and a third list comprised of individual information which is included in individual groups including all individual information included in the second list and is not included in the second list,

wherein the individual information selecting unit selects any one of the individual information from among the individual information included in the third list in response to a user designation, and the interface unit updates the second list by adding the individual information selected from the third list by the individual information selecting unit and updates the third list so as to correspond to the updated second list.

2. The apparatus according to claim 1, wherein the individual information selecting unit selects any one of the individual information from among the individual information included in the second list in response to a user designation, and the interface unit updates the second list by deleting the individual information selected by the individual information selecting unit from the second list and updates the third list so as to correspond to the updated second list.

3. The apparatus according to claim 1, wherein said storage unit stores a combination of all individual information identified in a video section comprising a plurality of video, as the individual group in association with the video section.

4. The apparatus according to claim 1, further comprising a video retrieval unit configured to retrieve, from one or a plurality of individual groups, video associated with the one or the plurality of individual groups.

5. The apparatus according to claim 1, wherein said image detection unit detects whether a person'"'"'s face is present as an image that matches the predetermined conditions;

and

said image analyzing unit acquires feature data for identifying the face individually from the person'"'"'s face detected by said image detection unit.

6. The apparatus according to claim 5, wherein said image identifying unit handles every person as a single individual and identifies whether a plurality of faces detected by said image detection unit are those of the same person.

7. The apparatus according to claim 3, wherein the video section is video continuously shot from the start of one recording operation to the end of the recording operation.

8. The apparatus according to claim 3, wherein the video section is video that is the result of partitioning video stored in the image processing apparatus, at a predetermined time intervals.

9. The apparatus according to claim 3, wherein the video section is video that is the result of partitioning video stored in the image processing apparatus, into a predetermined date-and-time sections.

10. An image processing method comprising:

an image detection step of detecting whether an image matching a predetermined conditions exists in input video;

an image analyzing step of acquiring a feature data that is indicative of a feature of an image from the image detected in said image detection step;

an image identifying step of comparing the feature data of a plurality of images detected in said image detection step and identifying whether the images are images in which the same individual is shot;

a storage step of storing individual information of an individual identified in said image identifying step and

a combination of a plurality of individual information as an individual group;

an individual information selecting step of selecting individual information from among a plurality of individual information;

an individual group retrieval step of retrieving one or a plurality of individual groups that include individual information selected in said individual information selecting unit; and

an interface step of displaying a first list comprised of the one of the plurality of individual groups retrieved in said individual group retrieval step,

a second list including individual information selected in said individual information selecting step, and a third list comprised of individual information which is included in individual groups including all individual information included in the second list and is not included in the second list,

wherein in said individual information selecting step, any one of the individual information is selected from among the individual information included in the third list in response to a user designation, and in the interface step, the second list is updated by adding the individual information selected from the third list by the individual information selecting step and the third list is updated so as to correspond to the updated second list.

11. The method according to claim 10, wherein in the individual information selecting step, any one of the individual information is selected from among the individual information included in the second list in response to a user designation, and in the interface step, the second list is updated by deleting the individual information selected by the individual information selecting step from the second list and the third list is updated so as to correspond to the updated second list.

12. The method according to claim 10, wherein said storage step stores a combination of all individual information identified in a video section comprising a plurality of video, as the individual group in association with the video section.

13. The method according to claim 10, further comprising a video retrieval step of retrieving, from one or a plurality of individual groups, video associated with the one or plurality of individual groups.

14. The method according to claim 10, wherein said image detection step detects whether a person'"'"'s face is present as an image that matches the predetermined conditions;

and

said image analyzing step acquires feature data for identifying the face individually from the person'"'"'s face detected in said image detection step.

15. The method according to claim 14, wherein said image identifying step handles every person as a single individual and identifies whether a plurality of faces detected in said image detection step are those of the same person.

16. The method according to claim 12, wherein the video section is video continuously shot from the start of one recording operation to the end of the recording operation.

17. The method according to claim 12, wherein the video section is video that is the result of partitioning video stored in an image processing apparatus, at a predetermined time intervals.

18. The method according to claim 12, wherein the video section is video that is the result of partitioning video stored in an image processing apparatus, into a predetermined date-and-time sections.

19. A non-transitory storage medium storing a program for causing a computer to execute an image processing method comprising:

an image detection step of detecting whether an image matching a predetermined conditions exists in input video;

an image analyzing step of acquiring a feature data that is indicative of a feature of an image from the image detected in said image detection step;

an image identifying step of comparing the feature data of a plurality of images detected in said image detection step and identifying whether the images are images in which the same individual is shot;

a storage step of storing individual information of an individual identified in said image identifying step and a combination of a plurality of individual information as an individual group;

an individual information selecting step of selecting individual information from among a plurality of individual information;

an individual group retrieval step of retrieving one or a plurality of individual groups that includes the individual information selected in said individual information selecting step; and

an interface step of displaying a first list comprised of the one of the plurality of individual groups retrieved in said individual group retrieval step, a second list including individual information selected in said individual information selecting step, and a third list comprised of individual information which is included in individual groups including all individual information included in the second list and is not included in the second list,

wherein in said individual information selecting step, any one of the individual information is selected from among the individual information included in the third list in response to a user designation, and in said interface step, the second list is updated by adding the individual information selected from the third list in said individual information selecting step and the third list is updated so as to correspond to the updated second list.