Image processing apparatus, imaging device, image processing method, and program

• US 20100142762A1
• Filed: 11/06/2009
• Published: 06/10/2010
• Est. Priority Date: 12/09/2008
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Morita, Yugo
• Granted Patent: US 8,503,735 B2
• Time in Patent Office: Days
• US Class Current: 382/115
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06V 20/35 Categorising the entire scene, e.g. birthday party or wedding scene
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

An image processing apparatus includes: a depth-of-relationship value calculation unit that regards a person, who appears in any of a plurality of contents, as a specific person, and calculates a depth-of-relationship value, which indicates the degree of depth of the relationship between the specific person and a second person, on the basis of an appearance frequency of the second person or a third person other than the second person in contents in which the specific person appears, and the appearance frequencies of the second person and the third person in contents in which the specific person does not appear; and a priority determination unit that determines a priority, which is assigned to the second person relating to the specific person among the persons appearing in the plurality of contents, on the basis of the calculated depth-of-relationship value.

Claims

1. An image processing apparatus comprising:

a depth-of-relationship value calculation unit that regards a person, who appears in any of a plurality of contents, as a specific person, and calculates a depth-of-relationship value, which indicates the degree of depth of the relationship between the specific person and a second person, on the basis of an appearance frequency of the second person or a third person other than the second person in contents in which the specific person appears, and the appearance frequencies of the second person and the third person in contents in which the specific person does not appear; and

a priority determination unit that determines a priority, which is assigned to the second person relating to the specific person among the persons appearing in the plurality of contents, on the basis of the calculated depth-of-relationship value.

2. The image processing apparatus according to claim 1, wherein the depth-of-relationship value calculation unit calculates scores to be given to pairs of persons, who appear in the plurality of contents, on the basis of the appearance frequencies of the pairs of persons, who appear together in the same contents, among the persons appearing in the plurality of contents, and calculates the depth-of-relationship value on the basis of the score given to the pair of the specific person and the second person, the score given to the pair of the specific person and the third person, and the score given to the pair of the second person and the third person.

3. The image processing apparatus according to claim 2, wherein

the depth-of-relationship value calculation unit calculates a first depth-of-relationship value on the basis of the score given to the pair of the specific person and the second person, and calculates a second depth-of-relationship value on the basis of the score given to the pair of the third person and the specific person and the score given to the pair of the second person and the third person;

and

the priority determination unit determines the priority on the basis of the calculated first depth-of-relationship value and second depth-of-relationship value.

4. The image processing apparatus according to claim 3, wherein the priority determination unit calculates the depth-of-relationship value on the basis of values obtained by weighting the calculated first depth-of-relationship value and second depth-of-relationship value.

5. The image processing apparatus according to claim 1, further comprising an output control unit that controls output of the plurality of contents according to the determined priority.

6. The image processing apparatus according to claim 1, wherein the depth-of-relationship value calculation unit calculates scores, which are given to pairs of persons appearing in the plurality of contents, on the basis of appearance frequencies of the pairs of persons, who appear together in the same contents, among the persons appearing in the plurality of contents, and the numbers of the persons who appear together in the same contents, and calculates the depth-of-relationship value on the basis of the score given to the pair of the specific person and the second person, the score given to the pair of the specific person and the third person, and the score given to the pair of the second person and the third person.

7. The image processing apparatus according to claim 1, wherein the depth-of-relationship value calculation unit calculates scores to be given to pairs of persons, who appear in the plurality of contents, on the basis of appearance frequencies of the pairs of persons, who appear together in the same contents, among the persons appearing in the plurality of contents, and distances between the pairs of persons appearing together in the same contents, and calculates the depth-of-relationship value on the basis of the score given to the pair of the specific person and the second person, the score given to the pair of the specific person and the third person, and the score given to the pair of the second person and the third person.

8. The image processing apparatus according to claim 1, wherein

the content includes a plurality of frames occupying a predetermined interval included in a motion picture;

and

the depth-of-relationship value calculation unit calculates the scores to be given to pairs of persons, who appear in the motion picture, on the basis of the appearance frequencies of the pairs of persons, who appear within the same intervals, among the persons appearing in the motion picture, and the periods during which the pairs of persons appear in the same frames within the same intervals, and calculates the depth-of-relationship value on the basis of the score given to the pair of the specific person and the second person, the score given to the pair of the specific person and the third person, and the score given to the pair of the second person and the third person.

9. An image processing apparatus comprising:

a discrimination information memory unit in which pieces of discrimination information for use in discriminating faces of persons from one another are stored;

a manipulation recognition unit that recognizes a designating manipulation performed to designate one of the persons, who have the pieces of discrimination information thereon stored, as a specific person;

a contents input unit that inputs a plurality of contents;

a face detection unit that detects faces appearing in the inputted contents;

a face discrimination unit that discriminates the detected faces from one another on the basis of the pieces of discrimination information;

a depth-of-relationship value calculation unit that specifies persons, who appear in the plurality of contents, on the basis of the results of discrimination, and calculates a depth-of-relationship value, which indicate the degree of depth of the relationship between the specific person and a second person, on the basis of an appearance frequency of the second person or a third person other than the second person in contents in which the specific person appears, and the appearance frequencies of the second person and the third person in contents in which the specific person does not appear;

a priority determination unit that determines a priority, which is assigned to the second person relating to the specific person among the persons appearing in the plurality of contents, on the basis of the calculated depth-of-relationship value; and

an output control unit that controls output of the inputted contents according to the determined priority.

10. An imaging device comprising:

an imaging unit that images subjects and produces images;

a depth-of-relationship value calculation unit that regards a person, who appears in any of the produced images, as a specific person, and calculates a depth-of-relationship value, which indicates the degree of depth of the relationship between the specific person and a second person, on the basis of an appearance frequency of the second person or a third person other than the second person in images in which the specific person appears, and the appearance frequencies of the second person and the third person in images in which the specific person does not appear;

a priority determination unit that determines priority, which is assigned to the second person relating to the specific person among the persons appearing in the produced images, on the basis of the calculated depth-of-relationship value; and

an imaging control unit that designates an imaging parameter, which is employed in production of the images by the imaging unit, according to the determined priority.

11. An image processing method comprising the steps of:

regarding a person, who appears in any of a plurality of contents, as a specific person, and calculating a depth-of-relationship value, which indicate the degree of depth of the relationship between the specific person and a second person, on the basis of an appearance frequency of the second person or a third person other than the second person in contents in which the specific person appears, and the appearance frequencies of the second person and the third person in contents in which the specific person does not appear; and

determining a priority, which is assigned to the second person relating to the specific person among the persons appearing in the plurality of contents, on the basis of the calculated depth-of-relationship value.

12. A program causing a computer to execute the steps of:

regarding a person, who appears in any of a plurality of contents, as a specific person, and calculating a depth-of-relationship value, which indicates the degree of depth of the relationship between the specific person and a second person, on the basis of an appearance frequency of the second person or a third person other than the second person in contents in which the specific person appears, and the appearance frequencies of the second person and the third person in contents in which the specific person does not appear; and

determining a priority, which is assigned to the second person relating to the specific person among the persons appearing in the plurality of contents, on the basis of the calculated depth-of-relationship value.