Image processing apparatus, image processing method, and non-transitory recording medium storing computer readable program

• US 10,445,566 B2
• Filed: 01/07/2015
• Issued: 10/15/2019
• Est. Priority Date: 03/05/2014
• Status: Active Grant

• Current Assignee: Konica Minolta Inc.
• Original Assignee: Konica Minolta Inc.
• Inventors: Sashida, Takehiko, Kudo, Yuta, Aoki, Yoshimitsu
• Primary Examiner(s): Park, Edward
• Application Number:
  US15/123,235
• Publication Number:
  US 20170076148A1
• Time in Patent Office: 1,742 Days
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

Image processing apparatus capable of detecting a person independently of the positional relationship between a camera and the person. The image processing apparatus (100) detects a human region included in an input image. The image processing apparatus (100) includes: head detection unit (210) for detecting head position of a person in an input image; determination unit (220) for determining a relative positional relationship between the head and another body part in the input image with use of feature amounts extracted from an image region around the head position detected by head detection unit (210); and human detection unit (230) for setting at least one of the direction of searching for a human region and the region of searching for the human region in accordance with a relative relation determined by determination unit (220), and detecting the human region from the input image.

Claims

1. An image processing apparatus comprising:

a hardware processor that;

receives an input image of a person, including a head of the person and other body parts, the input image including a distance image having distances to respective points on the surface of a subject,

detects a position of the head of the person in the input image,

determines a relative positional relationship between the head and another body part in the input image with the use of feature amounts extracted from an image region around the detected position of the head, the feature amounts including a distribution of a normal vector to the surface of the subject extracted from the distance image,

sets at least one of the direction of searching for a human region and the region of searching for the human region in accordance with the determined relative positional relationship,

detects the human region from the input image,

detects a position of the head of the person based on a distribution of distances extracted from the distance image, and

determines the relative positional relationship from the orientation in which distribution of a normal vector to the surface of the trunk of the person exists in the distribution of the normal vector in the image region around the head.

2. The image processing apparatus according to claim 1, wherein the hardware processor searches for feature amounts indicative of the trunk of the person from the feature amounts extracted from the image region around the head, and determines the orientation of the trunk relative to the head as the relative positional relationship.

3. The image processing apparatus according to claim 1, wherein

the hardware processor further detects the size of the head of the person in the input image, and decides the size of the image region around the head from which the feature amounts are to be extracted, depending on the size of the head.

4. The image processing apparatus according to claim 3, wherein the hardware processor detects the human region in the input image with limitation to at least one of the direction of searching for the human region and the region of searching for the human region, depending on at least one of the position of the trunk in the input image obtained by searching, the position of the head in the input image, and the size of the head.

5. The image processing apparatus according to claim 1, wherein

the relative positional relationship includes the orientation of the human body indicative of the orientation of another body part relative to the head in the input image, and

the hardware processor performs matching process while rotating one of a template for use in search for the human region and the input image depending on the orientation of the human body, and detects the human region in the input image.

6. An image processing apparatus comprising:

a hardware processor that;

receives an input image of a person, including a head of the person and other body parts, the input image including a distance image having distances to respective points on the surface of a subject,

detects a position of the head of the person in the input image,

determines a relative positional relationship between the head and another body part in the input image with the use of feature amounts extracted from an image region around the detected position of the head, the feature amounts including a relative distance to the subject from the position of the head extracted from the distance image,

sets at least one of the direction of searching for a human region and the region of searching for the human region in accordance with the determined relative positional relationship,

detects the human region from the input image,

detects a position of the head based on a distribution of distances extracted from the distance image, and

determines the relative positional relationship from the orientation in which a region having a specific or larger number of pixels with smaller values of the relative distance than a predetermined value exists in the image region around the head.

7. The image processing apparatus according to claim 6, wherein the hardware processor searches for feature amounts indicative of the trunk of the person from the feature amounts extracted from the image region around the head, and determines the orientation of the trunk relative to the head as the relative positional relationship.

8. The image processing apparatus according to claim 6, wherein

the hardware processor further detects the size of the head of the person in the input image, and decides the size of the image region around the head from which the feature amounts are to be extracted, depending on the size of the head.

9. The image processing apparatus according to claim 8, wherein the hardware processor detects the human region in the input image with limitation to at least one of the direction of searching for the human region and the region of searching for the human region, depending on at least one of the position of the trunk in the input image obtained by searching, the position of the head in the input image, and the size of the head.

10. The image processing apparatus according to claim 6, wherein

the relative positional relationship includes the orientation of the human body indicative of the orientation of another body part relative to the head in the input image, and

the hardware processor performs matching process while rotating one of a template for use in search for the human region and the input image depending on the orientation of the human body, and detects the human region in the input image.

11. An image processing apparatus comprising:

a hardware processor that;

receives an input image of a person, including a head of the person and other body parts, the input image including a distance image having distances to respective points on the surface of a subject,

detects a position of the head of the person in the input image,

determines a relative positional relationship between the head and another body part in the input image with the use of feature amounts extracted from an image region around the detected position of the head, the feature amounts including differences in distance from a background acquired by taking the differences between a background distance image obtained by shooting the background without the person and the distance image,

sets at least one of the direction of searching for a human region and the region of searching for the human region in accordance with the determined relative positional relationship,

detects the human region from the input image,

detects a position of the head of the person is detected based on a distribution of distances extracted from the distance image, and

determines the relative positional relationship from the orientation in which a region having a specific or larger number of pixels with larger values of the distance differences than a predetermined value exists in the image region around the head.

12. The image processing apparatus according to claim 11, wherein the hardware processor searches for feature amounts indicative of the trunk of the person from the feature amounts extracted from the image region around the head, and determines the orientation of the trunk relative to the head as the relative positional relationship.

13. The image processing apparatus according to claim 11, wherein

the hardware processor further detects the size of the head of the person in the input image, and decides the size of the image region around the head from which the feature amounts are to be extracted, depending on the size of the head.

14. The image processing apparatus according to claim 13, wherein the hardware processor detects the human region in the input image with limitation to at least one of the direction of searching for the human region and the region of searching for the human region, depending on at least one of the position of the trunk in the input image obtained by searching, the position of the head in the input image, and the size of the head.

15. The image processing apparatus according to claim 11, wherein

the relative positional relationship includes the orientation of the human body indicative of the orientation of another body part relative to the head in the input image, and

the hardware processor performs matching process while rotating one of a template for use in search for the human region and the input image depending on the orientation of the human body, and detects the human region in the input image.

16. An image processing apparatus comprising:

a hardware processor that;

receives an input image of a person, including a head of the person and other body parts,

detects a position of the head of a person in the input image,

determines a relative positional relationship between the head and another body part in the input image with the use of feature amounts extracted from an image region around the detected position of the head, the feature amounts including edge information extracted from the input image,

sets at least one of the direction of searching for a human region and the region of searching for the human region in accordance with the determined relative positional relationship, and

detects the human region from the input image,

wherein the detected relative positional relationship is determined from the orientation in which two parallel edges exist in the edge information in the image region around the detected position of the head.

17. The image processing apparatus according to claim 16, wherein the hardware processor searches for feature amounts indicative of the trunk of the person from the feature amounts extracted from the image region around the head, and determines the orientation of the trunk relative to the head as the relative positional relationship.

18. The image processing apparatus according to claim 16, wherein

the hardware processor further detects the size of the head of the person in the input image, and decides the size of the image region around the head from which the feature amounts are to be extracted, depending on the size of the head.

19. The image processing apparatus according to claim 18, wherein the hardware processor detects the human region in the input image with limitation to at least one of the direction of searching for the human region and the region of searching for the human region, depending on at least one of the position of the trunk in the input image obtained by searching, the position of the head in the input image, and the size of the head.

20. The image processing apparatus according to claim 16, wherein

the relative positional relationship includes the orientation of the human body indicative of the orientation of another body part relative to the head in the input image, and

the hardware processor performs matching process while rotating one of a template for use in search for the human region and the input image depending on the orientation of the human body, and detects the human region in the input image.