IMAGE PROCESSING APPARATUS AND IMAGE PROCESSING METHOD

• US 20100177159A1
• Filed: 01/07/2010
• Published: 07/15/2010
• Est. Priority Date: 01/09/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tojo, Hiroshi
• Granted Patent: US 8,797,381 B2
• Time in Patent Office: Days
• US Class Current: 348/14.160
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/77 using statistical methods
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

An image processing apparatus includes a photographing unit configured to generate a plurality of images by photographing a plurality of times a range which can be photographed, an object detection unit configured to detect a specified object from each of the plurality of images generated by the photographing unit, a position determination unit configured to determine an existing position of the specified object based on a detection result of the specified object in the plurality of images, and a range determination unit configured to determine a photographing range to be photographed within the range which can be photographed based on the existing position of the specified object determined by the position determination unit.

Claims

1. An image processing apparatus comprising:

a photographing unit configured to generate a plurality of images by photographing a plurality of times a range which can be photographed;

an object detection unit configured to detect a specified object from each of the plurality of images generated by the photographing unit;

a position determination unit configured to determine an existing position of the specified object based on a detection result of the specified object in the plurality of images; and

a range determination unit configured to determine a photographing range to be photographed within the range which can be photographed based on the existing position of the specified object determined by the position determination unit.

2. The image processing apparatus according to claim 1, further comprising a control unit configured to control the photographing unit to generate a frame image of the photographing range determined by the range determination unit.

3. The image processing apparatus according to claim 2, further comprising a transmission unit configured to transmit the frame image of the photographing range generated by the range photographing unit.

4. The image processing apparatus according to claim 2, wherein the control unit controls the photographing unit by performing pan, tilt, and zoom control.

5. The image processing apparatus according to claim 2, wherein the range determination unit includes a calculation unit configured to calculate, based on the existing position of the specified object in the plurality of images, an object exiting probability distribution of an object existing within the range that can be photographed by the photographing unit and determines the photographing range of the frame image based on the calculated object existing probability distribution.

6. The image processing apparatus according to claim 5, wherein the calculation unit calculates the object existing probability distribution by generating, with respect to object regions during a predetermined time detected by the object detection unit, a histogram of number of detected objects at respective representative positions in the object regions.

7. The image processing apparatus according to claim 6, wherein the calculation unit calculates the object existing probability distribution by generating a histogram for each size of object regions detected by the object detection unit.

8. The image processing apparatus according to claim 6, wherein the calculation unit changes a representative position in the object region according to a position of the object region detected by the object detection unit.

9. The image processing apparatus according to claim 5, wherein the calculation unit calculates the object existing probability distribution by summing a likelihood of detecting an object by the object detection unit for a predetermined time for each of a plurality of positions within a range which can be photographed.

10. The image processing apparatus according to claim 5, wherein the range determination unit extracts a peak of the object existing probability distribution and determines a photographing range based on the extracted peak.

11. The image processing apparatus according to claim 10, wherein the range determination unit extracts a peak of the object existing probability distribution and determines a photographing range so that the extracted peak satisfies a predetermined condition.

12. The image processing apparatus according to claim 10, wherein the range determination unit extracts a peak of the object existing probability distribution from both ends of the frame image towards a center of the frame image.

13. The image processing apparatus according to claim 10, further comprising a state determination unit configured to determine a state of a peak in the object existing probability distribution,

wherein the range determination unit determines a photographing range based on a peak determined to be stable by the state determination unit.

14. An image processing method comprising:

generating a plurality of images by photographing a plurality of times a range which can be photographed;

detecting a specified object from each of the generated plurality of images;

determining an existing position of the specified object based on a detection result of the specified object in the plurality of images; and

determining a photographing range to be photographed within the range which can be photographed based on the determined existing position of the specified object.

15. A computer-readable storage medium storing a program for causing a computer to execute the image processing method according to claim 14.