Image processing apparatus and image processing method

• US 8,797,381 B2
• Filed: 01/07/2010
• Issued: 08/05/2014
• Est. Priority Date: 01/09/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tojo, Hiroshi
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US12/684,012
• Publication Number:
  US 20100177159A1
• Time in Patent Office: 1,671 Days
• Field of Search: 340/435, 340/539.1, 348/14.16, 348/180, 348/229.1, 348/240.1, 348/345, 348/370, 356/3.08, 378/19, 382/103, 382/106, 382/254, 382/107, 382/209, 382/228, 396/55, 396/122, 396/234, 701/469, 706/46, 715/856
• US Class Current: 348/14.16
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/77 using statistical methods
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

An image processing apparatus includes a photographing unit configured to generate a plurality of images by photographing a plurality of times a range which can be photographed, an object detection unit configured to detect a specified object from each of the plurality of images generated by the photographing unit, a position determination unit configured to determine an existing position of the specified object based on a detection result of the specified object in the plurality of images, and a range determination unit configured to determine a photographing range to be photographed within the range which can be photographed based on the existing position of the specified object determined by the position determination unit.

Claims

1. An image processing apparatus comprising:

a photographing unit configured to generate a plurality of images by photographing a plurality of times within a first photographing range which can be photographed;

an object detection unit configured to detect at least one specified object from each of the plurality of images generated by the photographing unit;

a position determination unit configured to determine each of existing positions at which the specified object may exist based on detection results of the specified object in the plurality of images;

a distribution calculation unit configured to calculate, based on the existing positions of the specified object in the plurality of images, a probability distribution of the specified object existing within the first photographing range; and

a photographing range setting unit configured to set a second photographing range which should be used to photograph an image subsequent to the plurality of images, within the first photographing range, based on the probability distribution of the specified object existing calculated by the distribution calculation unit.

2. The image processing apparatus according to claim 1, further comprising a control unit configured to control the photographing unit to generate a frame image of the photographing range set by the range setting unit.

3. The image processing apparatus according to claim 2, further comprising a transmission unit configured to transmit the frame image of the photographing range generated by the range setting unit.

4. The image processing apparatus according to claim 2, wherein the control unit controls the photographing unit by performing pan, tilt, and zoom control.

5. The image processing apparatus according to claim 1, wherein the calculation unit calculates the object existing probability distribution by generating, with respect to object regions during a predetermined time detected by the object detection unit, a histogram of number of detected objects at respective representative positions in the object regions.

6. The image processing apparatus according to claim 5, wherein the calculation unit calculates the object existing probability distribution by generating a histogram for each size of object regions detected by the object detection unit.

7. The image processing apparatus according to claim 5, wherein the calculation unit changes a representative position in the object region according to a position of the object region detected by the object detection unit.

8. The image processing apparatus according to claim 1, wherein the calculation unit calculates the object existing probability distribution by summing a likelihood of detecting an object by the object detection unit for a predetermined time for each of a plurality of positions within a range which can be photographed.

9. The image processing apparatus according to claim 1, wherein the range setting unit extracts a peak of the object existing probability distribution and sets a photographing range based on the extracted peak.

10. The image processing apparatus according to claim 9, wherein the range setting unit extracts a peak of the object existing probability distribution and sets a photographing range so that the extracted peak satisfies a predetermined condition.

11. The image processing apparatus according to claim 9, wherein the range setting unit extracts a peak of the object existing probability distribution from both ends of the frame image towards a center of the frame image.

12. The image processing apparatus according to claim 9, further comprising a state determination unit configured to determine a state of a peak in the object existing probability distribution,

wherein the range setting unit sets a photographing range based on a peak determined to be stable by the state determination unit.

13. An image processing method comprising:

generating a plurality of images by photographing a plurality of times within a first photographing range which can be photographed;

detecting at least one specified object from each of the generated plurality of images;

determining each of existing positions at which the specified object may exist based on detection results of the specified object in the plurality of images;

calculating, based on the existing positions of the specified object in the plurality of images, a probability distribution of the specified object existing within the first photographing range; and

setting a second photographing range which should be used to photograph an image subsequent to the plurality of images, within the first photographing range, based on the calculated probability distribution of the specified object existing.

14. A computer-readable storage medium storing a program for causing a computer to execute the image processing method according to claim 13.