Automatic Imaging Method and Apparatus

• US 20070268369A1
• Filed: 04/28/2005
• Published: 11/22/2007
• Est. Priority Date: 04/28/2004
• Status: Abandoned Application

• Current Assignee: Chuo Electronics Co. Ltd.
• Original Assignee: Chuo Electronics Co. Ltd.
• Inventors: Sashikawa, Yoshinori, Amano, Shisai, Sashik'awa, Hisayo, Tsukidate, Mizuo
• Application Number:
  US11/579,169
• Publication Number:
  US 20070268369A1
• Time in Patent Office: Days
• US Class Current: 348/207.990
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

An automatic imaging method is provided that selects and images one target in a monitoring environment where multiple target candidates exist on input video images. The method acquires tracking video images of a target by steps of: estimating, for each block obtained by dividing an imaging region of input video image I, whether a part or all of an object to be tracked and imaged appears in the block, and extracting set of blocks P in which the object is estimated to appear; presetting N number of regions S_i (i=1, 2, 3 . . . N) of arbitrary shape on an imaging region of input video image I, together with priorities p_i (i=1, 2, 3 . . . N) of each region, examining correlations between the regions S_i and set of blocks P, and extracting and outputting connecting region T′ that overlaps with a region S_i having highest priority among connecting regions included in the set of blocks P and overlapping with any of regions S_i; and controlling second imaging means 2 to contain an object appearing in a region covered by connecting region T′ on input video image I in a field of view of second imaging means 2.

Claims

1. An automatic imaging method that controls second imaging means (2) that can change a line of sight, and performs tracking and imaging of a target that is detected based on an input video image I of first imaging means (1) to thereby acquire tracking video images of the target, wherein the video images of a target are acquired by steps comprising:

for each block obtained by dividing an imaging region of input video image I acquired from the first imaging means 1, estimating whether or not a part or all of an object to be tracked and imaged appears in the block, and extracting a set of blocks P in which the object is estimated to appear;

setting in advance N number of regions S_i (i=1, 2, 3 . . . N) of arbitrary shape on an imaging region of the input video image I, together with a priority p_i (i=1, 2, 3 . . . N) of each region, examining a correlation between the regions S_i and the set of blocks P, and extracting and outputting a connecting region T′

that has an overlap with a region S_i having a highest priority among connecting regions included in the set of blocks P and having an overlap with any of the regions S_i; and

controlling the second imaging means (2) so as to contain an object appearing in a region covered by a connecting region T′

on input video image I in a field of view of the second imaging means (2).

3. The automatic imaging method according to claim 1 or 2, further comprising providing:

imaging range correspondence means (19a) that calculates a range on which a field of view of the second imaging means (2) falls on a virtual global video image of a field of view that is equivalent to a range of a wide angle field of view that can contain an entire monitoring region from a position of the second imaging means (2); and

global video image update means (19b) that updates contents of a video image of a corresponding range on the global video image with a current video image that is input from the second imaging means (2); and

wherein a global video image that is updated based on a current video image of second imaging means (2) is output as input video image I.

4. The automatic imaging method according to claim 1 or 2 which is a method that examines a correlation between previously set regions S_i and a set of blocks P, extracts a connecting region T that has an overlap with a region S_i having a highest priority among connecting regions included in the set of blocks P and having an overlap with any of the regions S_i, and temporarily stores the connecting region T and a priority p of the region S_i overlapping therewith, and

outputs the temporarily stored connecting region T as a connecting region T′

, outputs the temporarily stored priority p as a priority p′

, and controls the second imaging means (2) so as to contain in a field of view of the second imaging means (2) an object that appears in a region that is covered by the connecting region T′

on an input video image I, to thereby acquire a tracking video image of a target;

wherein;

the connecting region T′

that is temporarily stored is replaced with a connecting region T that is selected from a current set of blocks P that are extracted from a current input video image I and the priority p′

that is temporarily stored is replaced with a priority p obtained together with the connecting region T only in a case where the current priority p is greater than or equal to the priority p′

; and

for a period in which the connecting region T is blank, a connecting region T₂′

that has an overlap with the temporarily stored connecting region T′

is extracted from a current set of blocks P that is extracted from a current input video image I, to update the connecting region T′

with the connecting region T₂′

.

5. The automatic imaging method according to claim 1 or 2, wherein an area E is previously set as a sense area for entry position imaging on an imaging region of an input video image I;

and

during a period in which the area E and the connecting region T′

overlap, tracking video images are acquired of a target appearing in the region E, without horizontally changing a field of view of the second imaging means (2).

6. The automatic imaging method according to claim 1 or 2, wherein an area R is previously set as a sense area for preset position imaging on an imaging region of an input video image I;

and

during a period in which the area R and the connecting region T′

overlap, a field of view of the second imaging means (2) is in a preset direction and range.

7. The automatic imaging method according to claim 4, wherein a connecting region M is previously set as an error detection and correction area on an imaging region of an input video image I;

and when a connecting region T′

is included in the connecting region M and an overlap arose between a periphery of the connecting region M and a set of blocks P that are extracted from the input video image I,

the connecting region T′

that is temporarily stored is replaced with a connecting region T′

of a set P that includes an overlap between the connecting region M and the set of blocks P.

2. An automatic imaging method that controls video image extracting means (18) that partially extracts a video image from an input video image I that is acquired from first imaging means (1) and outputs the extracted video image, to acquire tracking video images of a target based on the input video image I of the first imaging means (1), wherein the video images of a target are acquired by steps comprising:

for each block obtained by dividing an imaging region of input video image I acquired from the first imaging means (1), estimating whether or not a part or all of an object to be tracked and imaged appears in the block, and extracting a set of blocks P in which the object is estimated to appear;

setting in advance N number of regions S_i (i=1, 2, 3 . . . N) of arbitrary shape on an imaging region of the input video image I, together with a priority p_i (i=1, 2, 3 . . . N) of each region, examining a correlation between the regions S_i and the set of blocks P, and extracting and outputting a connecting region T′

that has an overlap with a region S_i having a highest priority among connecting regions included in the set of blocks P and having an overlap with any of the regions S_i; and

continuing to extract an image of an area covered by a connecting region T′

from the input video image I.

8. An automatic imaging apparatus, comprising:

first imaging means (1) that images an entire monitoring region;

second imaging means (27 that can change a line of sight;

pattern extraction means (3) that, for each block obtained by dividing an imaging region of an input video image I acquired from the first imaging means, estimates whether or not a part or all of an object to be tracked and imaged appears in the block, and outputs a set of blocks P in which the object is estimated to appear;

sense area storage means (5) that stores N number of regions S_i (i=1, 2, 3 . . . N) of arbitrary shape that are previously set on an imaging region of an input video image I, together with a priority p_i (i=1, 2, 3 . . . N) of each region,

sense means (4) that determines an overlap between the regions S_i and a set of blocks P that is output by the pattern extraction means (3), and when an overlap exists, outputs a pair consisting of a block B in which the overlap appears and a priority p_i of the region S_i having the overlap;

target selection means (6) that selects a pair with a highest priority (priority p) among pairs of overlapping block B and priority p_i thereof that are output by the sense means (4), and extracts a connecting region T that includes the block B from the set of blocks P;

pattern temporary storage means (21) that temporarily stores the connecting region T selected with the target selection means (6), and outputs the connecting region T as a connecting region T′

;

priority temporary storage means (22) that temporarily stores a priority p that is selected by the target selection means (6) and outputs the priority p as a priority p′

; and

imaging control means (8) that controls the second imaging means (2) so as to contain an object appearing in a region covered by the connecting region T′

on the input video image I in a field of view of the second imaging means (2);

wherein the connecting region T′

that is temporarily stored is replaced with a connecting region T that is selected from a current set of blocks P that are extracted from a current input video image I and the priority p′

that is temporarily stored is replaced with a priority p that is obtained together with the connecting region T only in a case where the current priority p is greater than or equal to the priority p′

, and

during a period in which the connecting region T is blank, a connecting region T₂′

that has an overlap with the temporarily stored connecting region T′

is extracted from a current set of blocks P extracted from a current input video image I, to update the connecting region T′

with the connecting region T₂′

.

9. An automatic imaging apparatus, comprising:

first imaging means (1) that images an entire monitoring region;

pattern extraction means (3) that, for each block obtained by dividing an imaging region of an input video image I acquired from the first imaging means, estimates whether or not a part or all of an object to be tracked and imaged appears in the block, and outputs a set of blocks P in which the object is estimated to appear;

sense area storage means (5) that stores N number of regions S_i (i=1, 2, 3 . . . N) of arbitrary shape that are previously set on an imaging region of an input video image I, together with a priority p_i (i=1, 2, 3 . . . N) of each region,

sense means (4) that determines an overlap between the regions S_i and a set of blocks P that is output by the pattern extraction means (3), and when an overlap exists, outputs a pair consisting of a block B in which the overlap appears and a priority p_i of the region S_i having the overlap;

target selection means (6) that selects a pair with a highest priority (priority p) among pairs of overlapping block B and priority p_i thereof that are output by the sense means (4), and extracts a connecting region T that includes the block B from the set of blocks P;

pattern temporary storage means (21) that temporarily stores the connecting region T selected by the target selection means (6), and outputs the connecting region T as a connecting region T′

;

priority temporary storage means (22) that temporarily stores a priority p that is selected by the target selection means (6) and outputs the priority p as a priority p′

; and

video image extracting means (18) that continuously extracts images of a region covered by the connecting region T′

on the input video image I and outputs the images;

wherein the connecting region T′

that is temporarily stored is replaced with a connecting region T that is selected from a current set of blocks P that are extracted from a current input video image I and the priority p′

that is temporarily stored is replaced with a priority p that is obtained together with the connecting region T only in a case where the current priority p is greater than or equal to the priority p′

, and

during a period in which the connecting region T is blank, a connecting region T₂′

that has an overlap with the temporarily stored connecting region T′

is extracted from a current set of blocks P extracted from a current input video image I, to update the connecting region T′

with the connecting region T₂′

.

10. An automatic imaging apparatus, comprising:

second imaging means (2) that can change a line of sight;

imaging range correspondence means (19a) that calculates a range on which a field of view of the second imaging means (2) falls on a virtual global video image of a field of view that is equivalent to a range of a wide angle field of view that can contain an entire monitoring region from a position of the second imaging means (2);

global video image update means (19b) that updates contents of a video image of a corresponding range on the global video image with a current video image from the second imaging means (2), to continuously output a current global video image;

pattern extraction means (3) that, for each block obtained by dividing an imaging region of an input video image I that is output from the global video image update means (19b), estimates whether or not a part or all of an object to be tracked and imaged appears in the block, and outputs a set of blocks P in which the object is estimated to appear;

sense area storage means (5) that stores N number of regions S_i (i=1, 2, 3 . . . N) of arbitrary shape that are previously set on an imaging region of an input video image I, together with a priority p_i (i=1, 2, 3 . . . N) of each region;

sense means (4) that determines an overlap between the regions S_i and a set of blocks P output by the pattern extraction means (3), and when an overlap exists, outputs a pair consisting of a block B in which the overlap appears and a priority p_i of the region S_i having the overlap;

target selection means (6) that selects a pair with a highest priority (priority p) among pairs of overlapping block B and priority p_i thereof that are output by the sense means (4), and extracts a connecting region T that includes the block B from the set of blocks P;

pattern temporary storage means (21) that temporarily stores the connecting region T selected by the target selection means (6), and outputs the connecting region T as a connecting region T′

;

priority temporary storage means (22) that temporarily stores a priority p that is selected by the target selection means (6) and outputs the priority p as a priority p′

; and

imaging control means (8) that controls the second imaging means (2) so as to contain an object appearing in a region covered by the connecting region T′

on the input video image I in a field of view of the second imaging means (2);

wherein the connecting region T′

that is temporarily stored is replaced with a connecting region T that is selected from a current set of blocks P that are extracted from a current input video image I and the priority p′

that is temporarily stored is replaced with a priority p that is obtained together with the connecting region T only in a case where the current priority p is greater than or equal to the priority p′

, and

during a period in which the connecting region T is blank, a connecting region T₂′

that has an overlap with the temporarily stored connecting region T′

is extracted from a current set of blocks P extracted from a current input video image I, to update the connecting region T′

with the connecting region T₂′

.