Video camera capable of automatic target tracking

• US 5,631,697 A
• Filed: 06/02/1995
• Issued: 05/20/1997
• Est. Priority Date: 11/27/1991
• Status: Expired due to Term

• Current Assignee: Hitachi Consumer Electronics Company Limited (Hitachi, Ltd.)
• Original Assignee: Hitachi, Ltd.
• Inventors: Nishimura, Ryuji, Imaide, Takuya, Oda, Mayuko
• Primary Examiner(s): BRINICH, STEPHEN M
• Application Number:
  US08/458,682
• Time in Patent Office: 718 Days
• Field of Search: 348/169-172, 348/352, 348/354, 348/356, 348/362-364, 348/345, 348/349, 358/452-453
• US Class Current: 348/172
• CPC Class Codes: G01S 3/7865 using correlation of the live video image with a stored image
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

An image signal provided by an image pickup device, such as a CCD, is converted into a video signal by a signal processor. An extraction means extracts a candidate object region from the current video signal and an object region determined a certain time before by a decision means is read from a memory. For example, the decision means compares an overlapping region in which the candidate object region and the object region read from the memory overlap each other and provides a new object region a size larger than the overlapping region and replace the object region with the new object region to update the contents of the memory. On the other hand, a calculating means calculates the features of the object region including the position of the centroid of the object region on a screen. A control means, such as a microcomputer, controls the image pick up device on the basis of information about the features so that a region including the target object substantially in its central part is cut out as a video signal. Consequently, the target object can be surely tracked regardless of objects other than the target object included in a scene.

Claims

1. A video camera comprising:

an image pickup device having a plurality of light receiving elements in a two-dimensional arrangement on an imaging surface thereof for producing an image signal through the photoelectric conversion of an optical image focused on the imaging surface by a lens unit;

a driver which drives the image pickup device to read the image signal from a part of the light receiving elements located in a specified region of the imaging surface;

a signal processor which produces a video signal indicating the luminance and chrominance on the basis of the image signal;

a target tracking processor which processes the video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and

a controller which continuously determines a location of the specified region of the imaging surface representing the current object region, so that the object region is located substantially in the center of the specified region, the controller providing an output to the driver for specifying the location of the specified region;

wherein the target tracking processor is provided with an extractor which makes a decision as to whether or not the video signal meets the predetermined conditions and generates an extraction signal representing an extracted region meeting the predetermined conditions; and

wherein the predetermined conditions require that the luminance and chrominance of the video signal are within fixed ranges, respectively.

2. A video camera according to claim 1, wherein the predetermined conditions require that the luminance and chrominance of the video signal are within ranges of luminance and chrominance corresponding to those of flesh color.

3. A video camera according to claim 1, wherein the target tracking processor is further provided with a memory for storing the object region determined a certain time before and a comparator which compares the contents of the memory and the extraction signal and generates a signal representing an overlapping region in a region represented by the extraction signal overlapping a region represented by the contents of the memory, and the object region is determined on the basis of the overlapping region.

4. A video camera according to claim 3, wherein the target tracking processor is provided further with a region enlarging means which receives the signal representing the overlapping region and generates a signal representing an enlarged region obtained by enlarging the overlapping region at a fixed enlargement ratio, and the objective region is the enlarged region.

5. A Video camera according to claim 1, wherein the target tracking processor is provided with a calculating means for calculating the features of the object region, and provides a feature signal representing the features of the object region.

6. A video camera according to claim 5, wherein the features of the object region are the size and the position of the centroid of the object region.

7. A video camera according to claim 6, further comprising a zoom processor for processing the video signal provided by the signal processor to change the size of a specified part of an image formed on the imaging surface, wherein the controller controls the zoom processor so that the specified part of the image formed on the imaging surface is reduced or enlarged according to the size of the object region.

8. A video camera according to claim 6, further comprising a zoom lens unit and a zooming motor for driving the zoom lens unit, wherein the controller controls the zooming motor so that the specified part of the image formed on the imaging surface is enlarged or reduced according to the size of the object region.

9. A video camera according to claim 6, further comprising a zoom lens unit and an automatic focusing motor for driving the zoom lens unit, wherein the controller calculates the subject distance on the basis of the size of the object region and controls the automatic zooming motor.

10. A video camera according to claim 1, further comprising an optical axis shifting means for shifting the optical axis of the image focused by the lens unit, and a second driver for driving the optical axis shifting means, wherein the controller controls the second driver on the basis of the signal representing the object region so that the object region is displayed in the substantially central region of the monitor screen.

11. A video camera according to claim 1, further comprising a zoom processor for processing the video signal provided by the signal processor to change the size of a specified part of the image formed on the imaging surface, and a memory storing algorithms defining procedures for automatic panning, zooming and focusing according to the condition of the scene, wherein the controller controls the zoom processor according to the algorithms stored in the memory and signals given thereto by the target tracking processor.

12. A video camera according to claim 1, further comprising a zoom lens unit and a zooming motor for driving the zoom lens unit, wherein the controller controls the zooming motor according to the algorithms stored in a memory and signals given thereto by the target tracking processor.

13. A video camera according to claim 1, further comprising a region specifying means to be operated by the operator to specify a region on the monitor screen and a sampling circuit for sampling video signals representing a region specified by the region specifying means.

14. A video camera according to claim 13, wherein the region specifying means comprises a push button and a marker displaying means for displaying a marker on the monitor screen, and a region corresponding to the marker when the push button is pushed is the specified region.

15. A video camera according to claim 1, further comprising a mechanism for moving a range on the imaging surface on which the image is focused by the lens unit, wherein the controller controls the mechanism so that the object region will be always included in the imaging surface.

16. A video camera according to claim 15, wherein the mechanism is an electrically powered pedestal mounted with the video camera and capable of changing the direction of the video camera.

17. A video camera according to claim 15, wherein the mechanism is an active prism interposed between the lens unit and the image pickup device.

18. A video camera according to claim 15, wherein the controller controls the mechanism so that the object region is located substantially in the central region of the monitor screen with respect to the horizontal direction, and controls the driver so that the object region including the image of the target object is located substantially in the central region of the monitor screen with respect to the vertical direction.

19. A video camera according to claim 15, wherein the controller controls the mechanism so that the object region is substantially in the central region of the monitor screen with respect to the vertical direction, and controls the driver so that the object region including the image of the target object is located substantially in the central region of the monitor screen with respect to the horizontal direction.

20. A video camera according to claim 1, wherein the driver drives the image pickup device to read the image signal only from a part of the light receiving elements located in a specified region of the imaging surface.

21. A video camera comprising:

an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a storage means for temporarily storing the image data produced by the image pickup means;

a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data;

a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and

a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen;

wherein the predetermined conditions require that the luminance and chrominance of the video signal are in fixed ranges respectively.

22. A video camera comprising:

an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a storage means for temporarily storing the image data produced by the image pickup means;

a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data;

a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and

a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen;

wherein the predetermined conditions require that the luminance and chrominance of the video signal are in ranges of luminance and chrominance corresponding to those of flesh color.

23. A video camera comprising:

an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a storage means for temporarily storing the image data produced by the image pickup means;

a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data;

a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and

a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen;

wherein the target tracking processor means is provided with an extraction means which makes a decision as to whether or not the video signal meets the predetermined conditions; and

generates an extraction signal representing an extracted region meeting the predetermined conditions, and the target tracking processor means is further provided with a second storage means for storing the object region determined a certain time before and a compactor means which compares the contents of the second storage means and the extraction signal and generates a signal representing an overlapping region in a region represented by the contents of the second storage means, and the object region is determined on the basis of the overlapping region.

24. A video camera according to claim 23, wherein the target tracking processor means is provided further with a region enlarging means which receives the signal representing the overlapping region and generates a signal representing an enlarged region obtained by enlarging the overlapping region at a fixed enlargement ratio, and the object region is the enlarged region.

25. A video camera comprising;

an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a storage means for temporarily storing the image data produced by the image pickup means;

a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data;

a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and

a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen;

wherein the image pickup means and the storage means are comprised of an image pickup device of a CCD type or a MOS type, capable of photoelectric signal conversion and storage, the control means controls the driving of the image pickup device to control the read operation of the signal processing means.

26. A video camera comprising:

an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a storage means for temporarily storing the image data produced by the image pickup means;

a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data;

a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region;

a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; and

a mechanism for moving a range of the imaging surface on which the image is focused by the lens unit;

wherein the control means controls the mechanism so that the object region will be always included in the imaging surface and so that the object region is located substantially in the central region of the monitor screen with respect to the horizontal direction, and controls the operation of the signal processing means for reading data from the storage means so that the object region including the extracted object is located substantially in the central region of the monitor screen with respect to the vertical direction.

27. A video camera comprising:

an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a storage means for temporarily storing the image data produced by the image pickup means;

a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data;

a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region;

a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; and

a mechanism for moving a range of the imaging surface on which the image focused by the lens unit;

wherein the control means controls the mechanism so that the object region will be always included in the imaging surface and so that the object region is located substantially in the central region of the monitor screen with respect to the vertical direction and controls the operation of the signal processing means for reading the contents of the storage means.

28. A video camera comprising:

an image pickup means capable of producing an image signal through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit;

a signal processing means which produces a video signal indicating the luminance and chrominance on the basis of the image signal;

a storage means for storing an object region which has previously been determined;

an extraction means which receives the video signal, and provides a signal representing an extracted region in which the video signal satisfies predetermined conditions;

a comparator means which receives a signal read from the storage means and the output signal of the extraction means, and provides a signal representing an overlapping region in which the object region and the extracted region overlap each other;

a region enlarging means which receives the output signal of the comparator means and gives a signal representing a new object region determined by enlarging the overlapping region at a predetermined enlargement ratio; and

a control means which functions for target tracking control operation to keep the new object region within a monitor screen on which the video signal is displayed.

29. A video camera according to claim 28, wherein the predetermined conditions require that the luminance and chrominance of the video signal are within fixed ranges, respectively.

30. A video camera according to claim 28, wherein the predetermined conditions require that the luminance and chrominance of the video signal are within ranges of luminance and chrominance corresponding to those of flesh color.

31. A video camera according to claim 28, further comprising a calculating means for calculating the features of the object region, wherein the control means carries out target tracking control operations according to the features of the object region.

32. A video camera according to claim 31, wherein the features are the size and the position of the centroid of the object region.

33. A video camera according to claim 28, further comprising an image memory for temporarily storing the image signal, wherein the control means reads the image signal from a specified area of the image memory for target tracking control operation.

34. A video camera according to claim 28, wherein the image pickup means is comprised of an image pickup device of a CCD type of a MOS type, the control means controls the image pickup device by specifying a read position for target tracking control operation.

35. A video camera according to claim 28, further comprising a mechanism for moving a range on the imaging surface on which the image is focused by the lens unit, wherein the control means controls the driving of the mechanism for target tracking control operation.

36. A video camera according to claim 35, wherein the mechanism is an electrically powered pedestal supporting the video camera and capable of changing the direction of the video camera.

37. A video camera according to claim 35, wherein the mechanism is an active prism interposed between the lens unit and the image pickup means.