Video camera, imaging method using video camera, method of operating video camera, image processing apparatus and method, and solid-state electronic imaging device

• US 5,420,635 A
• Filed: 08/28/1992
• Issued: 05/30/1995
• Est. Priority Date: 08/30/1991
• Status: Expired due to Term

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Masukane, Kazuyuki, Konishi, Masahiro, Inuiya, Masafumi, Tsugita, Makoto
• Primary Examiner(s): Razavi, Michael T.
• Assistant Examiner(s): Ho, Tuan V.
• Application Number:
  US07/936,845
• Time in Patent Office: 1,005 Days
• Field of Search: 358/228, 358/227, 358/209, 354/400
• US Class Current: 348/362
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/84 for processing colour signals
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/48 Increasing resolution by shifting the sensor relative to the scene
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/78263 for recording on tracks inclined relative to the direction of movement of the tape

Abstract

A suitable image is obtained of a subject in which the difference in luminance between a bright area and a dark area is very large. The dark area is properly exposed and first image data is obtained. The bright area is properly exposed, and second image data is obtained. The first image data pertaining to the bright area is replaced with the second image data, thereby obtaining composite image data. This is accomplished using an array of photodiodes comprising two sets of photodiodes, one set of the photodiodes comprising filters, and the respective sets of photodiodes output signals to respectively different transfer paths for signal processing.

Claims

1. A video camera comprising:

imaging means for successively imaging a subject using two different amounts of exposure and outputting image signals respectively representing two frames of images obtained under the conditions of different amounts of exposure;

discriminating means for discriminating an image signal portion representing a relatively high luminance area in the frame of an image obtained under the conditions of a large amount of exposure or discriminating an image signal portion representing a relatively low luminance area in the frame of an image obtained under the conditions of a small amount of exposure by comparing the image signal with a predetermined threshold level; and

generating means for generating a composite image signal by replacing the image signal portion representing the relatively high luminance area in the frame of an image obtained under the conditions of the large amount of exposure with an image signal portion representing a corresponding area in the frame of an image obtained under the conditions of a small amount of exposure or by replacing the image signal portion representing the relatively low luminance area in the frame of an image obtained under the conditions of the small amount of exposure with an image signal portion representing a corresponding area in the frame of an image obtained under the conditions of a large amount of exposure.

2. The video camera according to claim 1, further comprising determining means for respectively determining a proper amount of exposure for the relatively low luminance area and a proper amount of exposure for the relatively high luminance area in a visual field of the camera,

said imaging means imaging the subject twice using the determined two types of amounts of exposure, respectively.

3. The video camera according to claim 1, wherein said imaging means comprises:

beam splitter means for dividing incident light in accordance with a predetermined ratio of the amounts of exposure; and

two solid-state electronic imaging devices for respectively receiving two incident light beams obtained by the division by the beam splitter means to output image signals.

4. The video camera according to claim 1, wherein said imaging means comprises:

a solid-state electronic imaging device for outputting an image signal representing an image of the incident light; and

driving means for driving said solid-state electronic imaging device so as to make a constant exposure time in an ordinary state and driving said solid-state electronic imaging device so as to make an exposure time shorter than said constant exposure time in response to a command to generate a composite image.

5. The video camera according to claim 1, wherein said composite image signal generating means comprises:

a comparator for comparing a first analog video signal representing the image obtained under the conditions of a large amount of exposure with a predetermined threshold level to generate an output when the level of the first analog video signal exceeds said threshold level; and

a multiplexer receiving said first analog video signal and a second analog video signal applied in synchronization therewith and representing the image obtained under the condition of a small amount of exposure, and selecting said first analog video signal to output the same in an ordinary state and selecting said second analog video signal to output the same when the output of said comparator is applied.

6. The video camera according to claim 5, which further comprises a low-pass filter for removing a high frequency component of said first analog video signal, an output of the low-pass filter being applied to said comparator.

7. The video camera according to claim 5, which further comprises:

a time width detecting circuit for applying an output signal of said comparator to said multiplexer when the time width of the output signal is not less than a predetermined reference width; and

a delay circuit for delaying said first and second analog video signals for a time corresponding to said reference width to respectively apply the signals to said multiplexer.

8. The video camera according to claim 1, which further comprises strobe flashing means for emitting strobe light twice, resulting in suitable amounts of exposure respectively for two areas different distances away from the camera in the visual field of the camera.

13. The video camera according to claim 7, wherein said determining means defines an area of a relatively high luminance and having an area or length which fails to be less than a predetermined value in the image represented by said first image signal or an area of a relatively low luminance and having an area or length which fails to be less than a predetermined value in the image represented by said second image signal.

9. The video camera comprising:

imaging means for successively imaging a subject using two different amounts of exposure and outputting first and second image signals respectively representing two images obtained under the conditions of different amounts of exposure;

first storing means for storing said first image signal outputted from said imaging means and representing the image obtained under the conditions of a large amount of exposure;

second storing means for storing said second image signal outputted from said imaging means and representing the image obtained under the conditions of a small amount of exposure;

determining means for determining the relatively high luminance area in the image represented by the first image signal stored in said first storing means or the relatively low luminance area in the image represented by the second image signal stored in said second storing means; and

synthesizing means for synthesizing an image signal representing an area other than the high luminance area determined by said determining means in said first image signal and an image signal representing an area corresponding to said high luminance area in said second image signal, or synthesizing an image signal representing an area other than the low luminance area determined by said determining means in said second image signal and an image signal representing an area corresponding to said low luminance area in said first image signal.

10. The video camera according to claim 9, wherein

said determining means comprises third storing means for storing an area designation signal representing the area determined by said determining means, and

said synthesizing means comprises switching means for selecting either one of the first and second image signals synchronously read out from said first and second storing means to output the same in accordance with the area designation signal read out from said third storing means.

11. The video camera according to claim 9, wherein said determining means comprises comparing means for comparing said first image signal or said second image signal with a predetermined threshold level.

12. The video camera according to claim 9, wherein said determining means comprises:

means for low-pass filtering said first image signal or said second image signal; and

comparing means for comparing the image signal low-pass filtered with a predetermined threshold level.

14. The video camera according to claim 9, wherein said synthesizing means generating means for generating, in the vicinity of the boundary appearing when the first image signal is partially replaced with the second image signal or the second image signal is partially replaced with the first image signal, a signal representing the weighed average value of both said first and second image signals.

15. The video camera according to claim 9, wherein said synthesizing means comprises means for low-pass filtering, in the vicinity of the boundary appearing when the first image signal is partically replaced with the second image signal or the second image signal is partially replaced with the first image signal, the image signals.

16. A still video camera comprising:

determining means for respectively determining a proper amount of exposure for a relatively high luminance area and a proper amount of exposure for a relatively low luminance area in a visual field of the camera;

imaging means including a solid-state electronic imaging device for imaging a subject twice using the determined two different amounts of exposure and respectively outputting video signals representing images obtained by the imaging from said solid-state electronic imaging device;

analog-to-digital converting means for respectively converting the video signals outputted from said imaging means into digital image data corresponding thereto;

first storing means for storing first digital image data obtained by the analog-to-digital conversion and representing the image obtained under the conditions of a large amount of exposure;

second storing means for storing second digital image data obtained by the analog-to-digital conversion and representing the image obtained under the conditions of a small amount of exposure;

defining means for defining the relatively high luminance area in the image represented by the first digital image data stored in said first storing means; and

image synthesizing means for generating composite image data by replacing image data representing the high luminance area defined by said defining means in said first digital image data with image data representing a corresponding area in said second digital image data stored in said second storing means.

17. A still video camera comprising:

strobe flashing means for emitting strobe light twice, resulting in suitable amounts of exposure respectively for two areas different distances away from the camera in a visual field of the camera;

imaging means for imaging a subject twice in synchronization with the emission of strobe light by said strobe flashing means to respectively output video signals representing images obtained by the imaging;

analog-to-digital converting means for respectively converting the video signals outputted from said imaging means into digital image data corresponding thereto;

first storing means for storing first digital image data obtained by the analog-to-digital conversion and representing one of the images;

second storing means for storing second digital image data obtained by the analog-to-digital conversion and representing the other image;

defining means for defining a relatively high luminance area in the image represented by the first digital image data stored in said first storing means; and

image synthesizing means for generating composite image data by replacing image data representing the high luminance area defined by said defining means in said first digital image data with image data representing a corresponding area in said second digital image data stored in said second storing means.

18. A method of operating a video camera, comprising the steps of:

successively imaging a subject using two different amounts of exposure to obtain image signals respectively representing two images generated under the conditions of different amounts of exposure;

discriminating an image signal representing a relatively high luminance area in the image obtained under the conditions of a large amount of exposure or discriminating an image signal representing a relatively low luminance area in the image obtained under the conditions of a small amount of exposure by comparing the image signal with a predetermined threshold level; and

generating a composite image signal by replacing the image signal representing the relatively high luminance area in the image obtained under the conditions of the large amount of exposure with an image signal representing a corresponding area in the image obtained under the conditions of the small amount of exposure or by replacing the image signal representing the relatively low luminance area in the image obtained under the conditions of the small amount of exposure with an image signal representing a corresponding area in the image obtained under the conditions of the large amount of exposure.

19. The method of operating a video camera according to claim 18, further comprising the steps of:

respectively determining a proper amount of exposure for the relatively high luminance area and a proper amount of exposure for the relatively low luminance area in a visual field of the camera; and

imaging the subject twice using the determined two types of amounts of exposure to obtain two image signals generated under the conditions of different amounts of exposure.

20. The method of operating a video camera according to claim 18, further comprising the step of:

driving the solid-state electronic imaging device so as to make a constant exposure time in an ordinary state; and

driving the solid-state electronic imaging device so as to make an exposure time shorter than said constant exposure time in response to a command to generate a composite image to obtain two image signals generated under the conditions of different amounts of exposure.

21. The method of operating a video camera according to claim 20, which comprises the step of detecting the movement of an image of the subject on the basis of the image signal obtained from said solid-state electronic imaging device to continue to make exposure for said constant exposure time when the image of the subject is moved by not less than a constant amount.

22. The method of operating a video camera according to claim 18, further comprising the step of emitting strobe light twice, which results in suitable amounts of exposure respectively for two areas different distances away from the camera in a visual field of the camera, to obtain two image signals.