Still image producing method and still image capture system

• US 6,466,253 B1
• Filed: 06/05/1998
• Issued: 10/15/2002
• Est. Priority Date: 06/06/1997
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Honjoh, Atsushi
• Primary Examiner(s): Garber, Wendy R.
• Assistant Examiner(s): Villecco, John M.
• Application Number:
  US09/092,264
• Time in Patent Office: 1,593 Days
• Field of Search: 348/36, 348/39, 348/42, 348/50, 348/208, 348/218, 348/252, 348/352, 348/169, 348/699, 396/52, 396/55, 396/421, 382/284, 382/300
• US Class Current: 348/36
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 7/0125 one of the standards being a high definition standard
• CPC Class Codes: H04N 7/014 involving the use of motion vectors motion estimation and compensation in video coding H04N19/51

Abstract

A method is disclosed for producing a still image of an object using an image pickup element, which captures an image as a plurality of pixels. The method includes calculating relative displacement amounts between positions of the object on a plurality of frame images taken by the image pickup element, producing a synthesized still image of the object as an image containing an amount of information N times as large as that of each of the frame images using the relative displacement amounts to shift and overlay the plurality of frame images, and carrying out an interpolation processing so that intervals between adjacent pixels distributed on said synthesized still image are substantially the same, by a Fourier series expansion of a distribution state of pixels on said synthesized still image.

Claims

1. A still image producing method for producing a still image of an object by means of an image pickup element, which captures an image as a plurality of pixels, said method comprising:

taking pictures of said object while allowing a relative displacement between said object and said image pickup element;

producing a plurality of frame images, each of which is formed by a plurality of pixels, so that different points of said object are recorded on the corresponding pixels of at least two or more frame images of said plurality of frame images;

calculating relative displacement amounts between positions of said object on said plurality of frame images;

producing a synthesized still image of said object as an image containing an amount of information N (N being a natural number equal to or greater than

     2) times as large as that of each of the frame images by overlapping said plurality of frame images by overlapping said plurality of frame images after shifting said plurality of frame images from each other so that said positions of said object on said plurality of frame images are overlaid with each other on the basis of said relative displacement amounts; and

carrying out an interpolation processing so that intervals between adjacent pixels distributed on said synthesized still image are substantially the same, by a Fourier series expansion of a distribution state of pixels on said synthesized still image.

2. A still image producing method according to claim 1, wherein carrying out said interpolation processing comprises:

obtaining a resolution N^½

times as large as that of each of said plurality of frame images by distributing pixels on said synthesized still image as f (x/N^½

, y/N^½

) assuming that the number of terms of said Fourier series is the product of the number of said plurality of frame images and the predetermined number N (N being the number of frame images, on the corresponding pixels of which different points of said object are recorded, out of said plurality of frame images) and assuming that said Fourier series is f(x, y).

3. A still image producing method according to claim 1, wherein carrying out said interpolation processing, comprises:

obtaining a higher S/N ratio than that of each of said plurality of frame images by distributing pixels on said synthesized still image as f (x, y) assuming that the number of terms of said Fourier series is equal to the number of said plurality of frame images and assuming that said Fourier series is (x, y).

4. A still image producing method according to claim 1, wherein calculating said relative displacement amounts, comprises:

extracting a contour of said object on each of said plurality of frame image;

obtaining a characteristic pattern of said contour on each of said plurality of frame images, the position of said characteristic pattern capable of being identified on each of said plurality of frame images; and

obtaining relative displacement amounts between said positions of said object on said plurality of frame images by dividing the position of said characteristic pattern on each of said plurality of frame images.

5. A still image producing method according to claim 4, wherein calculating said relative displacement amounts, comprises:

extracting said characteristic pattern on each of said plurality of frame images every a predetermined number M (M being a natural number equal to or greater than

     2) of characteristic patterns; and

deriving the position of said characteristic pattern on each of said plurality of frame images for each of said predetermined number M of characteristic patterns, to calculate said relative displacement amounts between said positions of said object on said plurality of frame images as average values of relative displacement amounts of said predetermined number M of characteristic patterns.

6. A still image producing method according to claim 1,

wherein producing a plurality of frame images, comprises dividing each of said plurality of frame images to produce a plurality of luminance signal frame images, each of which is formed by luminance signals, and a plurality of color signal frame images, each of which is formed by color signals;

and

wherein calculating said relative displacement amounts, comprises calculating relative displacement amounts between said positions of said object on any one of said plurality of luminance signal frame images and said plurality of color signal frame images.

7. A still image producing method according to claim 6, wherein producing a synthesized still image, comprises:

producing a single luminance signal synthesized still image by overlapping said plurality of luminance signal frame images after shifting said plurality of luminance signal frame images from each other so that said positions of said object are overlaid with each other on the basis of said relative displacement amounts; and

producing a single color signal synthesized still image by overlapping said plurality of color signal frame images after shifting said plurality of color signal frame images from each other so that said positions of said object are overlaid with each other an the basis of said relative displacement amounts.

8. A still image producing method according to claim 1, wherein producing said plurality of frame images, comprises producing each of said plurality of frame images by recording for substantially the same exposure time to be produced.

9. A still image capture system including an image pickup element for taking a picture of an object to capture an image as a plurality of pixels, and a signal processing system for processing said picture by converting said image containing said plurality of pixels captured by said image pickup element into image signals, said signal processing system comprising:

a frame image producing part to produce a plurality of frame images, each of which is formed by said plurality of pixels and shot by said image pickup element and on the corresponding pixels of which different points of said object are recorded;

a calculation part to calculate relative displacement amounts between positions of said object on said plurality of frame images which are produced by said frame image producing part;

an overlapping part to overlap said plurality of frame images after shifting said plurality of frame images from each other so that said positions of said object on said plurality of frame images are overlaid with each other on the basis of said relative displacement amounts;

a synthesized still image producing part to produce a synthesized still image of said object as an image containing an amount of information N (N being a natural number equal to or greater than

     2) times as large as that of each of the frame images; and

an interpolation processing part to carry out an interpolation processing by a Fourier series expansion of a distribution state of pixels on said synthesized still image so that the intervals of adjacent distributed on said synthesized still image are substantially the same.

10. A still image capture system according to claim 9,

wherein said interpolation processing part obtains a resolution N½

times as large as that of each of said plurality of frame images by distributing pixels on said synthesized still image as f (x/N^½

, y/N^½

) assuming that the number of terms of said Fourier series is the product of the number of said plurality of frame images and the predetermined number N (N being the number of frame images, on the corresponding pixels of which different points of said object are recorded, out of said plurality of frame images) and assuming the said Fourier series is f (x, y).

11. A still image capture system according to claim 10, wherein said interpolation processing part obtains a higher S/N ratio than that of each of said plurality of frame images by distributing pixels on said synthesized still image as f (x, y) assuming that the number of frames of said Fourier series is equal to the number of pixels of said plurality of frame images and assuming that said Fourier series is f (x, y).

12. A still image capture system according to claim 9,

wherein the number of said plurality of frame images, which are produced by said a frame image producing part, is a predetermined number m² (m being a natural number equal to or greater than 2).

13. A still image capture system according to claim 9,

wherein each of said plurality of frame images, which are produced by said frame image producing part, is recorded for substantially the same exposure time.

14. A still image capture system according to claim 9,

wherein said synthesized still image, which is produced by said synthesized still image producing part, has a substantially larger number of pixels than that of each of said frame images so as to have a higher resolution.

15. A still image capture system according to claim 9,

wherein said synthesized still image, which is produced by said synthesized still image producing part, has a substantially larger amount of signals per pixel than that of each of said frame images so as to have a higher S/N ratio.

16. A still image capture system according to claim 9,

wherein said image pickup element comprises a CCD image sensor or a CMOS sensor.