Solid-state imaging device for enlargement of dynamic range

• US 7,466,358 B1
• Filed: 11/20/2000
• Issued: 12/16/2008
• Est. Priority Date: 11/22/1999
• Status: Expired due to Fees

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Yamamoto, Yasutoshi, Kusaka, Hiroya, Sakaue, Shigeo, Nakayama, Masaaki, Tsutsumi, Tomoaki
• Primary Examiner(s): Ho; Tuan
• Assistant Examiner(s): KHAN, USMAN A
• Application Number:
  US10/130,696
• Time in Patent Office: 2,948 Days
• Field of Search: 348/322, 348/229.1, 348/363, 348/362, 348/371, 348/373, 348/208.13, 348/221.1, 348/222.1
• US Class Current: 348/362
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/136 using complementary colours
• CPC Class Codes: H04N 25/42 by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
• CPC Class Codes: H04N 25/46 by combining or binning pixels
• CPC Class Codes: H04N 25/589 with different integration times, e.g. short and long exposures
• CPC Class Codes: H04N 25/616 involving a correlated sampling function, e.g. correlated double sampling [CDS] or triple sampling
• CPC Class Codes: H04N 25/70 SSIS architectures; Circuits associated therewith
• CPC Class Codes: H04N 25/73 using interline transfer [IT]

Abstract

An inter-line CCD(IT-CCD) capable of reading signals in two read modes, a field read mode and a frame read mode, is used to control, by a system control means, a CCD exposure and a signal read mode, a short-time exposure signal(Short signal) acquires an image by a field read and a long-time exposure signal(Long signal) acquires an image by a frame read, and these two images are synthesized by a signal synthesizing means to expand a dynamic range.

Claims

1. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein the signal synthesizer means includes;

coefficient generation means for generating a certain coefficient k according to a signal level of said synthesis control signal, and

synthesizer means for weighting and adding said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to the coefficient k generated by said coefficient generation means.

2. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from one another in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of said two image signals having a different number of pixels;

first interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into a brightness signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by the first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels by the first interpolation means;

second interpolation means for converting said image signal having a small number of pixels, into an image signal having the same signal type as said image signal having a large number of pixels by an interpolation signal process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a large number of pixels and said image signal having a large number of pixels according to said synthesis control signal,

wherein said brightness signal synthesizer means includes

first coefficient generation means for generating a certain coefficient k according to a signal level of said synthesis control signal; and

first synthesizer means for weighting and adding the brightness signal converted to the same signal type as the brightness signal obtained from said image signal having a large number of pixels by the first interpolation means, and the brightness signal extracted from said image signal having a large number of pixels, according to the coefficient k generated by the first coefficient generation means.

3. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from one another in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of said two image signals having a different number of pixels;

first interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into a brightness signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by the first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels by the first interpolation means;

second interpolation means for converting said image signal having a small number of pixels, into an image signal having the same signal type as said image signal having a large number of pixels by an interpolation signal process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a large number of pixels and said image signal having a large number of pixels according to said synthesis control signal,

wherein said signal synthesizer means includes;

second synthesizer means for weighting and adding said image signal converted to the same signal type as said image signal having a large number of pixels by said second interpolation means, and said image signal having a large number of pixels, according to at least one of the coefficients k generated by said first coefficient generation means.

4. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from one another in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of said two image signals having a different number of pixels;

first interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into a brightness signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by the first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels by the first interpolation means;

second interpolation means for converting said image signal having a small number of pixels, into an image signal having the same signal type as said image signal having a large number of pixels by an interpolation signal process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a large number of pixels and said image signal having a large number of pixels according to said synthesis control signal,

wherein said signal synthesizer means includes;

second synthesizer means for weighting and adding said image signal converted to the same signal type as said image signal having a large number of pixels by said second interpolation means, and said image signal having a large number of pixels, according to at least one of the mean value, maximum value, minimum value and intermediate value of a plurality of coefficients k, of the coefficients k generated by said first coefficient generation means.

5. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from one another in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of said two image signals having a different number of pixels;

first interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into a brightness signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by the first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels by the first interpolation means;

second interpolation means for converting said image signal having a small number of pixels, into an image signal having the same signal type as said image signal having a large number of pixels by an interpolation signal process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a large number of pixels and said image signal having a large number of pixels according to said synthesis control signal,

wherein said signal synthesizer means includes;

second coefficient generation means for generating a certain coefficient k according to a signal level of said synthesis control signal; and

second synthesizer means for weighting and adding said image signal converted to the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels, according to the coefficient k generated by said second coefficient generation means.

6. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said, brightness signal extracted from said image signal having a small number of pixels, into an image signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels, according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

thinning out means for converting said image signal having a large number of pixels, into the same signal type as said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to said synthesis control signal,

wherein said brightness signal synthesizer means includes;

first coefficient generation means for generating a certain coefficient k according to a signal level of said synthesis control signal; and

first synthesizer means for weighting and adding said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, and said brightness signal extracted form said image signal having a large number of pixels, according to the coefficient k generated by said first coefficient generation means.

7. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said, brightness signal extracted from said image signal having a small number of pixels, into an image signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels, according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

thinning out means for converting said image signal having a large number of pixels, into the same signal type as said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to said synthesis control signal,

wherein said signal synthesizer means includes;

second synthesizer means for weighting and adding said image signal converted to the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to at least one of said coefficients k generated by said first coefficient generation means.

8. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said, brightness signal extracted from said image signal having a small number of pixels, into an image signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels, according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

thinning out means for converting said image signal having a large number of pixels, into the same signal type as said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to said synthesis control signal,

wherein said signal synthesizer means includes;

second synthesizer means for weighting and adding said image signal converted to the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to at least one of the mean value, maximum value, minimum value and intermediate value of a plurality of coefficients k, of the coefficients k generated by said first coefficient generation means.

9. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said, brightness signal extracted from said image signal having a small number of pixels, into an image signal having the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said first interpolation means, and said brightness signal obtained from said image signal having a large number of pixels, according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

thinning out means for converting said image signal having a large number of pixels, into the same signal type as said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signal converted into the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to said synthesis control signal,

wherein said signal synthesizer means includes;

second coefficient generation means for generating a certain coefficient k according to a signal level of the synthesis control signal; and

second synthesizer means for weighting and adding said image signal converted to the same signal type as said image signal having a small number of pixels by said thinning out means, and said image signal having a small number of pixels, according to said coefficient k generated by said second coefficient generation means.

10. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into to the same signal type as a brightness signal obtained from said image signal having a large number of pixels by said interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

first thinning out means for thinning out pixels of said image signal having a large number of pixels by a thinning out process;

second thinning out means for thinning out pixels of said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means according to said synthesis control signal

wherein said brightness signal synthesizer means includes;

first coefficient generation means for generating a certain coefficient k according to a signal level of the synthesis control signal; and

first synthesizer means for weighting and adding a brightness signal converted to the same signal type as a brightness signal obtained from said image signal having a large number of pixels by said interpolation means, and a brightness signal extracted from said image signal having a large number of pixels, according to the coefficient k generated by said first coefficient generation means.

11. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into to the same signal type as a brightness signal obtained from said image signal having a large number of pixels by said interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

first thinning out means for thinning out pixels of said image signal having a large number of pixels by a thinning out process;

second thinning out means for thinning out pixels of said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means, according to said synthesis control signal,

wherein said signal synthesizer means includes;

second synthesizer means for weighting and adding said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means, according to at least one of said coefficients k generated by said first coefficient generation means.

12. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into to the same signal type as a brightness signal obtained from said image signal having a large number of pixels by said interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

first thinning out means for thinning out pixels of said image signal having a large number of pixels by a thinning out process;

second thinning out means for thinning out pixels of said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means, according to said synthesis control signal,

wherein said signal synthesizer means includes;

second synthesizer means for weighting and adding said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means, according to at least one of the mean value, maximum value, minimum value and intermediate value of a plurality of coefficients k, of said coefficients k generated by said first coefficient generation means.

13. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

brightness signal extraction means for extracting a brightness signal from an image signal having a small number of pixels or an image signal having a large number of pixels of the two image signals which are different from each other in the number of pixels;

interpolation means for converting said brightness signal extracted from said image signal having a small number of pixels, into the same signal type as a brightness signal obtained from said image signal having a large number of pixels by an interpolation process;

brightness signal synthesizer means for synthesizing said brightness signal converted into to the same signal type as a brightness signal obtained from said image signal having a large number of pixels by said interpolation means and said brightness signal extracted from said image signal having a large number of pixels according to a synthesis control signal, said synthesis control signal being at least one of said brightness signal extracted from said image signal having a small number of pixels, said brightness signal converted to the same signal type as said brightness signal obtained from said image signal having a large number of pixels by said interpolation means, or said brightness signal extracted from said image signal having a large number of pixels;

first thinning out means for thinning out pixels of said image signal having a large number of pixels by a thinning out process;

second thinning out means for thinning out pixels of said image signal having a small number of pixels by a thinning out process; and

signal synthesizer means for synthesizing said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means, according to said synthesis control signal,

wherein said signal synthesizer means includes;

second coefficient generation means for generating a certain coefficient k according to a signal level of the synthesis control signal; and

second synthesizer means for weighting and adding said image signals whose pixels are thinned out by said first thinning out means and said second thinning out means, according to said coefficient k generated by said second coefficient generation means.

14. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein said coefficient generation means, said first coefficient generation means and said second coefficient generation means generate said coefficient k according to a signal level of at least one pixel of a plurality of pixels of said synthesis control signal.

15. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein said coefficient generation means, said first coefficient generation means and said second coefficient generation means generate said coefficient k according to at least one of the mean value, maximum value, minimum value and intermediate value of each signal level of a plurality of pixels of said synthesis control signal.

16. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein said coefficient generation means, said first coefficient generation means and said second coefficient generation means generate said coefficient k corresponding to each pixel of said synthesis control signal.

17. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein said coefficient-generation means, said first coefficient generation means and said second coefficient generation means generate said coefficient k corresponding to a block consisting of a plurality of pixels of said synthesis control signal.

18. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein said coefficient generation means, said first coefficient generation means and said second coefficient generation means generate said coefficient k according to at least one of the mean value, maximum value, minimum value and intermediate value of each signal level in the block consisting of a plurality of pixels of the synthesis control signal.

19. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein said coefficient generation means, said first coefficient generation means and said second coefficient generation means generate a certain coefficient k according to a signal level of a pixel existing at a specific position in a block of each signal level in a block consisting of a plurality of pixels of said synthesis control signal.

20. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein of said two image signals which are different from each other in said exposure amount and said number of pixels, said image signal having a small number of pixels is a short-time exposure signal, while said image signal having a large number of pixels is a long-time exposure signal.

21. A solid-state imaging device comprising:

a solid-state imaging element for outputting two image signals which are different from each other in an exposure amount and the number of pixels;

interpolation means for converting an image signal having a small number of pixels of said two image signals having a different number of pixels, into an image signal having the same signal type as an image signal having a large number of pixels by an interpolation process; and

signal synthesizer means for synthesizing said image signal having a large number of pixels and said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means according to a synthesis control signal, said synthesis control signal being at least one of said image signal having a small number of pixels, said image signal converted into the same signal type as said image signal having a large number of pixels by said interpolation means, and said image signal having a large number of pixels,

wherein of said two image signals which are different from each other in said exposure amount and said number of pixels, said image signal having a small number of pixels is a long-time exposure signal, while said image signal having a large number of pixels is a short-time exposure signal.