Image signal conversion device

• US 4,768,092 A
• Filed: 07/21/1987
• Issued: 08/30/1988
• Est. Priority Date: 07/23/1986
• Status: Expired due to Term

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Ishikawa, Hisashi
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/076,132
• Time in Patent Office: 406 Days
• Field of Search: 358/140, 358/11, 358/105, 358/136, 358/135
• US Class Current: 348/458
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 7/012 Conversion between an interlaced and a progressive signal for graphics images G09G2310/0229

Abstract

An image signal conversion device for handling an interlaced image signal whereby one frame picture plane is formed by multiplexing, in an alternately time sharing manner, odd- and even-number field image signals which form the interlaced image signal and respectively correspond to odd- and even-number field picture planes consisting of horizontal scanning lines alternately located on a picture plane is arranged to form a high resolution image signal by increasing the number of horizontal scanning line signals forming each of said field image signals in the following manner: A given field image signal within the interlaced image signal is assumed to be a first field image signal; an inner-field interpolation signal for the first field image signal is formed by using the first field image signal; an inter-field interpolation signal for the first field image signal is formed by using at least a second field image signal which is received immediately before the first field image signal; either the inner-field interpolation signal or the inter-field interpolation signal is selected for the interlaced signal by using at least the first and second field image signals; and a high solution image signal is obtained with the number of the horizontal scanning line signals increased for each of the field image signals by carrying out interpolation using the interpolation signal selected.

Claims

1. An image signal conversion device for handling an interlaced image signal, whereby one frame picture plane is formed by multiplexing, in a time sharing manner, a plurality of field image signals corresponding to a plurality of field picture planes consisting of horizontal scanning lines located in different positions from each other on a picture plane, said device being arranged to form a high resolution image signal by increasing the number of horizontal scanning line signals constituting each of the field image signals, said device comprising:

(a) inner-field interpolation signal forming means arranged to receive said interlaced image signal and, with a given field image signal of said interlaced image signal assumed to be a first field image signal, to use said first field image signal for forming an inner-field interpolation signal for the first field image signal;

(b) inter-field interpolation signal forming means arranged to receive said interlaced image signal and to form an inter-field interpolation signal for said first field image signal by using at least a second field image signal which is received prior to said first field image signal within said interlaced image signal and is adjacent to said first field image signal;

(c) selective output means arranged to select and produce either said inner-field interpolation signal formed by said inner-field interpolation signal forming means or said inter-field interpolation signal formed by said inter-field interpolation signal forming means;

(d) control means for controlling said selective output means by using at least said first and second field image signals; and

(e) image signal forming means for forming a high resolution image signal b interpolating said interlaced image signal with said interpolation signal produced from said selective output means.

2. A device according to claim 1, wherein said image signal forming means is arranged to receive said interlaced image signal through every horizontal scanning line signal thereof, to also receive said interpolation signal produced from said selective output means, to compress the time base of said horizontal scanning line signal and that of said interpolation signal respectively, to alternately produce the time-base compressed horizontal scanning line signal and the time-base compressed interpolation signal;

and thus to form a high resolution image signal.

3. A device according to claim 1, wherein said inner-field interpolation signal forming means includes:

(a) a first extraction circuit arranged to extract, from said first field image signal, horizontal scanning line signals covering two adjacent lines; and

(b) a first computing circuit arranged to produce, as said inner-field interpolation signal, an average value signal representing the average value of said horizontal scanning line signals of two lines extracted by said first extraction circuit.

4. A device according to claim 3, wherein said inter-field interpolation signal forming means includes a second extraction circuit which is arranged to extract, from among a plurality of horizontal scanning line signals within said second field image signal, a horizontal scanning line signal corresponding to a position located in between the two horizontal scanning lines covered by said scanning line signals of said first field image signal extracted by said first extraction circuit.

5. A device according to claim 4, wherein said control means includes:

(a) a subtraction circuit arranged to perform a subtracting operation on said horizontal scanning line signals of two lines extracted by said first extraction circuit and said horizontal scanning line signal which is extracted by said second extraction circuit and to obtain level differences of them;

(b) a comparison circuit arranged to compare said level differences obtained by said subtraction circuit with a preset threshold value respectively; and

(c) an instruction circuit arranged to instruct said selective output means to produce said inner-field interpolation signal or said inter-field interpolation signal according to the result of comparison made by said comparison circuit.

6. A device according to claim 4, wherein said control circuit includes:

(a) a first comparison result detection circuit arranged to produce, for said second field image signal and a third field image signal which comes immediately after said first field image signal, the result of comparison between the horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said third field image signal and corresponds to the horizontal scanning line signal extracted by said second extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said first field image signal and a fourth field image signal which immediately precedes said second field image signal, the result of comparison between horizontal scanning line signals which are included in said first and fourth field image signals and correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said second field image signal and a fifth field image signal which immediately precedes said fourth field image signal, the result of comparison between horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to the horizontal scanning line signal extracted by said second extraction circuit; and

(d) an instruction circuit arranged to instruct said selective output means to selectively produce either the signal output of said first computing circuit or that of said second computing circuit in accordance with the results of comparison produced from said first, second and third comparison result detection circuits.

7. A device according to claim 4, wherein said control means includes:

(a) a first comparison result detection circuit arranged to produce, for said first field image signal and a third field image signal which comes immediately after said first field image signal, the result of comparison between a horizontal scanning line signal which corresponds to a lower part of a picture plane and is extracted from said first field image signal by said first extraction circuit and a horizontal scanning line signal which is included in said third field image signal and corresponds to said horizontal scanning line signal extracted by said first extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said second field image signal and a fourth field image signal which comes immediately after said first field image signal, the result of comparison between a horizontal scanning line signal extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fourth field image signal and corresponds to said horizontal scanning line signal extracted by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said first field image signal and a fifth field image signal which precedes said first field image signal by two field periods, the result of comparison between a horizontal scanning line signal which is extracted from said first field image signal by said first extraction circuit and corresponds to the lower part of a picture plane and a horizontal scanning line signal which is included is said fifth field image signal and corresponds to said horizontal scanning line signal extracted by said first extraction circuit;

(d) a fourth comparison result detection circuit arranged to produce, for said second field image signal and a sixth field image signal which immediately precedes said fifth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to said horizontal scanning line signal extracted by said second extraction circuit; and

(e) an instruction circuit arranged to supply an instruction signal to said selective output means to cause said selective output means to produce one of signal outputs of said first computing circuit and said second extraction circuit in accordance with the results of comparison produced from said first, second, third and fourth comparison result detection circuits.

8. A device according to claim 4, wherein said control circuit includes:

(a) a first comparison result detection circuit arranged to produce, for said second field image signal and a third field image signal which comes immediately after said first field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said third field image signal and corresponds to the horizontal scanning line signal extracted by said second extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said first field image signal and a fourth field image signal which immediately precedes said second field image signal, the result of comparison between horizontal scanning line signals which are included in said first and fourth field image signals and correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said second field image signal and a fifth field image signal which immediately precedes said fourth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to the horizontal scanning line signal extracted by said second extraction circuit;

(d) a fourth comparison result detection circuit arranged to produce, for said fourth field image signal and a sixth field image signal which immediately precedes said fifth field image signal, the result of comparison between horizontal scanning line signals which are included in said fourth and fifth field image signals and respectively correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit; and

(e) an instruction circuit arranged to instruct said selective output means to selectively produce either the signal output of said first computing circuit or that of said second extraction circuit in accordance with the results of comparison produced from said first, second, third and fourth comparison result detection circuits.

9. A device according to claim 8, wherein said instruction circuit includes an inverter which is arranged to invert the result of comparison produced from said fourth comparison result detection circuit;

and said instruction circuit is arranged to supply said selective output means with an instruction signal which causes said selective output means to produce either the signal output of said first computing circuit or that of said second extraction circuit in accordance with the results of comparison produced from said first, second and third comparison result detection circuits and an inverted comparison result produced by said inverter.

10. A device according to claim 4, wherein said inter-field interpolation signal forming means further includes:

(a) a third extraction circuit arranged to extract, from among a plurality of horizontal scanning line signals included in a third field image signal which comes immediately after said first field image signal, a horizontal scanning line signal corresponding to a position located in between the two lines of said horizontal scanning line signals of said first field image signal extracted by said first extraction circuit; and

(b) a second computing circuit arranged to obtain an average value signal representing the average value of said horizontal scanning line signal extracted by said second extraction circuit and said horizontal scanning line signal extracted by said third extraction circuit.

11. A device according to claim 10, wherein said control means includes:

(a) a first subtraction circuit arranged to perform a subtracting operation on said two horizontal scanning line signals extracted by said first extraction circuit and said horizontal scanning line signal extracted by said second extraction circuit and to obtain level differences among them;

(b) a first comparison circuit arranged to compare each of the level differences obtained by said first subtraction circuit with a preset threshold value;

(c) a second subtraction circuit arranged to perform a subtracting operation on said two scanning line signals extracted by said first extraction circuit and said horizontal scanning line signal extracted by said third extraction circuit and to obtain level differences among them;

(d) a second comparison circuit arranged to compare each of said level differences obtained by the second subtraction circuit with a preset threshold value; and

(e) an instruction circuit arranged to instruct said selective output means to select one of signals produced from said first computing circuit, said second computing circuit, said second extraction circuit and said third extraction circuit in accordance with the result of comparison made by said first comparison circuit and the result of comparison made by said second comparison circuit.

12. A device according to claim 10, wherein said control circuit includes:

(a) a first comparison result detection circuit arranged to produce, for said second field image signal and a third field image signal, the result of comparison between the horizontal scanning line signal extracted from said said second field image signal by said second extraction circuit and the horizontal scanning line signal extracted from said third field image signal by said third extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said first field image signal and a fourth field image signal which immediately precedes said second field image signal, the result of comparison between horizontal scanning line signals which are included in said first and fourth field image signals and correspond respectively to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said second field image signal and a fifth field image signal which immediately precedes said fourth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to said horizontal scanning line signal extracted by said second extraction circuit; and

(d) an instruction circuit arranged to instruct said selective output means to selectively produce one of the signal outputs of said first computing circuit, said second computing circuit and said second extraction circuit on the basis of the results of comparison produced from said first, second and third comparison result detection circuits.

13. An image signal conversion device for handling an interlaced image signal whereby one frame picture plane is formed by multiplexing, in an alternately time sharing manner, odd- and even-number field image signals which form said interlaced image signal and respectively correspond to odd- and even-number field picture planes consisting of horizontal scanning lines alternately located on a picture plane, said device being arranged to form a high resolution image signal by increasing the number of horizontal scanning line signals constituting each of said field image signals, said device comprising:

(a) inner-field interpolation signal forming means arranged to receive said interlaced image signal and, with a given field image signal of said interlaced image signal assumed to be a first field image signal to use the first field image signal for forming an inner-field interpolation signal for said first field image signal;

(b) inter-field interpolation signal forming means arranged to receive said interlaced image signal and to form an inter-field interpolation signal for said first field image signal by using at least one field length of a second field image signal which has horizontal scanning lines in different positions on a corresponding picture plane from said first field image signal;

(c) selective output means arranged to select and produce either said inner-field interpolation signal formed by said inner-field interpolation signal forming means or said inter-field interpolation signal formed by said inter-field interpolation signal forming means;

(d) control means for controlling said selective output means by using at least said first and second field image signals; and

(e) image signal forming means for forming a high resolution image signal by interpolating said interlaced image signal with said interpolation signal produced from said selective output means.

14. A device according to claim 13, wherein said inner-field interpolation signal forming means includes:

(a) a first extraction circuit arranged to extract, form said first field image signal, horizontal scanning line signals covering two adjacent lines; and

(b) a first computing circuit arranged to produce, as said inner-field interpolation signal, an average value signal representing the average value of said horizontal scanning line signals of two lines extracted by said first extraction circuit.

15. A device according to claim 14, wherein said inter-field interpolation signal forming means is arranged such that, of two field image signals which come before and after said first field image signal within said interlaced image signal and which have horizontal scanning lines differently located from those of said first field image signal on the corresponding picture plane, the field image signal preceding said first field image signal is assumed to be a second field image signal and the field image signal ensuing said first field image signal to be a third field image signal and that the inter-field interpolation signal is formed, for said first field image signal, by using at least one of said second and third field image signal.

16. A device according to claim 15, wherein said inter-field interpolation signal forming means includes:

(a) a second extraction circuit arranged to extract a horizontal scanning line signal which, among the plurality of horizontal scanning line signals of the second field image signal, corresponds to a position between the two scanning line signals of said first field image signal extracted by said first extraction circuit; and

(b) a third extraction circuit arranged to extract a horizontal scanning line signal which, among the plurality of horizontal scanning line signals of the third field image signal, corresponds to a position between the two scanning line signals of said first field image signal extracted by said first extraction circuit.

17. A device according to claim 16, wherein said control circuit includes:

(a) a first comparison result detection circuit arranged to produce, for said second field image signal and a third field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is extracted from said third field image signal by said third extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said first field image signal and a fourth field image signal which immediately precedes said second field image signal, the result of comparison between horizontal scanning line signals which are included in said first and fourth field image signals and correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said second field image signal and a fifth field image signal which immediately precedes said fourth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to the horizontal scanning line signal extracted by said second extraction circuit; and

(d) an instruction circuit arranged to supply an instruction signal to said selective output means to instruct the latter to selectively produce either the signal output of said first computing circuit or that of said second extraction circuit in accordance with the results of comparison produced from said first, second and third comparison result detection circuits.

18. A device according to claim 16, wherein said control circuit includes:

(a) a first comparison result detection circuit arranged to produce, for said second field image signal and a third field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is extracted from said third field image signal by said third extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said first field image signal and a fourth field image signal which immediately precedes said second image signal, the result of comparison between horizontal scanning line signals which are included in said first and fourth field image signals and correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said second field image signal and a fifth field image signal which immediately precedes said fourth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to the horizontal scanning line signal extracted by said second extraction circuit;

(d) a fourth comparison result detection circuit arranged to produce, for said fourth field image signal and a sixth field image signal which immediately precedes said fifth field image signal, the result of comparison between horizontal scanning line signals which are included in said fourth an fifth field image signals and respectively correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit; and

(e) an instruction circuit arranged to produce an instruction signal for instructing said selective output means to selectively produce either the signal output of said first computing circuit or that of said second extraction circuit in accordance with the results of comparison produced from said first, second, third and fourth comparison result detection circuits.

19. A device according to claim 18, wherein said instruction circuit includes an inverter which is arranged to invert the result of comparison produced from said fourth comparison result detection circuit;

and said instruction circuit is arranged to produce said instruction signal to cause said selective output means to produce either the signal output of said first computing circuit and that of said second extraction circuit according to the results of comparison produced from said first, second and third comparison result detection circuit and the inverted result of comparison produced from said inverter.

20. A device according to claim 16, wherein said inter-field interpolation signal forming means further includes a second computing circuit which is arranged to compute and obtain an average value signal representing the average value of the horizontal scanning line signal extracted by said second extraction circuit and the horizontal scanning line signal which is extracted by said third extraction circuit.

21. A device according to claim 20, wherein said control circuit includes:

(a) a first comparison result detection circuit arranged to produce, for said second and third field image signals, the result of comparison between said horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and said horizontal scanning line signal which is included in said third field image signal and is extracted therefrom by said third extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said first field image signal and a fourth field image signal which immediately precedes said second field image signal, the result of comparison between horizontal scanning line signals which are included in said first and fourth field image signals and correspond to said horizontal scanning line signal extracted from said second field image signal by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said second field image signal and a fifth field image signal which immediately precedes said fourth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to said horizontal scanning line signal extracted by said second extraction circuit;

(d) an instruction circuit arranged to produce an instruction signal for instructing said selective output means to selectively produce one of the signal outputs of said first and second computing circuits and said second extraction circuit according to the results of comparison produced from said first, second and third comparison result detection circuits.

22. A device according to claim 21, wherein said selective output means includes:

(a) a first selection circuit arranged to produce either the signal output of said second computing circuit or that of said second extraction circuit on the basis of the result of comparison produced from said first comparison result detection circuit; and

(b) a second selection circuit arranged to produce either the signal output of said first selection circuit or that of said computing circuit at least on the basis of the results of comparison produced from said first, second and third comparison result detection circuit.

23. An image signal conversion device for handling an interlaced image signal whereby one frame picture plane is formed by multiplexing, in an alternately time sharing manner, odd- and even-number field image signals which form said interlaced image signal and respectively correspond to odd- and even-number field picture planes consisting of horizontal scanning lines alternately located on a picture plane, said device being arranged to form a high resolution image signal by increasing the number of horizontal scanning line signals constituting each of said field image signals, said device comprising:

(a) inner field interpolation signal forming means arranged to receive said interlaced image signal, to use, as a first field image signal, a field image signal portion of said interlaced image signal received one frame period before a presently received field image signal portion for forming an inner-field interpolation signal for the first field image signal;

(b) inter-field interpolation signal forming means arranged to receive said interlaced image signal and to form an inter-field interpolation signal for said first field image signal by using a second field image signal which has horizontal scanning lines in different positions on a corresponding picture plane from said first field image signal;

(c) selective output means arranged to select and produce either the inner-field interpolation signal formed by said inner-field interpolation signal forming means or the inter-field interpolation signal formed by said inter-field interpolation signal forming means;

(d) control means for controlling said selective output means on the basis of at least said first and second field image signals; and

(e) image signal forming means for forming a high resolution image signal by interpolating said interlaced image signal with the interpolation signal produced from said selective output means.

24. A device according to claim 23, wherein said inner-field interpolation signal forming means includes:

(a) a first extraction circuit arranged to extract, from said first field image signal, horizontal scanning line signals covering two adjacent lines; and

(b) a first computing circuit arranged to produce, as said inner-field interpolation signal, an average value signal representing the average value of said horizontal scanning line signals of two lines extracted by said first extraction circuit.

25. A device according to claim 24, wherein said inter-field interpolation signal forming means includes a second extraction circuit arranged to extract, from among a plurality of horizontal scanning line signals of a field image signal which is included in the incoming interlaced image signal and has its horizontal scanning line signals differently positioned from those of said first field image signal on a corresponding picture plane, a horizontal scanning line signal corresponding to a position in between said two horizontal scanning line signals extracted from said first field image signal by said first extraction circuit.

26. A device according to claim 25, wherein said control means includes:

(a) a first comparison result detection circuit arranged to produce, for said first field image signal and a third field image signal which comes immediately after said first field image signal, the result of comparison between a horizontal scanning line signal which corresponds to a lower part of a picture plane and is extracted from said first field image signal by said first extraction circuit and a horizontal scanning line signal which is included in said third field image signal and corresponds to said horizontal scanning line signal extracted by said first extraction circuit;

(b) a second comparison result detection circuit arranged to produce, for said second field image signal and a fourth field image signal which comes immediately after said first field image signal, the result of comparison between a horizontal scanning line signal extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fourth field image signal and corresponds to said horizontal scanning line signal extracted by said second extraction circuit;

(c) a third comparison result detection circuit arranged to produce, for said first field image signal and a fifth field image signal which precedes said first field image signal by two field periods, the result of comparison between a horizontal scanning line signal which is extracted from said first field image signal by said first extraction circuit and corresponds to the lower part of a picture plane and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to said horizontal scanning line signal extracted by said first extraction circuit;

(d) a fourth comparison result detection circuit arranged to produce, for said second field image signal and a sixth field image signal which immediately precedes said fifth field image signal, the result of comparison between a horizontal scanning line signal which is extracted from said second field image signal by said second extraction circuit and a horizontal scanning line signal which is included in said fifth field image signal and corresponds to said horizontal scanning line signal extracted by said second extraction circuit; and

(e) an instruction circuit arranged to supply an instruction signal to said selective output means to cause said selective output means to produce either the signal output of said first computing circuit or that of said second extraction circuit in accordance with the results of comparison produced from said first, second, third and fourth comparison result detection circuits.