Image processing system and method, and image display system

• US 6,836,293 B2
• Filed: 06/21/2001
• Issued: 12/28/2004
• Est. Priority Date: 06/23/2000
• Status: Expired due to Term

• Current Assignee: Japan Display Central Incorporated (Japan Display Incorporated)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Itoh, Goh, Okumura, Haruhiko
• Primary Examiner(s): Lee, Michael H.
• Assistant Examiner(s): Tran, Trang U.
• Application Number:
  US09/885,138
• Publication Number:
  US 20020015104A1
• Time in Patent Office: 1,286 Days
• Field of Search: H04/N 1.120, H04/N.701, 348/441, 348/447, 348/451, 348/452, 348/620, 348/459, 348/443, 348/448, 348/558
• US Class Current: 348/452
• CPC Class Codes: G09G 1/167 Details of the interface to the display terminal specific for a CRT details suitable for both CRT and flat panel G09G5/006, specific for a flat panel G09G3/2096
• CPC Class Codes: G09G 2320/0257 Reduction of after-image effects
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2320/103 Detection of image changes, e.g. determination of an index representative of the image change
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: G09G 3/22 using controlled light sources
• CPC Class Codes: G09G 3/30 using electroluminescent panels
• CPC Class Codes: G09G 3/3651 using multistable liquid crystals, e.g. ferroelectric liquid crystals
• CPC Class Codes: G09G 5/005 Adapting incoming signals to the display format of the display terminal
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: H04N 7/01 Conversion of standards , e.g. involving analogue television standards or digital television standards processed at pixel level
• CPC Class Codes: H04N 7/0132 the field or frame frequency of the incoming video signal being multiplied by a positive integer, e.g. for flicker reduction
• CPC Class Codes: H04N 7/0137 dependent on presence/absence of motion, e.g. of motion zones H04N7/014 takes precedence; movement detection in television signals H04N5/144

Abstract

There is provided an image processing method capable of improving the picture quality. The image processing method comprises: incorporating input frame pictures to be displayed on a display device, on the basis of an input picture signal and an input synchronizing signal which is synchronized with the input picture signal; recording the incorporated input frame pictures in an input frame memory; and producing output frame pictures from input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the frame pictures, between input frame pictures corresponding to a picture information of the input frame picture to be displayed, on the basis of the picture information and the input synchronizing signal and an output synchronizing signal.

Claims

1. An image processing method comprising:

discriminating whether a display device is an impulse type display device;

incorporating input frame pictures to be displayed on the display device, on the basis of an input picture signal and an input synchronizing signal that is synchronized with the input picture signal;

recording the incorporated input frame pictures in an input frame memory;

producing output frame pictures from the input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the input frame pictures, between input frame pictures corresponding to a picture information of the input frame picture to be displayed, on the basis of the picture information and the input synchronizing signal and an output synchronizing signal, the picture information including information that indicates whether the picture to be displayed is a moving picture or a still picture; and

discriminating whether the picture to be displayed is a moving picture or a still picture, comprising;

incorporating frame pictures to be displayed, at regular intervals on the basis of the input picture signal and the input synchronizing signal;

obtaining a correlation between two frame pictures that have been continuously incorporated, the method discriminating whether the picture to be displayed is a moving picture or a still picture on the basis of the correlation result; and

when it is determined that the picture to be displayed is a moving picture, determining whether the moving picture is in a first state in which the motion of a moving object in the moving picture is rapid, or in a second state in which the moving speed of the moving object is slower than that in the first state, on the basis of the correlation,

wherein when it is discriminated that the display device is the impulse type display device, when it is discriminated that the picture to be displayed is a moving picture, and when it is determined that the moving speed of the moving object in the moving picture is in the second state, the producing of the output frame pictures comprises;

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

stopping the output of signals between the input frame pictures, or inserting and outputting a black raster picture, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

2. An image processing method as set forth in claim 1, wherein when it is discriminated that the picture to be displayed is a still picture, the producing of the output frame pictures comprises:

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

displaying the same picture between the output frame pictures, or stopping the output of signals between the input frame pictures, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

3. An image processing method as set forth in claim 1, wherein the interpolated picture or the black raster picture is selected in accordance with a spatial frequency and the frequency spectrum in one frame picture.

4. An image processing method as set forth in claim 1, wherein the interpolated picture or the black raster picture is selected in accordance with the speed of a moving object in the picture to be displayed.

5. An image processing method as set forth in claim 1, wherein the correlation is obtained on the basis of the difference between pixels corresponding to the continuously incorporated two frame pictures.

6. An image processing method as set forth in claim 1, wherein the correlation is obtained on the basis of the scalar quantity of a motion vector.

7. An image processing method as set forth in claim 1, wherein when it is discriminated that the picture to be displayed is a moving picture and when it is determined that the moving speed of the moving object in the moving picture is in the first state, the producing of the output frame pictures comprises:

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

producing an interpolated picture between the input frame pictures to output the interpolated picture, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

8. An image processing method comprising:

discriminating whether a display device is a hold type display device;

incorporating input frame pictures to be displayed on the display device, on the basis of an input picture signal and an input synchronizing signal which is synchronized with the input picture signal;

recording the incorporated input frame pictures in an input frame memory;

producing output frame pictures from the input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the input frame pictures, between input frame pictures corresponding to a picture information of the input frame picture to be displayed, on the basis of the picture information and the input synchronizing signal and an output synchronizing signal, the picture information including information which indicates whether the picture to be displayed is a moving picture or a still picture; and

discriminating whether the picture to be displayed is a moving picture or a still picture, comprising;

incorporating frame pictures to be displayed, at regular intervals on the basis of the input picture signal and the input synchronizing signal,

obtaining a correlation between two frame pictures which have been continuously incorporated, the method discriminating whether the picture to be displayed is a moving picture or a still picture on the basis of the correlation result, and

when it is determined that the picture to be displayed is a moving picture, determining whether the moving picture is in a first state in which the motion of a moving object in the moving picture is rapid, or in a second state in which the moving speed of the moving object is slower than that in the first state, on the basis of the correlation,

wherein when it is discriminated that the display device is the hold type display device, when it is discriminated that the picture to be displayed is a moving picture, and when it is determined that the moving speed of the moving object in the moving picture is in the second state, the producing of the output frame pictures comprises;

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

stopping the outputs of the output picture signal and the output synchronizing signal between the input frame pictures, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

9. An image processing method as set forth in claim 8, wherein the correlation is obtained on the basis of the difference between pixels corresponding to the continuously incorporated two frame pictures.

10. An image processing method as set forth in claim 8, wherein the correlation is obtained on the basis of the scalar quantity of a motion vector.

11. An image processing method as set forth in claim 8, wherein when it is discriminated that the picture to be displayed is a moving picture and when it is determined that the moving speed of the moving object in the moving picture is in the first state, the producing of the output frame pictures comprises:

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

producing an interpolated picture between the input frame pictures to output the interpolated picture, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

12. An image processing method as set forth in claim 8, wherein when it is discriminated that the picture to be displayed is a still picture, the producing of the output frame pictures comprises:

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

displaying the same picture between the output frame pictures, or stopping the output of signals between the input frame pictures, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

13. An image processing method as set forth in claim 8, wherein the interpolated picture or the black raster picture is selected in accordance with a spatial frequency and the frequency spectrum in one frame picture.

14. An image processing method as set forth in claim 8, wherein the interpolated picture or the black raster picture is selected in accordance with the speed of a moving object in the picture to be displayed.

15. An image processing system comprising a picture signal converting part configured to convert an input picture signal, which is a picture signal for a picture to be displayed on a display device configured to display a picture while changing the picture every frame picture, and an input synchronizing signal, which is synchronized with the input picture signal, into an output picture signal, which is a picture signal for a picture suitable for the display for the display device, and an output synchronizing signal, which is synchronized with the output picture signal, on the basis of picture information of the picture to be displayed on the display device, the picture signal converting part comprising:

a device discriminating part configured to discriminate whether a display device is an impulse type display device;

an input frame memory in which an input frame picture is recorded;

an input switching part configured to transmit an input frame picture to be displayed, to the input frame memory on the basis of the input picture signal and the input synchronizing signal;

a black raster picture producing part in which a black raster picture has been produced or stored;

a picture converting part configured to produce output frame pictures from input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the frame pictures, between frame pictures corresponding to the picture information, on the basis of the picture information and the input synchronizing signal and the output synchronizing signal;

an output frame memory in which the output frame pictures are recorded; and

an output control switching part configured to take the output picture signal and the output synchronizing signal out of the output frame pictures, which have been recorded in the output frame memory, and to transmit the signals to the display device,

wherein the picture information is information which indicates whether the picture to be displayed is a moving picture or a still picture, and which further comprises a motion discriminating part configured to discriminate whether the picture to be displayed is a moving picture or a still picture,

wherein the motion discriminating part incorporates input frame pictures to be displayed, at regular intervals on the basis of the input picture signal and input synchronizing signal, obtains the correlation between two input frame pictures which have been continuously incorporated, and discriminates whether the input frame picture to be displayed is a moving picture or a still picture on the basis of the correlation result,

wherein when it is determined that the picture to be displayed is a moving picture, the motion discriminating part determines whether the moving picture is in a first state in which the motion of a moving object in the moving picture is rapid, or in a second state in which the moving speed of the moving object is slower than that in the first state, on the basis of the correlation, and

wherein when it is discriminated that the display device is the impulse type display device, when it is discriminated that the picture to be displayed is a moving picture, and when it is determined that the moving speed of the moving object in the moving picture is in the second state, the picture converting part;

compares the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputs the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

stops the output of signals between the input frame pictures, or inserts and outputs a black raster picture, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thins out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

16. An image processing system as set forth in claim 15, wherein the motion discriminating part comprises:

a switching part configured to incorporate input frame pictures to be displayed, at regular intervals on the basis of the input picture signal and input synchronizing signal;

a plurality of frame memories configured to store therein the input frame pictures which have been incorporated by the switching part;

means for calculating a differential signal between two input frame pictures which have been continuously incorporated; and

means for discriminating whether the input frame picture to be displayed is a moving picture or a still picture on the basis of the results of the calculation.

17. An image processing system as set forth in claim 15, wherein the picture signal converting part produces the output frame pictures from the input frame pictures on the basis of a moving or still picture indicating signal, which indicates whether the kind of a picture to be displayed on the display device is a moving picture or a still picture, and the output of the motion discriminating part.

18. An image processing method comprising:

discriminating whether a display device is an impulse type display device or a hold type display device;

incorporating input frame pictures to be displayed on the display device, on the basis of an input picture signal and an input synchronizing signal which is synchronized with the input picture signal;

recording the incorporated input frame pictures in an input frame memory;

producing output frame pictures from the input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the input frame pictures, between input frame pictures corresponding to a picture information of the input frame picture to be displayed, on the basis of the picture information and the input synchronizing signal and an output synchronizing signal, the picture information including information which indicates whether the picture to be displayed is a moving picture or a still picture; and

discriminating whether the picture to be displayed is a moving picture or a still picture, comprising;

incorporating frame pictures to be displayed, at regular intervals on the basis of the input picture signal and the input synchronizing signal;

obtaining a correlation between two frame pictures which have been continuously incorporated, the method discriminating whether the picture to be displayed is a moving picture or a still picture on the basis of the correlation result; and

when it is determined that the picture to be displayed is a moving picture, determining whether the moving picture is in a first state in which the motion of a moving object in the moving picture is rapid, or in a second state in which the moving speed of the moving object is slower than that in the first state, on the basis of the correlation,

wherein when it is discriminated that the display device is the impulse type display device, when it is discriminated that the picture to be displayed is a moving picture, and when it is determined that the moving speed of the moving object in the moving picture is in the second state, the producing of the output frame pictures comprises;

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

stopping the output of signals between the input frame pictures, or inserting and outputting a black raster picture, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures, and

wherein when it is discriminated that the display device is the hold type display device, when it is discriminated that the picture to be displayed is a moving picture, and when it is determined that the moving speed of the moving object in the moving picture is in the second state, the producing of the output frame pictures comprises;

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

stopping the outputs of the output picture signal and the output synchronizing signal between the input frame pictures, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

19. An image processing method as set forth in claim 18, wherein the correlation is obtained on the basis of the difference between pixels corresponding to the continuously incorporated two frame pictures.

20. An image processing method as set forth in claim 18, wherein the correlation is obtained on the basis of the scalar quantity of a motion vector.

21. An image processing method as set forth in claim 18, wherein when it is discriminated that the picture to be displayed is a moving picture and when it is determined that the moving speed of the moving object in the moving picture is in the first state, the producing of the output frame pictures comprises:

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

producing an interpolated picture between the input frame pictures to output the interpolated picture, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

22. An image processing method as set forth in claim 18, wherein when it is discriminated that the picture to be displayed is a still picture, the producing of the output frame pictures comprises:

comparing the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputting the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

displaying the same picture between the output frame pictures, or stopping the output of signals between the input frame pictures, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thinning out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

23. An image processing method as set forth in claim 18, wherein the interpolated picture or the black raster picture is selected in accordance with a spatial frequency and the frequency spectrum in one frame picture.

24. An image processing method as set forth in claim 18, wherein the interpolated picture or the black raster picture is selected in accordance with the speed of a moving object in the picture to be displayed.

25. An image processing system comprising a picture signal converting part configured to convert an input picture signal, which is a picture signal for a picture to be displayed on a display device configured to display a picture while changing the picture every frame picture, and an input synchronizing signal, which is synchronized with the input picture signal, into an output picture signal, which is a picture signal for a picture suitable for the display for the display device, and an output synchronizing signal, which is synchronized with the output picture signal, on the basis of picture information of the picture to be displayed on the display device, the picture signal converting part comprising:

a device discriminating part configured to discriminate whether a display device is a hold type display device;

an input frame memory in which an input frame picture is recorded;

an input switching part configured to transmit an input frame picture to be displayed, to the input frame memory on the basis of the input picture signal and the input synchronizing signal;

a black raster picture producing part in which a black raster picture has been produced or stored;

a picture converting part configured to produce output frame pictures from input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the frame pictures, between frame pictures corresponding to the picture information, on the basis of the picture information and the input synchronizing signal and the output synchronizing signal;

an output frame memory in which the output frame pictures are recorded; and

an output control switching part configured to take the output picture signal and the output synchronizing signal out of the output frame pictures, which have been recorded in the output frame memory, and to transmit the signals to the display device,

wherein the picture information is information which indicates whether the picture to be displayed is a moving picture or a still picture, and which further comprises a motion discriminating part configured to discriminate whether the picture to be displayed is a moving picture or a still picture,

wherein the motion discriminating part incorporates input frame pictures to be displayed, at regular intervals on the basis of the input picture signal and input synchronizing signal, obtains the correlation between two input frame pictures which have been continuously incorporated, and discriminates whether the input frame picture to be displayed is a moving picture or a still picture on the basis of the correlation result,

wherein when it is determined that the picture to be displayed is a moving picture, the motion discriminating part determines whether the moving picture is in a first state in which the motion of a moving object in the moving picture is rapid, or in a second state in which the moving speed of the moving object is slower than that in the first state, on the basis of the correlation, and

wherein when it is discriminated that the display device is the hold type display device, when it is discriminated that the picture to be displayed is a moving picture, and when it is determined that the moving speed of the moving object in the moving picture is in the second state, the picture converting part;

compares the refresh rate of the input frame pictures with the refresh rate of the output frame pictures;

outputs the input frame pictures as the output frame picture, when the refresh rate of the input frame pictures is equal to the refresh rate of the output frame pictures;

stops the outputs of the output picture signal and the output synchronizing signal between the input frame pictures, when the refresh rate of the output frame pictures is higher than the refresh rate of the input frame pictures; and

thins out the input frame pictures to produce and output the output frame pictures, when the refresh rate of the output frame pictures is lower than the refresh rate of the input frame pictures.

26. An image processing system as set forth in claim 25, wherein the motion discriminating part comprises:

a switching part configured to incorporate input frame pictures to be displayed, at regular intervals on the basis of the input picture signal and input synchronizing signal;

a plurality of frame memories in which the input frame pictures, which have been incorporated by the switching part, are stored;

means for calculating a differential signal between two input frame pictures which have been continuously incorporated; and

means for discriminating whether the input frame picture to be displayed is a moving picture or a still picture on the basis of the results of the calculation.

27. An image processing system as set forth in claim 25, wherein the picture signal converting part produces the output frame pictures from the input frame pictures on the basis of a moving or still picture indicating signal, which indicates whether the kind of a picture to be displayed on the display device is a moving picture or a still picture, and the output of the motion discriminating part.