Multi-window apparatus

• US 5,977,946 A
• Filed: 01/16/1997
• Issued: 11/02/1999
• Est. Priority Date: 12/16/1993
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Mizobata, Norihiko
• Primary Examiner(s): Shalwala, Bipin H.
• Assistant Examiner(s): Kovalick, Vincent E.
• Application Number:
  US08/783,910
• Time in Patent Office: 1,020 Days
• Field of Search: 345/112, 345/113, 345/114, 345/147, 345/150, 345/153, 345/155, 345/431, 345/432, 348/576
• US Class Current: 345/418
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/06 using colour palettes, e.g. look-up tables
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/30 Control of display attribute
• CPC Class Codes: G09G 5/395 Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen G09G5/399 takes precedence
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/20 Circuitry for controlling amplitude response
• CPC Class Codes: H04N 5/57 Control of contrast or brightness

Abstract

A video memory stores a plurality of image data, and an attribute storage means stores image attributes indicating whether or not the respective image data require expansion of a luminance range. An image data conversion means receives an image data digital signal output from the video memory and an image attribute signal output from the attribute storage means. When the image attribute signal provides an instruction to expand the luminance range, the image data conversion means outputs, to a display unit, a display data analog signal representing a higher luminance value, as compared with the display data analog signal to be output therefrom when the image attribute signal provides no instruction to expand the luminance range.

Claims

1. An image data conversion apparatus which receives an image data digital signal output from a video memory having a plurality of storage areas where a plurality of image data are respectively stored, and also receives an image attribute signal output from an attribute storage means where information on whether expansion of a luminance range is required or not is stored as an image attribute corresponding to each of said storage areas, said image attribute signal providing an instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is required, or providing no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required,

said image data conversion apparatus then generating a display data analog signal which allows a display unit to display an image, and thereafter outputting the thus generated signal to the display unit,

wherein a luminance value represented by said display data analog signal is increased only when the received image attribute signal provides the instruction to expand the luminance range.

2. The image data conversion apparatus of claim 1, comprising:

a luminance conversion means which performs luminance conversion on said image data digital signal input thereto so as to expand the luminance range, and outputs the result of the conversion as a luminance-converted image data digital signal;

a data selection means which receives said image data digital signal, said luminance-converted image data digital signal and said image attribute signal, and selects said luminance-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal; and

a D/A conversion means which converts, from digital to analog form, the image data digital signal or luminance-converted image data digital signal output from said data selection means, and outputs the result of the conversion as said display data analog signal.

3. The image data conversion apparatus of claim 1, comprising:

a first color conversion means which performs color conversion on said image data digital signal input thereto, and outputs the result of the conversion as a first color-converted image data digital signal;

a second color conversion means which performs color conversion on said image data digital signal input thereto and also performs luminance conversion on it so as to expand the luminance range, and then outputs the results of the conversion as a second color-converted image data digital signal;

a data selection means which receives said first color-converted image data digital signal, said second color-converted image data digital signal and said image attribute signal, and selects said second color-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said first color-converted image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal; and

a D/A conversion means which converts, from digital to analog form, the first or second color-converted image data digital signal output from said data selection means, and outputs the result of the conversion as said display data analog signal.

4. The image data conversion apparatus of claim 1, comprising:

first D/A conversion means which converts said image data digital signal input thereto from digital to analog form, and outputs the result of the conversion as a first image data analog signal;

second D/A conversion means which converts said image data digital signal input thereto from digital to analog form at a higher maximum output signal level as compared with said first D/A conversion means, and outputs the result of the conversion as a second image data analog signal; and

a data selection means which receives said first image data analog signal, said second image data analog signal and said image attribute signal, and selects said second image data analog signal when said image attribute signal provides the instruction to expand the luminance range, or selects said first image data analog signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal as said display data analog signal.

5. The image data conversion apparatus of claim 1, comprising:

a D/A conversion means which converts said image data digital signal input thereto from digital to analog form, and outputs the result of the conversion as an image data analog signal; and

an amplifying means which receives said image data analog signal and said image attribute signal, and amplifies the received image data analog signal by a relatively high amplification factor when said image attribute signal provides the instruction to expand the luminance range, or amplifies the received image data analog signal by a relatively low amplification factor when said image attribute signal provides no instruction to expand the luminance range, and then outputs the result of the amplification as said display data analog signal.

6. An image data conversion apparatus which receives an image data digital signal output from a video memory having a plurality of storage areas where a plurality of image data are respectively stored, and also receives an image attribute signal output from an attribute storage means where a rate of expansion of a luminance range as well as information on whether the expansion of the luminance range is required or not is stored as an image attribute corresponding to each of said storage areas, said image attribute signal providing an instruction to expand the luminance range and also indicating the rate of expansion of the luminance range when said image attribute indicates that the expansion of the luminance range is required, or providing no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required,

said image data conversion apparatus then generating a display data analog signal which allows a display unit to display an image, and thereafter outputting the thus generated signal to the display unit,

wherein a luminance value represented by said display data analog signal is increased in accordance with the received image attribute signal only when the image attribute signal provides the instruction to expand the luminance range.

7. The image data conversion apparatus of claim 6, comprising:

a plurality of luminance conversion means which perform luminance conversion on said image data digital signal input thereto so as to expand the luminance range, and output their respective results of the conversion as luminance-converted image data digital signals;

a data selection means which receives said image data digital signal, said luminance-converted image data digital signals and said image attribute signal, and selects one digital signal from among said image data digital signal and said luminance-converted image data digital signals in accordance with said image attribute signal; and

a D/A conversion means which converts, from digital to analog form, the digital signal selected by said data selection means, and outputs the result of the conversion as said display data analog signal.

8. The image data conversion apparatus of claim 6, comprising:

a plurality of D/A conversion means which convert said image data digital signal input thereto from digital to analog form at different maximum output signal levels, and output their respective results of the conversion as image data analog signals; and

a data selection means which receives said image data analog signals and said image attribute signal, and selects one analog signal from among said image data analog signals in accordance with said image attribute signal, and then outputs the thus selected analog signal as said display data analog signal.

9. An image data conversion apparatus which receives a non-luminance-adjusted image data digital signal output from a main memory having a plurality of storage areas where a plurality of image data are respectively stored, and also receives an image attribute signal output from an attribute storage means where information on whether expansion of a luminance range is required or not is stored as an image attribute corresponding to each of said storage areas, said image attribute signal providing an instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is required, or providing no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required,

said image data conversion apparatus then generating a luminance-adjusted image data digital signal and outputting it to a video memory,

wherein a luminance value represented by said luminance-adjusted image data digital signal is increased only when the received image attribute signal provides the instruction to expand the luminance range.

10. The image data conversion apparatus of claim 9, comprising:

a luminance conversion means which performs luminance conversion on said non-luminance-adjusted image data digital signal input thereto so as to expand the luminance range, and outputs the result of the conversion as a luminance-converted image data digital signal; and

a data selection means which receives said non-luminance-adjusted image data digital signal, said luminance-converted image data digital signal and said image attribute signal, and selects said luminance-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said non-luminance-adjusted image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal as said luminance-adjusted image data digital signal.

11. The image data conversion apparatus of claim 9, comprising:

a first color conversion means which performs color conversion on said non-luminance-adjusted image data digital signal input thereto, and outputs the result of the conversion as a first color-converted image data digital signal;

a second color conversion means which performs color conversion on said non-luminance-adjusted image data digital signal input thereto and also performs luminance conversion on it so as to expand the luminance range, and then outputs the results of the conversion as a second color-converted image data digital signal; and

a data selection means which receives said first colorconverted image data digital signal, said second color-converted image data digital signal and said image attribute signal, and selects said second color-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said first color-converted image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal as said luminance-adjusted image data digital signal.

12. An image data conversion apparatus which receives a non-luminance-adjusted image data digital signal output from a main memory having a plurality of storage areas where a plurality of image data are respectively stored, and also receives an image attribute signal output from an attribute storage means where a rate of expansion of a luminance range as well as information on whether the expansion of the luminance range is required or not is stored as an image attribute corresponding to each of said storage areas, said image attribute signal providing an instruction to expand the luminance range and also indicating the rate of expansion of the luminance range when said image attribute indicates that the expansion of the luminance range is required, or providing no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required,

said image data conversion apparatus then generating a luminance-adjusted image data digital signal and outputting it to a video memory,

wherein a luminance value represented by said luminance-adjusted image data digital signal is increased in accordance with the received image attribute signal only when the image attribute signal provides the instruction to expand the luminance range.

13. The image data conversion apparatus of claim 12, comprising:

a plurality of luminance conversion means which perform luminance conversion on the non-luminance-adjusted image data digital signal input thereto so as to expand the luminance range, and output their respective results of the conversion as luminance-converted image data digital signals; and

a data selection means which receives said non-luminance-adjusted image data digital signal, said luminance-converted image data digital signals and said image attribute signal, and selects one digital signal from among said non-luminance-adjusted image data digital signal and said luminance-converted image data digital signals in accordance with said image attribute signal, and then outputs the thus selected digital signal as said luminance-adjusted image data digital signal.

14. A multi-widow apparatus comprising:

an image combining means for combining a plurality if images; and

a display unit for displaying, on a screen, an image that is obtained by combining said plurality of images by said image combining means,

wherein said image combining means distinguishes a first image from a second image, said first image requiring a relative expansion of its luminance range with respect to said second image, converts luminance ranges of at least one of said first and second images so that an upper limit of the luminance range of said first image exceeds an upper limit of the luminance range of said second image, and then combines said first and second images.

15. The multi-window apparatus of claim 14,

wherein said image combining means expands the luminance range of only said first image, and then combines said first and second images.

16. The multi-window apparatus of claim 15, wherein said image combining means comprises:

a video memory which has a plurality of storage areas for respectively storing a plurality of image data, and outputs, as an image data digital signal, the image data stored in the respective storage areas;

an attribute storage means for storing, as an image attribute corresponding to each of said storage areas, information on whether expansion of a luminance range is required or not, and for outputting an image attribute signal which provides an instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range when said image attribute indicates that the expansion of the luminance range is not required; and

an image data conversion means which receives the image data digital signal output from said video memory and the image attribute signal output from said attribute storage means, and generates a display data analog signal for allowing said display unit to display the image, and then outputs the thus generated signal to the display unit, said image data conversion means increasing a luminance value represented by said display data analog signal only when said image attribute signal provides the instruction to expand the luminance range.

17. The multi-window apparatus of claim 16, wherein said image data conversion means comprises:

a luminance conversion means which performs luminance conversion on said image data digital signal input thereto so as to expand the luminance range, and outputs the result of the conversion as a luminance-converted image data digital signal;

a data selection means which receives said image data digital signal, said luminance-converted image data digital signal and said image attribute signal, and selects said luminance-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal; and

a D/A conversion means which converts, from digital to analog form, the image data digital signal or luminance-converted image data digital signal output from said data selection means, and outputs the result of the conversion as said display data analog signal.

18. The multi-window apparatus of claim 14,

wherein said second image represents an object by contrast with the background, and

wherein said first image has a continuing luminance distribution between one and another peaks in a luminance distribution of said second image.

19. The multi-window apparatus of claim 18,

wherein said first image includes photograph or motion video image, and

wherein said second image includes character image or computer graphics.

20. The multi-window apparatus of claim 18,

wherein said first image is an image produced by using a camera, and

wherein said second image is an image produced by a computer.

21. The multi-window apparatus of claim 15, wherein said image combining means comprises:

a main memory which has a plurality of storage areas for respectively storing a plurality of image data, and outputs, as a non-luminance-adjusted image data digital signal, the image data stored in the respective storage areas;

an attribute storage means for storing, as an image attribute corresponding to each of said storage areas, information on whether expansion of a luminance range is required or not, and for outputting an image attribute signal which provides an instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is required, or provides no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required;

a first image data conversion means which receives the non-luminance-adjusted image data digital signal output from said main memory and the image attribute signal output from said attribute storage means, and outputs a luminance-adjusted image data digital signal, said first image data conversion means increasing a luminance value represented by said luminance-adjusted image data digital signal only when said image attribute signal provides the instruction to expand the luminance range;

a video memory which first stores, in the form of image data, said luminance-adjusted image data digital signal output from said first image data conversion means, and then outputs the stored image data as an image data digital signal; and

a second image data conversion means which receives the image data digital signal output from said video memory, and generates and outputs a display data analog signal.

22. The multi-window apparatus of claim 21, wherein said first image data conversion means comprises:

a luminance conversion means which performs luminance conversion on said non-luminance-adjusted image data digital signal input thereto so as to expand the luminance range, and outputs the result of the conversion as a luminance-converted image data digital signal; and

a data selection means which receives said non-luminance-adjusted image data digital signal, said luminance-converted image data digital signal and said image attribute signal, and selects said luminance-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said non-luminance-adjusted image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal as said luminance-adjusted image data digital signal.

23. The multi-window apparatus of claim 21, wherein said first image data conversion means comprises:

a first color conversion means which performs color conversion on said non-luminance-adjusted image data digital signal input thereto, and outputs the result of the conversion as a first color-converted image data digital signal;

a second color conversion means which performs color conversion on said non-luminance-adjusted image data digital signal input thereto and also performs luminance conversion on it so as to expand the luminance range, and then outputs the results of the conversion as a second color-converted image data digital signal; and

a data selection means which receives said first color-converted image data digital signal, said second color-converted image data digital signal and said image attribute signal, and selects said second color-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said first color-converted image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal as said luminance-adjusted image data digital signal.

24. The multi-window apparatus of claim 21,

wherein said attribute storage means stores, as the image attribute corresponding to each of said storage areas, a rate of expansion of the luminance range as well as the information on whether the expansion of the luminance range is required or not, and outputs an image attribute signal which not only provides the instruction to expand the luminance range but also indicates the rate of expansion of the luminance range when said image attribute indicates that the expansion of the luminance range is required, or provides no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required, and

said first image data conversion means comprises:

a plurality of luminance conversion means which perform luminance conversion on the non-luminance-adjusted image data digital signal input thereto so as to expand the luminance range, and output their respective results of the conversion as luminance-converted image data digital signals; and

a data selection means which receives said non-luminance-adjusted image data digital signal, said luminance-converted image data digital signals and said image attribute signal, and selects one digital signal from among said non-luminance-adjusted image data digital signal and said luminance-converted image data digital signals in accordance with said image attribute signal, and then outputs the thus selected digital signal as said luminance-adjusted image data digital signal.

25. The multi-window apparatus of claim 16, wherein said image data conversion means comprises:

a first color conversion means which performs color conversion on said image data digital signal input thereto, and outputs the result of the conversion as a first color-converted image data digital signal;

a second color conversion means which performs color conversion on said image data digital signal input thereto and also performs luminance conversion on it so as to expand the luminance range, and then outputs the results of the conversion as a second color-converted image data digital signal;

a data selection means which receives said first color-converted image data digital signal, said second color-converted image data digital signal and said image attribute signal, and selects said second color-converted image data digital signal when said image attribute signal provides the instruction to expand the luminance range, or selects said first color-converted image data digital signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal; and

a D/A conversion means which converts, from digital to analog form, the first or second color-converted image data digital signal output from said data selection means, and outputs the result of the conversion as said display data analog signal.

26. The multi-window apparatus of claim 16, wherein said image data conversion means comprises:

a first D/A conversion means which converts said image data digital signal input thereto from digital to analog form, and outputs the result of the conversion as a first image data analog signal;

a second D/A conversion means which converts said image data digital signal input thereto from digital to analog form at a higher maximum output signal level as compared with said first D/A conversion means, and outputs the result of the conversion as a second image data analog signal; and

a data selection means which receives said first image data analog signal, said second image data analog signal and said image attribute signal, and selects said second image data analog signal when said image attribute signal provides the instruction to expand the luminance range, or selects said first image data analog signal when said image attribute signal provides no instruction to expand the luminance range, and then outputs the thus selected signal as said display data analog signal.

27. The multi-window apparatus of claim 16, wherein said image data conversion means comprises:

a D/A conversion means which converts said image data digital signal input thereto from digital to analog form, and outputs the result of the conversion as an image data analog signal; and

an amplifying means which receives said image data analog signal and said image attribute signal, and amplifies the received image data analog signal by a relatively high amplification factor when said image attribute signal provides the instruction to expand the luminance range, or amplifies the received image data analog signal by a relatively low amplification factor when said image attribute signal provides no instruction to expand the luminance range, and then outputs the result of the amplification as said display data analog signal.

28. The multi-window apparatus of claim 16,

wherein said attribute storage means stores, as the image attribute corresponding to each of said storage areas, a rate of expansion of the luminance range as well as the information on whether the expansion of the luminance range is required or not, and outputs an image attribute signal which not only provides the instruction to expand the luminance range but also indicates the rate of expansion of the luminance range when said image attribute indicates that the expansion of the luminance range is required, or provides no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required, and

said image data conversion means comprises:

a plurality of luminance conversion means which perform luminance conversion on said image data digital signal input thereto so as to expand the luminance range, and output their respective results of the conversion as luminance-converted image data digital signals;

a data selection means which receives said image data digital signal, said luminance-converted image data digital signals and said image attribute signal, and selects one digital signal from among said image data digital signal and said luminance-converted image data digital signals in accordance with said image attribute signal; and

a D/A conversion means which converts, from digital to analog form, the digital signal selected by said data selection means, and outputs the result of the conversion as said display data analog signal.

29. The multi-window apparatus of claim 16,

wherein said attribute storage means stores, as the image attribute corresponding to each of said storage areas, a rate of expansion of the luminance range as well as the information on whether the expansion of the luminance range is required or not, and outputs an image attribute signal which not only provides the instruction to expand the luminance range but also indicates the rate of expansion of the luminance range when said image attribute indicates that the expansion of the luminance range is required, or provides no instruction to expand the luminance range when said image attribute indicates that the expansion of the luminance range is not required, and

said image data conversion means comprises:

a plurality of D/A conversion means which convert said image data digital signal input thereto from digital to analog form at different maximum output signal levels, and output their respective results of the conversion as image data analog signals; and

a data selection means which receives said image data analog signals and said image attribute signal, and selects one analog signal from among said image data analog signals in accordance with said image attribute signal, and then outputs the thus selected analog signal as said display data analog signal.

30. A method of displaying a plurality of images on a screen, comprising the steps of:

combining a plurality of images; and

displaying, on said screen, an image that is obtained by combining said plurality of images by said combining step;

wherein said combining step comprises;

a first step of distinguishing a first image from a second image, said first image requiring a relative expansion of its luminance range with respect to said second image;

a second step of converting a luminance range of at least one of said first and second images so that an upper limit of the luminance range of said first image exceeds an upper limit of the luminance range of said second image; and

a third step of combining said first and second images.

31. The method of displaying a plurality of images on a screen according to claim 30,

wherein said second step includes the step of expanding the luminance range of only said first image.

32. The method of displaying a plurality of images on a screen according to claim 30,

wherein said second image represents an object by contrast with the background, and said first image has a continuing luminance distribution between one and another peaks in a luminance distribution of said second images.