System for transmitting and/or storing signals corresponding to textured pictures

• US 5,533,140 A
• Filed: 11/28/1994
• Issued: 07/02/1996
• Est. Priority Date: 12/18/1991
• Status: Expired due to Fees

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Oddou, Christophe, Sirat, Jacques A.
• Primary Examiner(s): Chin, Stephen
• Assistant Examiner(s): MAY, TIMOTHY
• Application Number:
  US08/345,877
• Time in Patent Office: 582 Days
• Field of Search: 382/21, 382/22, 382/28, 382/54, 382/56, 382/108, 382/197, 382/199, 382/206, 382/286, 348/420, 348/409
• US Class Current: 382/108
• CPC Class Codes: G06T 9/008 Vector quantisation
• CPC Class Codes: H04N 19/20 using video object coding

Abstract

Device for transmitting and/or storing signals presented thereto representing the textures of different areas of a video picture. The device includes a sampling stage for deriving a reference sample of the texture signals from a given picture area, and a coding stage for coding the reference sample signal as well as area signals representative of texture over the entire area from which the sample has been taken. The coded output signals of the coding stage may be transmitted by a transmission medium such as a communication channel and/or a store. A decoding stage then decodes the coded signals, and a texture synthesis stage uses the decoded sample signals to enhance the decoded area signals, thereby effectively achieving synthesis of a reproduction of the relevant picture area having a texture closely resembling the texture of such area of the original picture.

Claims

1. Apparatus for transmitting a video picture which is received at an input of said apparatus in the form of digital signals corresponding to the luminosities of pixels of said video picture, blocks of said signals constituting texture signals representative of textures in said video picture formed by the corresponding blocks of pixels;

said apparatus comprising;

a sampling stage coupled to said input for deriving a reference sample of the texture signals relating to an area of the video picture having substantially homogeneous texture, said reference sample including data blocks representative of blocks of pixels in a sample of said area of the video picture;

a first coding stage coupled to said sampling stage for encoding said reference sample of the texture signals relating to said area of the video picture so as to form a coded reference sample signal;

a second coding stage coupled to said input for encoding the texture signals relating to said video picture so as to form coded texture signals;

a transmission medium coupled to said first and second coding stages for transmitting the coded reference sample signal and the coded texture signals, said transmission medium comprising at least one of a communication channel and storage means;

decoding means coupled to said transmission medium for receiving therefrom the transmitted coded reference sample signal and the coded texture signals, and decoding said signals to derive a decoded reference sample signal and decoded texture signals; and

picture synthesizing means coupled to said decoding means for (i) combining the decoded texture signals to derive an approximative synthesis of the video picture, and (ii) extrapolating said approximative synthesis of the video picture by replacing pixels in said area of substantially homogeneous texture with pixel blocks represented by the decoded reference sample signal, thereby completing synthesis of the video picture.

2. Apparatus as claimed in claim 1, wherein said decoding means comprises a first decoding stage for decoding the transmitted coded reference sample signal and a second decoding stage for decoding the transmitted coded texture signals, said first and second decoding stages being arranged in parallel;

and said picture synthesizing means comprises a dictionary-forming circuit and a texture extrapolation circuit, the dictionary-forming circuit forming a dictionary of data blocks corresponding to blocks of the pixels represented by the decoded reference sample signal, each data block in said dictionary being indexed to indicate the positions of pixels represented thereby in said area of the video picture, the texture extrapolation circuit extrapolating said approximative synthesis by replacing pixels corresponding to decoded texture signals with pixels corresponding to data blocks in said dictionary.

3. Apparatus as claimed in claim 2, wherein the dictionary-forming circuit and the texture extrapolation circuit repeat the operations of forming a dictionary of data blocks of the decoded reference sample signal and replacement of pixels represented by the texture signals with pixels corresponding to data blocks in said dictionary, data blocks of a different size being used in each repetition of said operations.

4. Apparatus as claimed in claim 2, wherein said sampling stage derives respective reference samples of the texture signals from areas of said picture of respectively different homogeneous textures, and said picture synthesizing means synthesizes the textures of the respective areas based on the respective reference samples.

5. Apparatus as claimed in claim 1, wherein:

said second coding stage comprises a first dictionary-forming circuit and a vector quantization (VQ) coding circuit, the first dictionary-forming circuit being coupled to said sampling stage to receive the reference sample of the texture signals corresponding to said area of substantially homogeneous texture of the video picture and produce therefrom a first dictionary of data blocks corresponding to pixels included in said area, each data block being indexed to indicate the positions of the pixels represented thereby in said area, the VQ coding circuit being coupled to said input to receive the texture signals therefrom and to encode them by vector quantization using data blocks from said first dictionary;

said decoding means comprises a first decoding circuit for decoding the transmitted coded reference sample signal and a second decoding circuit for decoding the transmitted coded texture signals by vector quantization, the first and second decoding circuits being arranged in parallel at the output of said transmission medium; and

said picture synthesizing means comprises a second dictionary-forming circuit coupled to said first decoding circuit for producing a second dictionary of data blocks of the decoded reference sample signal produced by said first decoding circuit, the data blocks in said second dictionary being indexed the same as the data blocks in said first dictionary and being supplied to said second decoding circuit for use thereby in performing said vector quantization decoding of the transmitted coded texture signals;

the vector quantization decoding of the transmitted coded texture signals resulting in digital signals representing said area of substantially homogeneous texture in said completed synthesis of the video picture.

6. Apparatus as claimed in claim 5, wherein the first and second dictionary-forming circuits repeat the formation of said first and second dictionaries of data blocks, each time using data blocks corresponding to different size blocks of pixels.

7. Apparatus as claimed in claim 5, wherein said sampling stage derives respective reference samples of the texture signals from areas of said picture of respectively different homogeneous textures, and said coding and decoding stages repeat said coding and decoding operations for each of said reference samples.

8. Apparatus as claimed in claim 5, further comprising, coupled between the input of said apparatus and said sampling stage, a picture splitting circuit and a segmentation circuit;

said picture splitting circuit being coupled to said input for receiving the digital signals and separating them into signals representing textured and non-textured areas of said picture, the non-textured signals being supplied to a further coding stage comprised in said apparatus;

said segmentation circuit being coupled to said picture splitting circuit to receive the textured area signals and separate them according to whether they relate to homogeneous or non-homogeneous texture areas of the video picture, the homogeneous texture area signals being supplied to said sampling stage and the non-homogeneous texture area signals being supplied to a contour coding circuit which is also comprised in said apparatus;

the outputs of the first and second coding stages, the contour coding circuit and the further coding stage all being supplied to said transmission medium and after decoding by said decoding means being combined by said picture synthesizing means to form said completed synthesis of the video picture.

9. A system for transmitting a video picture in the form of digital signals which include texture signals and reference sample signals, the texture signals representing textures in the video picture, the reference sample signals representing texture in samples of areas of said picture of respectively different substantially homogeneous textures;

the signals being transmitted via a transmission medium, decoded upon reception from said transmission medium, and the decoded signals being supplied to picture synthesizing apparatus for deriving a synthesis of the video picture therefrom;

characterized in that said picture synthesizing apparatus comprises;

a dictionary-forming circuit for storing a dictionary of data blocks included in each of the decoded reference sample signals, each data block including data representative of a block of pixels in the sample of the relevant area of the video picture, each data block being indexed to indicate the positions of the pixels represented thereby in said area of the video picture; and

a texture extrapolation circuit for (i) combining the decoded texture area signals so as to form an approximative synthesis of the video picture, and (ii) extrapolating said approximative synthesis by replacing pixels represented by decoded texture signals with pixels represented by data blocks in said dictionary;

the pixels represented by the data blocks in said dictionary being positioned in the synthesized video picture in accordance with the indexing in said dictionary.