Correlator device

• US 5,247,586 A
• Filed: 12/12/1991
• Issued: 09/21/1993
• Est. Priority Date: 12/21/1990
• Status: Expired due to Fees

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Gobert, Jean, Sirat, Jacques A.
• Primary Examiner(s): Boudreau, Leo H.
• Application Number:
  US07/806,023
• Time in Patent Office: 649 Days
• Field of Search: 382/30, 382/34, 382/42, 364/728.03, 364/728.05, 358/105
• US Class Current: 382/278
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation

Abstract

Correlation device calculating a correlation between a current block of a first image and symbol blocks taken from a second image to determine the displacement vectors. Selection means (26) (27) select a limited number of symbols contained in the said blocks to which the correlation calculation relates. This selection can be effected by either a random choice or as a function of the data content of the blocks. The said current block can be divided into zones onto which the selection means act. A correlator (25) performs the correlation calculation block-sequentially on the overall current block and a decision unit (28) determines the displacement vector. It is possible to chose for the correlator (25) an architecture which promotes either its calculation rate or a reduction in its hardware bulk. The invention is used to reduce the flow of data to be transmitted, more specifically for image (television, videophone) or sound processing.

Claims

1. A correlator device acting on input signals which represent symbols organized in blocks in accordance with a regular configuration, comprising:

a correlator determining a correlation between the symbols of a current block and symbols having identical positions in a sequence of blocks to be processed coming from said configuration,

and selection means selecting from the symbols of said current block a limited number of reference symbols to which the correlation relates, characterized, in that, the selection means select, in the said current block, a reference symbol or symbols by chosing its/their position(s);

either as a function of the data content of the said current block,

or in accordance with a random selection,

or for a first portion preferably as a function of the data content and for a second portion according to a random selection.

2. A device as claimed in claim 1, wherein, the same random selection is used for a plurality of current blocks for selecting the position of the randomly selected reference symbol(s).

3. A device as claimed in claim 1, wherein the said position adapted to the data content is determined from a distortion function calculated for each symbol of the current block with respect to the surrounding symbols, the selected reference symbol(s) being chosen from the symbols of the current block whose values of the distortion function differ most from those with respect to the surrounding symbols.

4. A device as claimed in claim 3, characterized, in that, the said distortion function is determined by calculating a laplacian relating to a characteristic inherent to the input signal.

5. A device as claimed in claim 1, wherein that, the current block is divided into several blocks, the selection means acting separately on each zone, the correlation acting on the totality of the selected reference symbols of the current block.

6. A device as claimed in claim 5, wherein that, the reference symbol(s) of a zone is(are) selected in such a manner that the distortion function is alternately maximal and minimal for contiguous zones.

7. A device as claimed in claim 1, wherein that, it includes a neural network which adaptively determines the number of reference symbols as a function of the data content by calculating suitable values of the correlation matrix and the variances, said number of symbols being equal to the number of highest variances which are characteristic of the set of input signals.

8. A device as claimed in claim 1, wherein that, the symbols, organized in a regular configuration are pixels constituting an image, the correlation device acting on blocks of 4×

4 reference pixels from which n reference pixels are selected (n<

N1²), the correlations being determined between a current block and blocks of a window taken in the image, the current block being obtained from a preceding or a subsequent image to determine the displacement vectors of the image blocks.

9. A device as claimed in claim 1, wherein that, the symbols are binary encoded values representing a unidimensional acoustic signal configuration, the correlation device acting on current blocks enclosing several of the said values from which reference values are selected in a limited number and in position.

10. A device as claimed in claim 1 which effects a displacement vector calculation relative to a set of data blocks to be processed contained in a window, characterized, in that, the correlator effects a correlation calculation using current data blocks subdivided into p zones with n/p selected reference symbols per zone, the correlator comprising:

a systolic network of registers in which pixel data of the window are transferred from one register to the other,

a plurality of processors, each processor effecting a calculation of the correlation of at least one displacement vector, the device making operative a first calculating stage during which;

a) each processor performs a correlation calculation on the successive n/p selected reference symbols of a first zone, the said calculation successively bearing on all the displacement vectors the said processor is to calculate,

b) storage means store the intermediate results supplied by the processors at the end of a),

c) transfer means transfer the content of the registers acting on a zone to subsequent registers acting on a next zone, the said first calculation stage being thereafter reiterated for the subsequent p-1 zones, summing means determining the sum of the intermediate results relative to each block to be processed to supply the correlations of the said sequence of blocks.

11. A device as claimed in claim 10, wherein the correlator acts on a bidimensional pixel window having current blocks divided into rectangular zones containing k pixels, one single reference pixels being selected per zone, a bidimensional matrix of registers storing, at a given instant, the pixels of the said window according to the same lay-out, k registers being assigned to the processing of a zone, rows of the said registers exchanging pixels of the window in the two directions of the matrix, a processor being assigned to the consecutive processing of k displacement vectors while operating with k registers containing pixels belonging to the same zone, the serial numbers of the pixels being consecutive in both directions, a selection signal causing each processor to operate, for each displacement, with the data of the register corresponding to the selected reference pixel of the current zone.

12. A device as claimed in claim 10, wherein the correlator acts on a bidimensional pixel window having blocks divided into zones containing 4 pixels each, one single pixel being selected in each zone, a bidimensional matrix of registers storing, at a given instant, the pixels of the said window according to the same lay-out, four registers being assigned to the processing of a zone, rows of the said registers exchanging, in both directions of the matrix, even pixels of the window and further register rows exchanging odd pixels of the window, this exchange being unidirectional in one direction of the window and bidirectional in the other direction of the window, a processor being assigned to the processing of each displacement vector and operating with four registers containing even and odd pixels of the window, the serial numbers of the said pixels taken two by two being consecutive in each direction, a common selection signal causing the processors to opeate with the data of the registers corresponding to the selected reference pixels in the current block.