Foreground/background detector

• US 6,771,799 B2
• Filed: 05/15/2001
• Issued: 08/03/2004
• Est. Priority Date: 05/18/2000
• Status: Expired due to Fees

• Current Assignee: Dynamic Data Technologies LLC
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: De Haan, Gerard, Mertens, Mark Jozef Willem
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US09/858,009
• Publication Number:
  US 20020085096A1
• Time in Patent Office: 1,176 Days
• Field of Search: 382/103, 382/107, 382/149, 382/197, 382/236, 382/253, 382/287, 348/97, 348/154, 348/155, 348/208.1, 348/208.2, 348/208.4, 348/208.16, 348/352, 348/585, 348/699
• US Class Current: 382/107
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109

Abstract

A detector for detecting the foreground or background vector near a discontinuity in a vector field has a covering-uncovering detector (3)for determining whether covering or uncovering situation exists. The detector further has calculating means (1,2,4) for calculating at the position {right arrow over (x)}₁ of the discontinuity:

a first position {right arrow over (x)}_a in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (x)}₁ over the first vector at one side of the discontinuity,

a second position {right arrow over (x)}_b in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (x)}₁ over the second vector at the other side of the discontinuity

and a third intermediate position between {right arrow over (x)}_a and {right arrow over (x)}_b.

Furthermore, the detector has means (5) for fetching the background vector with v_{{right arrow over (a)}v} at the third position in the previous (covering) or next (uncovering) vector field.

Claims

1. A method for detecting the foreground or background vector near a discontinuity in a vector field, characterized in that the method comprises determining whether covering or uncovering situation exists, that, at the position {right arrow over (x)}₁ of the discontinuity, the method comprises the steps:

calculating a first position {right arrow over (x)}_a in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (x)}₁ over the first vector at one side of the discontinuity;

calculating a second position {right arrow over (x)}_b in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (x)}₁ over the second vector at the other side of the discontinuity; and

calculating a third intermediate position between {right arrow over (x)}_a and {right arrow over (x)}_b,

wherein the vector fetched with v_{{right arrow over (a)}v} at the third position in the previous (covering) or next (uncovering) vector field is the background vector.

2. The method as claimed in claim 1, characterized in that the intermediate position is ({right arrow over (x)}_a+{right arrow over (x)}_b)/2.

3. The method as claimed in claim 1, characterized in that the vector fetched with v_{{right arrow over (a)}v} at the first position in the previous (covering) or next (uncovering) image is filled in those regions of the image in the environment of the edge, to which no vector is projected, in case the background vector v_{{right arrow over (B)}G} should be filled in, and the vector chosen between $\stackrel{->}{D}$



(x->

-(10),n)

 



and

 



D->



(x->

+(10),n)

which is most different from v_{{right arrow over (a)}v} is filled in, in case a foreground vector v_{{right arrow over (F)}G} should be filled in.

4. A method for detecting the foreground or background vector near a discontinuity in a vector field, characterized in that the method comprises the steps:

determining whether covering or uncovering situation exists;

projecting the discontinuity to the previous vector field in the covering situation and to the future vector field in the uncovering situation; and

testing, near discontinuities, whether the mentioned edge has moved over the first vector on one side of the discontinuity, or over the second vector on the other side of the discontinuity, wherein, in case the discontinuity moves with the first (second) vector, the second (first) vector is the background vector v_{{right arrow over (B)}G}.

5. The method as claimed in claim 4, characterized in that the mentioned edge has moved over the first vector on one side of the edge, or over the second vector on the other side of the edge, in case the edge moves with the first vector with which the discontinuity moves, is filled in those regions of the projected vector field in the environment of the discontinuity, to which no vector is projected, in case a foreground vector v_{{right arrow over (F)}G} should be filled in, and the other vector is filled in, in case a background vector v_{{right arrow over (B)}G} should be filled.

6. A detector for detecting the foreground or background vector near a discontinuity in a vector field, characterized in that said detector comprises:

a covering-uncovering detector for determining whether covering or uncovering situation exists;

calculating means for calculating, at the position {right arrow over (x)}₁ of the discontinuity,

a first position {right arrow over (x)}_a in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (x)}₁ over the first vector at one side of the discontinuity,

a second position {right arrow over (x)}_b in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (x)}₁ over the second vector at the other side of the discontinuity, and

a third intermediate position between {right arrow over (x)}_a and {right arrow over (x)}_b; and

means for fetching the background vector with v_{{right arrow over (a)}v} at the third position in the previous (covering) or next (uncovering) vector field.

7. The detector as claimed in claim 6, characterized in that the intermediate position is ({right arrow over (x)}_a+{right arrow over (x)}_b)/2.

8. The detector as claimed in claim 6, characterized in that the vector fetched with v_{{right arrow over (a)}v} at the first position in the previous (covering) or next (uncovering) image is filled in those regions of the image in the environment of the edge, to which no vector is projected, in case the background vector v_{{right arrow over (B)}G} should be filled in, and the vector chosen between $\stackrel{->}{D}$



(x->

-(10),n)

 



and

 



D->



(x->

+(10),n)

which is most different from v_{{right arrow over (a)}v} is filled in, in case a foreground vector v_{{right arrow over (F)}G} should be filled in.

9. A detector for detecting the foreground or background vector near a discontinuity in a vector field, characterized in that said detector comprises:

a covering-uncovering detector for determining whether covering or uncovering situation exists;

means for projecting the discontinuity to the previous vector field in the covering situation and to the future vector field in the uncovering situation; and

testing means for testing near discontinuities whether the mentioned edge has moved over the first vector on one side of the discontinuity, or over the second vector on the other side of the discontinuity, wherein, in case the discontinuity moves with the first (second) vector, the second (first) vector is the background vector v_{{right arrow over (B)}G}.

10. The detector as claimed in claim 9, characterized in that the mentioned edge has moved over the first vector on one side of the edge, or over the second vector on the other side of the edge, in case the edge moves with the first (second) vector with which the discontinuity moves, the second (first) vector is filled in those regions of the projected vector field in the environment of the discontinuity, to which no vector is projected, in case a foreground vector v_{{right arrow over (F)}G} should be filled in, and the other vector is filled in, in case a background vector v_{{right arrow over (B)}G} should be filled.

11. An image display apparatus comprising:

a covering-uncovering detector for determining whether covering or uncovering situation exists;

calculating means for calculating, at the position {right arrow over (X)}₁ of the discontinuity,

a first position {right arrow over (X)}_a in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (X)}₁ over the first vector at one side of the discontinuity,

a second position {right arrow over (X)}_b in the previous (covering) or next (uncovering) vector field by shifting {right arrow over (X)}₁ over the second vector at the other side of the discontinuity, and

a third intermediate position between {right arrow over (X)}_a and {right arrow over (X)}_b; and

means for fetching the background vector with V_av at the third position in the previous (covering) or next (uncovering) vector field.

filling means for filling the foreground/background vector detected by the detector; and

a display device connected to the filling means.