Method for mixing pictures

• US 6,304,245 B1
• Filed: 09/24/1998
• Issued: 10/16/2001
• Est. Priority Date: 09/30/1997
• Status: Expired due to Term

• Current Assignee: Qualcomm, Inc.
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Groenenboom, Johannes C.
• Primary Examiner(s): Brier, Jeffery
• Assistant Examiner(s): YANG, RYAN R
• Application Number:
  US09/159,991
• Time in Patent Office: 1,118 Days
• Field of Search: 345/114, 345/435, 345/113, 345/428, 345/136, 348/552
• US Class Current: 345/611
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

A method for mixing a foreground picture and a background picture having different resolutions. Parts of the foreground picture of which the color complies with a color-key are designated as being transparent. Artifacts which are caused by scaling of a foreground picture which contains transparent parts by conventional means are avoided by mixing the foreground picture and the background picture at an intermediate resolution, which is substantially equal to the least common multiple of the resolution of the foreground picture and the resolution of the background picture. Alternatively, instead of actually scaling the pictures to the intermediate resolution, a phase table can be used, the entries of which prescribe how a background pixel should be combined with a predetermined number of foreground pixels.

Claims

1. A method for mixing a foreground picture and a background picture, a resolution of the foreground picture differing from a corresponding resolution of the background picture, the method comprising the steps:

designating parts of the foreground picture as being transparent; and

replacing transparent parts of the foreground picture by underlying parts of the background picture, the foreground picture and the background picture being converted to a common target resolution, characterized in that the step of replacing transparent parts of the foreground picture by underlying parts of the background picture is effectively accomplished at an intermediate resolution different from the target resolution, said intermediate resolution being substantially equal to the least common multiple of the resolution of the foreground picture and the corresponding resolution of the background picture, and not equal to the resolution of either said foreground picture or said background picture.

2. The method as claimed in claim 1, characterized in that the method further comprises the steps:

determining a fraction which substantially represents the proportion between the resolution of the foreground picture and the resolution of the background picture;

scaling the foreground picture and the background picture to the intermediate resolution by replicating pixels of the foreground picture a number of times equal to a predetermined multiple of the denominator of the fraction, and by replicating pixels of the background picture a number of times equal to the predetermined multiple of the numerator of the fraction;

forming a result picture by replacing, at the intermediate resolution, transparent pixels of the foreground picture by underlying pixels of the background picture; and

converting the resolution of the result picture from the intermediate resolution to the target resolution.

3. The method as claimed in claim 2, characterized in that the predetermined multiple is two.

4. The method as claimed in claim 1, characterized in that the method further comprises the steps:

constructing a table having entries each comprising weight factors defining the contribution of a predetermined number of input pixels from the foreground picture to an output pixel of a result picture, the weight factors being computed in a predetermined way to predict the effects of mixing the background picture and the foreground picture at the intermediate resolution; and

producing output pixels of the result picture by processing one input pixel from the background picture and the predetermined number of input pixels from the foreground picture, wherein the processing comprising the steps;

(1) replacing transparent pixels from the foreground picture by the pixel from the background picture, the replacement yielding replaced pixels with the same weight factors as the transparent pixels;

(2) averaging the replaced pixels and opaque pixels from the foreground picture in proportion to their respective weight factors; and

(3) skipping one input pixel from the background picture and a number of input pixels from the foreground picture.

5. The method as claimed in claim 4, characterized in that each table entry further comprises a skip factor which defines the number of input pixels from the foreground picture which have to be skipped after production of the output pixel.

6. The method as claimed in claim 4, characterized in that the target resolution is equal to the resolution of the background picture.

8. The display apparatus as claimed in claim 6, characterized in that the predetermined multiple is two.

10. The display apparatus as claimed in claim 8, characterized in that each table entry further comprises a skip factor for determining the number of input pixels from the foreground picture which have to be skipped after the output pixel has been produced.

7. A display apparatus comprising:

first and second inputs for receiving a foreground picture and a background picture, respectively, a resolution of the foreground picture differing from a corresponding resolution of the background picture, and the foreground picture comprising transparent parts;

scaling means for converting the resolution of the foreground picture and the background picture to a common target resolution; and

mixing means for mixing the foreground picture and the background picture by replacing the transparent parts of the foreground picture by underlying parts of the background picture, characterized in that the display apparatus further comprises;

storage means for storing a fraction substantially representing the proportion between the resolution of the foreground picture and the resolution of the background picture; and

further scaling means for scaling the foreground picture and the background picture to an intermediate resolution by replicating pixels of the foreground picture a number of times equal to a predetermined multiple of the denominator of the fraction, and by replicating pixels of the background picture a number of times equal to the predetermined multiple of the numerator of the fraction, said intermediate resolution not being equal to either of said foreground picture resolution or said background picture resolution.

9. A display apparatus comprising:

first and second inputs for receiving a foreground picture and a background picture, respectively, a resolution of the foreground picture differing from a corresponding resolution of the background picture, and the foreground picture comprising transparent parts;

scaling means for converting the resolution of the foreground picture and the background picture to a common target resolution; and

mixing means for mixing the foreground picture and the background picture by replacing the transparent parts of the foreground picture by underlying parts of the background picture, characterized in that the mixing means further comprises;

storage means for storing a table having entries each comprising weight factors defining the contribution of a predetermined number of input pixels from the foreground picture to an output pixel of a result picture, the weight factors being computed in a predetermined way to predict the effects of mixing the background picture and the foreground picture at an intermediate resolution, said intermediate resolution being the least common multiple of said foreground picture resolution and said background picture resolution, and not being equal to either of said foreground picture resolution or said background resolution; and

computing means for producing output pixels of the result picture by processing one input pixel from the background picture and the predetermined number of input pixels from the foreground picture, the processing comprising the steps;

(1) replacing transparent pixels from the foreground picture by the pixel from the background picture, the replacement yielding replaced pixels with the same weight factors as the transparent pixels,

(2) averaging the replaced pixels and opaque pixels from the foreground picture in proportion to their respective weight factors, and

(3) skipping one input pixel from the background picture and a number of input pixels from the foreground picture.