Method and apparatus for generating a reference image from an image sequence

• US 5,963,272 A
• Filed: 10/30/1996
• Issued: 10/05/1999
• Est. Priority Date: 10/31/1995
• Status: Expired due to Term

• Current Assignee: Sarnoff Corporation (SRI International, Inc.)
• Original Assignee: Sarnoff Corporation (SRI International, Inc.)
• Inventors: Wixson, Lambert Ernest
• Primary Examiner(s): LEE, RICHARD J
• Application Number:
  US08/742,434
• Time in Patent Office: 1,070 Days
• Field of Search: 348/17-19, 348/402, 348/407, 348/413, 348/416, 348/699-701, 348/143, 348/148, 348/149, 382/190, 382/217-219, 382/232, 382/238, 382/242
• US Class Current: 348/700
• CPC Class Codes: G08G 1/07 Controlling traffic signals
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/507 using conditional replenishment
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A locally-adaptive method and apparatus for constructing a reference image containing only the background from an image sequence containing moving or temporarily-stationary objects. Specifically, the apparatus contains a sample mask selector and a reference updater. The selector generates a mask which is used by the updated to perform updating of a reference image using only portions of the input image that contain background imagery. The updater enhances the masking function using a statistical analysis to avoid updating pixels using non-background imagery.

Claims

1. Apparatus for generating and updating a reference image from a sequence of images representing a scene comprising:

a sample mask selector for generating, in response to a first image and a second image in said sequence of images, a sample mask for controlling reference image generation; and

a reference updater for updating select portions of a reference image in response to said first image and said sample mask, where said sample mask defines the portions of said reference image to be updated.

2. The apparatus of claim 1 wherein said sample mask permits the reference image to be updated with information in said first image at locations containing background information of said scene.

3. A method of generating and updating a reference image from a sequence of images representing a scene comprising the steps of:

generating, in response to a first image and a second image in said sequence of images, a sample mask for controlling reference image generation; and

updating select portions of a reference image in response to said first image and said sample mask, where said sample mask defines the portions of said reference image to be updated.

4. The method of claim 3 wherein said sample mask permits the reference image to be updated with information in said first image at locations containing background information of said scene.

5. The method of claim 3 wherein said generating step further comprises the step of detecting locations in said sequence of images having changes followed by no change over a predefined duration.

6. The method of claim 3 further comprising the step of determining a true background value for each reference image pixel.

7. The method of claim 6 further comprising the steps of:

maintaining a true reference image and a potential reference image;

generating a coherence measure for each pixel in said true reference image and a coherence measure for each pixel in said potential reference image;

when the coherence measure of a pixel in the potential reference image exceeds the coherence measure of a pixel in the true reference image, replacing a pixel value of the pixel in the true reference image with a pixel value of the pixel in the potential reference image; and

using the true reference image as the reference image.