×

System and method of real time insertions into video using adaptive occlusion with a synthetic reference image

  • US 5,953,076 A
  • Filed: 06/12/1996
  • Issued: 09/14/1999
  • Est. Priority Date: 06/16/1995
  • Status: Expired due to Term
First Claim
Patent Images

1. A method of occlusion processing for merging an inserted image with a current image in a live broadcast of an event, the method comprising the steps of:

  • (a) obtaining a reference image of a scene, said scene including at least one intended insertion region;

    (b) processing the reference image to obtain a synthetic reference image;

    (c) warping the synthetic reference image into the current image using warp parameters which transform the synthetic reference image to the same size and perspective as the current image;

    (d) updating the warped, synthetic reference image to reflect camera and lighting conditions in the current image;

    (e) creating a difference image by subtracting the updated, warped, synthetic reference image from the current image;

    (f) creating an occlusion mask from said difference image for deciding whether to broadcast the pixels of the current image, the pixels of the inserted image, or a mixture of each; and

    (g) mixing the inserted image and the current image according to the occlusion mask to obtain a broadcast image which seamlessly blends the inserted image into a portion of the current image without obscuring the action of the event.

View all claims
  • 14 Assignments
Timeline View
Assignment View
    ×
    ×