Method and apparatus for automatic electronic replacement of billboards in a video image

• US 6,292,227 B1
• Filed: 06/02/1998
• Issued: 09/18/2001
• Est. Priority Date: 09/08/1995
• Status: Expired due to Fees

• Current Assignee: Orad Hi-Tec Systems Ltd. (Avid Technology Incorporated)
• Original Assignee: Orad Hi-Tec Systems Ltd. (Avid Technology Incorporated)
• Inventors: Tamir, Michael, Wilf, Itzhak, Sharir, Avi
• Primary Examiner(s): Hsia, Sherrie
• Application Number:
  US09/029,778
• Time in Patent Office: 1,204 Days
• Field of Search: H04/N.974, H04/N.975, 348/586, 348/587, 348/590, 348/591, 348/592
• US Class Current: 348/587
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

Apparatus for automatic replacement of a billboard in a video image is provided. The billboard comprises a chroma-key surface, and the apparatus includes a video camera for viewing the billboard, and a chroma-key unit operative to detect at least one chroma-key color of the billboard chroma-key surface. A reference color of the chroma-key unit is adjustable to conform to the color of the chrom-key surface, thereby enabling the chroma-key unit to correctly identify the billboard surface and to correctly replace the chroma-key surface of the billboard by a virtual advertisement in a video image with correct occlusion of any foreground object.

Claims

1. Apparatus for automatic replacement of a billboard in a video image comprising:

the billboard comprising a chroma-key surface,

a video camera for viewing the billboard, and

a chroma-key unit operative to detect at least one chroma-key colour of the billboard chroma-key surface and in which a reference colour of the chroma-key unit is adjustable to conform to the colour of the chroma-key surface, thereby enabling the chroma-key unit to correctly identify the billboard surface and to correctly replace the chroma-key surface of the billboard by a virtual advertisement in the video image with correct occlusion of any foreground object.

2. Apparatus as claimed in claim 1 in which the apparatus further comprises a billboard map memory for recording a position of plurality of billboards and for recording the chroma-key colour of each billboard to be replaced to thereby provide a chroma-key colour map for a stadium.

3. Apparatus as claimed in claim 2 in which the apparatus further comprises means for automatically adjusting the chroma-key colour map in accordance with variations in lighting conditions within the stadium.

4. Apparatus as claimed in any one of claims 1 to 3 in which the camera incorporates an automatic camera orientation measurement means including motion measurement means operative to measure a Field of View (FOV) of the camera relative to a known reference position.

5. Apparatus as claimed in claim 4 including image processing means for processing video signals generated by the camera in which said image processing means includes calibrating means for periodically automatically calibrating the motion measurement means.

6. Apparatus as claimed in claim 4 further including means for transmitting, for each billboard to be replaced, a perfect background colour key signal.

7. Apparatus as claimed in claim 6 further including means for transmitting coordinates of each billboard to be substituted.

8. Apparatus as claimed in claim 7 further including receiving apparatus for reception of the coordinates of each billboard and the perfect background colour key signal and including means for providing a combined video picture incorporating occlusion in coordinate areas identified by the perfect background colour key signal.

9. Apparatus as claimed in claim 2 further comprising a dynamic billboard memory for recording any changes in measured position of the billboard as the camera pans or tilts.

10. A method for automatic electronic replacement of billboards in a sports stadium, said billboards having chroma-key surfaces in a video image comprising the steps of:

i. identifying a first specific area corresponding to a billboard in the video image, said specific area having a defined first chroma-key colour of the chroma-key surface of a first billboard;

ii. recording the first colour of said first specific area in a chroma-key colour store;

iii. identifying a first electronic replacement billboard for substitution into said first specific area; and

iv. replacing by chroma-key techniques said first replacement billboard in said video image said replacement including the step of occluding those parts of the first specific area which are occluded in the video image by an occluding object.

11. A method as claimed in claim 10 comprising the steps of:

i. identifying further specific area in the video image, each further specific area comprising a further billboard having a related chroma-key colour;

ii. recording the colour of all specific areas in a chroma-key colour store together with information relating to a position of each of said specific area;

iii. identifying replacement billboards for substitution into each of said specific area; and

iv. replacing the substitute billboards into correct respective locations with occlusion by occluding objects.

12. A method as claimed in claim 10 including the steps of:

updating the recorded chroma-key colours for each specific area at appropriate time intervals to compensate for lighting changes within a stadium.

13. A method as claimed in claim 11 or claim 12 further including the steps of:

i. transmitting together with video image information data identifying the specific area comprising location and size of each of a plurality of billboards;

ii. transmitting for each specific area identified as a billboard a perfect chroma-key colour;

iii. receiving a receiver data identifying each of the plurality of billboards to be replaced and perfect chroma-key colour information for said specific area;

iv. comparing the perfect chroma key colour with a preselected matching perfect chroma-key colour in a chroma-key apparatus in said receiver;

v. substituting the plurality of billboards selected locally at said receiver into the specific area identified for each billboard; and

vi. inserting occluding objects by chroma-key techniques for each billboard using a chroma-keyer in which the chroma-key colour is set to detect the perfect chroma-key colour.