Method and apparatus for adding a graphic indication of a first down to a live video of a football game

• US 6,141,060 A
• Filed: 03/05/1999
• Issued: 10/31/2000
• Est. Priority Date: 10/22/1996
• Status: Expired due to Term

• Current Assignee: Sportsmedia Technology Corporation
• Original Assignee: Fox Sports Productions, Inc. (The Walt Disney Company)
• Inventors: Goren, Edward Gerald, Cavallaro, Richard H., Honey, Stanley K., Hill, David Blyth, Gepner, Jerry Neil
• Primary Examiner(s): BRITTON, HOWARD W
• Application Number:
  US09/264,138
• Time in Patent Office: 606 Days
• Field of Search: 348/157, 348/169, 348/578, 348/579, 348/580
• US Class Current: 348/578
• CPC Class Codes: G01S 3/7865 using correlation of the live video image with a stored image
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02

Abstract

Pan, tilt and zoom sensors are coupled to a broadcast camera in order to determine the field of view of the broadcast camera and to make a rough estimate of a target'"'"'s location in the broadcast camera'"'"'s field of view. Pattern recognition techniques can be used to determine the exact location of the target in the broadcast camera'"'"'s field of view. If a preselected target is at least partially within the field of view of the broadcast camera, all or part of the target'"'"'s image is enhanced. The enhancements include replacing the target image with a second image, overlaying the target image or highlighting the target image. Examples of a target include a billboard, a portion of a playing field or another location at a live event. The enhancements made to the target'"'"'s image can be seen by the television viewer but are not visible to persons at the live event.

Claims

1. A method for adding a graphic indication of a first down to a live video of a football game, comprising the steps of:

receiving an indication of a location on a football field corresponding to said first down;

sensing first field of view data using one or more field of view sensors that do not use pattern recognition;

determining a first position in said live video using said first field of view data, said first position in said live video corresponds to said location on said football field at a first time, said step of determining a first position includes recognizing at least a portion of said live video;

creating, in real time, a first graphic of a line for said live video; and

adding said first graphic to said live video based on said determined first position.

2. A method according to claim 1, further including the steps of:

sensing second field of view data using said one or more field of view sensors;

determining a second position in said live video using said second field of view data, said second position in said live video corresponds to said location on said football field at a second time, said step of determining a second position includes recognizing at least a portion of said live video;

creating, in real time, a second graphic of said line; and

adding said second graphic to said live video based on said determined second position.

3. A method according to claim 1, wherein:

said first field of view data is for a camera capable of being panned and tilted.

4. A method according to claim 1, wherein:

said first field of view data includes pan data and tilt data.

5. A method according to claim 1, wherein:

said step of adding includes accounting for an occlusion.

6. A method according to claim 1, wherein:

said step of creating is performed by a processor; and

said step of adding is performed by a keyer.

7. A system for adding a graphic indication of a first down to a live video of a football game, comprising:

one or more field of view sensors coupled to a camera such that said one or more field of view sensors detect field of view data for said camera without using pattern recognition, said camera is positioned to view a football field;

memory; and

one or more processors, in communication with said memory and said one or more field of view sensors, said one or more processors programmed to determine a position in video from said camera using said field of view data and by recognizing at least a portion of said video, said determined position in said video corresponds to a location on said football field representing said first down, said one or more processors further programmed to cause an adding of a line to said video at said determined position.

8. A system according to claim 7, further including:

a video modification unit in communication with said one or more processors, said video modification unit adds said line to said video in response to said one or more processors.

9. A system according to claim 8, wherein:

said video modification unit is a keyer.

10. A system according to claim 8, further including:

an input device, in communication with said one or more processors, for selecting said location on said football field.

11. A system according to claim 7, wherein:

said one or more field of view sensors include a local processor in communication with said one or more processors.

12. A system according to claim 7, wherein:

said one or more processors cause said graphic to be created in real time.

13. A method for adding a graphic indication of a first down to a live video of a football game, comprising the steps of:

receiving an indication of a location on a football field;

simultaneously sensing first field of view data for multiple cameras using field of view sensors that do not use pattern recognition;

determining positions in successive video images of a selected camera using appropriate field of view data, said positions in said video images correspond to said location on said football field, said step of determining includes recognizing at least a portion of said video images; and

adding images of a line to said successive video images at appropriate orientations based on said determined positions.

14. A method according to claim 13, wherein:

said step of adding includes accounting for an occlusion.

15. A method according to claim 13, wherein:

said field of view data includes pan and tilt data.

16. A method according to claim 13, wherein said step of adding includes the step of:

creating said images of said line at said appropriate orientations in real time.

17. A method for adding a graphic indication of a first down to a live video of a football game, comprising the steps of:

storing an indication of a location on a football field, said location corresponding to said first down;

sensing field of view data for a camera using one or more field of view sensors;

determining a position in video from said camera using said field of view data, said position in said video from said camera corresponds to said location on said football field, said step of determining a position includes recognizing at least a portion of said video from said camera; and

adding an image of said line to said video at an appropriate orientation based on said step of determining.

18. A method according to claim 17, wherein said step of adding includes the step of:

creating said image of said line at said appropriate orientation in real time.

21. A method according to claim 17, wherein:

said step of adding includes accounting for an occlusion.

19. A method for adding a graphic indication of a first down to a video of a football game, comprising the steps of:

storing an indication of a location on a football field, said location corresponding to said first down;

sensing field of view data for a camera using one or more field of view sensors that do not use pattern recognition;

determining a position in video from said camera using said field of view data, said position in said video from said camera corresponds to said location on said football field, said step of determining a position includes recognizing at least a portion of said video from said camera; and

adding an image of said line to said video based on said position.

20. A method according to claim 19, wherein:

said step of adding includes accounting for an occlusion.