System for displaying an object that is not visible to a camera

• US 5,953,077 A
• Filed: 01/17/1997
• Issued: 09/14/1999
• Est. Priority Date: 01/17/1997
• Status: Expired due to Term

• Current Assignee: Sportsmedia Technology Corporation
• Original Assignee: Fox Sports Productions, Inc. (The Walt Disney Company)
• Inventors: Gloudemans, James R., Cavallaro, Richard H., Honey, Stanley K., Heidmann, Timothy P., O'Brien, Terence J., Olsen, Patrick W.
• Primary Examiner(s): LIN, BRYAN T
• Application Number:
  US08/785,205
• Time in Patent Office: 970 Days
• Field of Search: 348/571, 348/578, 348/584, 348/589, 348/598, 348/600, 348/601
• US Class Current: 348/589
• CPC Class Codes: A63B 2225/30 Maintenance
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 43/00 Balls with special arrangements
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A system for enhancing the television presentation of an object that can display the object even if the object is not visible to a camera. The system determines whether the object is visible to the camera broadcasting the event. If the object is not visible to the camera, the video image captured by the camera is edited to show the object, not show the object or enhance the video in a different manner. The object is placed in the captured video image at the position the object would be in the camera'"'"'s field of view if there was no barrier between the object and the camera.

Claims

1. A method of presenting a target during a live event, comprising the steps of:

determining whether a camera'"'"'s view of said target is obstructed by a barrier; and

editing, during said live event, a first video image captured by said camera to indicate a position of said target in said first video image if said camera'"'"'s view of said target is obstructed by said barrier.

2. A method according to claim 1, wherein:

said step of determining whether a camera'"'"'s view of said target is obstructed includes the step of determining whether said target is within said camera'"'"'s field of .

3. A method according to claim 1 further including the step of:

determining said position of said target in said first video image using field of view data.

4. A method according to claim 1, wherein:

said step of editing said first video image adds an image of said target at said position of said target in said first video image.

5. A method according to claim 1 further including the steps of:

determining a three dimensional location of said target; and

determining said position of said target in said first video image based on said three dimensional location of said target.

6. A method according to claim 1 wherein:

said step of editing includes keying a second video image with said first video image, said second video image depicts a representation of said target.

7. A method according to claim 1 wherein:

said step of editing includes combining a second image with said first video image, said second video image includes an image representing said target.

8. A method according to claim 7 wherein:

said second video image further includes a highlight.

9. A method according to claim 1 wherein:

said step of determining is performed automatically by a computer.

10. A method according to claim 1 wherein:

said target is mobile.

11. A method according to claim 1 wherein:

said target is a hockey puck.

12. A method according to claim 1 wherein:

said step of determining includes determining whether a sensor co-located with said camera can detect said target.

13. A method according to claim 1 wherein:

said barrier is a known fixed barrier.

14. A method according to claim 1 wherein:

said steps of determining and editing are performed in real time.

15. A method according to claim 1 further including the step of:

broadcasting said first video image after said step of editing, said steps of determining, editing and broadcasting are performed in real time during said live event.

16. A method according to claim 1 further including the step of:

adding, during said live event, a second video image to said first video image if said camera'"'"'s view of said target is not obstructed by said barrier, said step of editing includes adding a third video image to said first video image if said camera'"'"'s view of said target is obstructed by said barrier.

17. A method according to claim 1 wherein:

said first video image is a field of video.

18. A method according to claim 1 wherein:

said first video image is a frame of video.

19. An apparatus for enhancing a presentation of a target during a live event, comprising:

a camera;

a processor, in communication with said camera, said processor programmed to;

determine whether said camera'"'"'s view of said target is obstructed by a barrier, and

edit, during said live event, a first video image captured by said camera to indicate a position of said target in said first video image if said camera'"'"'s view of said target is obstructed by said barrier.

20. An apparatus according to claim 19, further including:

at least one sensor, in communication with said processor, for detecting said target, said sensor being different from said camera.

21. An apparatus according to claim 20 further including:

one or more field of view sensors in communication with said processor capable of detecting said camera'"'"'s field of view.

22. An apparatus according to claim 21 further including:

a keyer, in communication with said processor, to be used by said processor to edit said first video image.

23. An apparatus according to claim 21, wherein:

said processor further programmed to

determine said target'"'"'s three dimensional location using data from said sensor, and

determine said position of said target in said first video image based on said three dimensional location of said target and data from said one or more field of view sensors.

24. An apparatus for enhancing a presentation of a target during a live event, comprising:

means for determining whether a camera'"'"'s view of said target is obstructed by a barrier;

means for selectively enhancing a video signal from said camera if said camera'"'"'s view of said target is obstructed by said barrier.

25. An apparatus according to claim 24 further including:

means for determining said target'"'"'s position in a video image captured by said camera.

26. An apparatus according to claim 25 further including:

means for determining a three dimensional location of said target.

27. An apparatus according to claim 24 wherein:

said means for selectively enhancing adds an image representing said target to a video image captured by said camera.

28. A method of presenting a target during a live event, comprising the steps of:

determining if said target is visible to a camera, said step of determining includes symbolically constructing a line of position from a location at or near said camera to said target and determining whether said line of position passes through a barrier; and

editing, during said live event, a first video image captured by said camera to indicate a position of said target in said first video image if said target is not visible to said camera.

29. A method of presenting a target during a live event, comprising the steps of:

determining if said target is visible to a camera, said step of determining includes the steps of symbolically constructing a line of position from a location at or near said camera to said target, symbolically constructing a surface representing a barrier free path and determining whether said line of position passes through said surface; and

editing, during said live event, a first video image captured by said camera to indicate a position of said target in said first video image if said target is not visible to said camera.

30. One or more processor readable storage media having processor readable code embodied on said processor readable storage media, said processor readable code for programming one or more processors to perform a method comprising the steps of:

determining whether a camera'"'"'s view of said target is obstructed by a barrier, and editing, during said live event, a first video image captured by said camera to indicate a position of said target in said first video image if said camera'"'"'s view of said target is obstructed by said barrier.

31. One or more processor readable storage media according to claim 30 wherein said step of determining whether a camera'"'"'s view of said target is obstructed includes the step of:

determining whether said target is within said camera'"'"'s field of view.

32. One or more processor readable storage media according to claim 30 wherein:

said step of editing said first video image adds an image of said target at said position of said target in said first video image, said position of said target in said first image corresponds to a position of said target in said camera'"'"'s field of view.

33. One or more processor readable storage media according to claim 30 wherein:

said step of determining whether a camera'"'"'s view of said target is obstructed includes;

symbolically constructing a line of position from a location at or near said camera to said target; and

determining whether said line of position passes through a barrier.

34. One or more processor readable storage media according to claim 33 wherein:

said barrier is a known fixed barrier.

35. One or more processor readable storage media according to claim 30 wherein:

said step of determining whether a camera'"'"'s view of said target is obstructed includes;

symbolically constructing a line of position from a location at or near said camera to said target;

constructing a surface representing a barrier free path; and

determining whether said line of position passes through said surface.

36. One or more processor readable storage media according to claim 30, wherein said method further includes the step of:

adding, during said live event, a second video image to said first video image if said camera'"'"'s view of said target is not obstructed by said barrier, said step of editing includes adding a third video image to said first video image if said camera'"'"'s view of said target is obstructed by said barrier.