System and method for enhancing display of a sporting event
First Claim
1. A system for enhancing display of a sporting event by tracking the path of a ball in a playing field of the sporting event while the ball is moving and generating successive overlaid video image frames that represent successive overlaid video images of the path of the ball in the playing field within an overhead large field of view over the playing field, the system comprising:
- a tracking video camera that is positioned over the playing field and generates successive tracking video image frames while the ball is moving that represent successive tracking video images of successive overhead small fields of view that contain the ball and are within the overhead large field of view;
a tracking processor that generates from the successive tracking video image frames successive determined location data sets that represent successive determined locations of the ball within the successive tracking video images;
a path prediction processor that generates from the successive determined location data sets successive predicted position data sets that represent successive predicted positions of the ball with respect to the tracking video camera so as to predict the path of the ball;
tracking camera orientation, zoom, and focus controllers that generate tracking camera orientation, zoom, and focus control signals from the successive predicted position data sets;
the tracking video camera adjusting its orientation, zoom, and focus in response to the tracking camera orientation, zoom, and focus control signals so as to be oriented toward, zoomed in on, and focused on the ball in the overhead small fields of view while the ball is moving so that the ball is tracked;
a background video camera that is positioned over the playing field and generates successive background video image frames that represent successive background video images of the playing field within the overhead large field of view while the ball is moving; and
an overlay processor that (1) generates from the successive determined location data sets successive overlay video image frames that represent successive overlay video images of the path of the ball within the overhead large field of view but without the playing field in the background, and (2) combines the successive overlay video image frames with the successive background video image frames to generate the successive overlaid video image frames such that the successive overlaid video images comprise the successive overlay video images overlaid on the successive background video images.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for enhancing display of a sporting event. The path of a ball in a playing field of the sporting event is tracked while the ball is moving. In response, successive overlay video image frames are generated that represent successive overlay video images of the path of the ball within the large field of view but without the playing field in the background. In one embodiment, the successive overlay video image frames are combined with a single background video image frame so as to generate successive overlaid video image frames. The overlaid video image frames represent successive overlaid video images of the path of the ball in the playing field within the large field of view. In another embodiment, the successive overlay video image frames are combined with successive background video image frames so as to generate the successive overlaid video image frames.
81 Citations
22 Claims
-
1. A system for enhancing display of a sporting event by tracking the path of a ball in a playing field of the sporting event while the ball is moving and generating successive overlaid video image frames that represent successive overlaid video images of the path of the ball in the playing field within an overhead large field of view over the playing field, the system comprising:
-
a tracking video camera that is positioned over the playing field and generates successive tracking video image frames while the ball is moving that represent successive tracking video images of successive overhead small fields of view that contain the ball and are within the overhead large field of view;
a tracking processor that generates from the successive tracking video image frames successive determined location data sets that represent successive determined locations of the ball within the successive tracking video images;
a path prediction processor that generates from the successive determined location data sets successive predicted position data sets that represent successive predicted positions of the ball with respect to the tracking video camera so as to predict the path of the ball;
tracking camera orientation, zoom, and focus controllers that generate tracking camera orientation, zoom, and focus control signals from the successive predicted position data sets;
the tracking video camera adjusting its orientation, zoom, and focus in response to the tracking camera orientation, zoom, and focus control signals so as to be oriented toward, zoomed in on, and focused on the ball in the overhead small fields of view while the ball is moving so that the ball is tracked;
a background video camera that is positioned over the playing field and generates successive background video image frames that represent successive background video images of the playing field within the overhead large field of view while the ball is moving; and
an overlay processor that (1) generates from the successive determined location data sets successive overlay video image frames that represent successive overlay video images of the path of the ball within the overhead large field of view but without the playing field in the background, and (2) combines the successive overlay video image frames with the successive background video image frames to generate the successive overlaid video image frames such that the successive overlaid video images comprise the successive overlay video images overlaid on the successive background video images. - View Dependent Claims (2, 3, 4, 5, 6)
background camera orientation, zoom, and focus controllers that generate background camera orientation, zoom, and focus control signals and successive background camera orientation and zoom data sets representing the orientation and degree of zoom of the background video camera when the successive background video image frames are generated;
the background video camera adjusting its orientation, zoom, and focus in response to the background camera orientation, zoom, and focus control signals so as to be oriented toward, zoomed in on, and focused on the playing field in the large field of view;
the tracking camera orientation and zoom controllers also generating from the successive predicted position data sets successive tracking camera orientation and zoom data sets representing the successive orientations and degrees of zoom of the tracking video camera when the successive tracking video image frames are generated; and
the overlay processor generates the successive overlay video image frames also from the successive tracking camera orientation and zoom data sets and the successive background camera orientation and zoom data sets.
-
-
5. The system of claim 4 wherein:
-
the tracking and background video cameras are mounted on a moving object that positions the tracking and background video cameras over the playing field;
the system further comprises a precise positioning system that generates successive precise tracking camera position data sets and successive precise background camera position data sets, the successive precise tracking camera position data sets representing successive precise positions of the tracking video camera with respect to the playing field when the successive tracking video image frames are generated, the successive precise background camera position data sets representing successive precise positions of the background video camera with respect to the playing field when the successive background video image frames are generated;
the path prediction processor generates the successive predicted position data sets also from the successive precise tracking camera position data sets; and
the overlay processor generates the successive overlay video image frames also from the successive precise tracking camera and background camera position data sets.
-
-
6. The system of claim 1 wherein the overlay processor generates the successive overlay and overlaid video images such that the path of the ball in the successive overlay and overlaid video images is represented by a comma shaped curve.
-
7. A method for enhancing display of a sporting event by tracking the path of a ball in a playing field of the sporting event while the ball is moving and generating successive overlaid video image frames that represent successive overlaid video images of the path of the ball in the playing field within an overhead large field of view over the playing field, the method comprising:
-
positioning a tracking video camera and background video camera over the playing field;
with the tracking video camera, generating successive tracking video image frames while the ball is moving that represent successive tracking video images of successive overhead small fields of view that contain the ball and are within the overhead large field of view;
generating from the successive tracking video image frames successive determined location data sets that represent successive determined locations of the ball within the successive tracking video images;
generating from the successive determined location data sets successive predicted position data sets that represent successive predicted positions of the ball with respect to the tracking video camera so as to predict the path of the ball;
generating tracking camera orientation, zoom, and focus control signals from the successive predicted position data sets;
adjusting the tracking video camera'"'"'s orientation, zoom, and focus in response to the tracking camera orientation, zoom, and focus control signals so that the tracking video camera is oriented toward, zoomed in on, and focused on the ball in the overhead small fields of view while the ball is moving so that the ball is tracked;
with the background video camera, generating successive background video image frames that represent successive background video images of the playing field within the overhead large field of view;
generating from the successive determined location data sets successive overlay video image frames that represent successive overlay video images of the path of the ball within the overhead large field of view but without the playing field in the background; and
combining the successive overlay video image frames with the successive background video image frames to generate the successive overlaid video image frames such that the successive overlaid video images comprise the successive overlay video images overlaid on the successive background video images. - View Dependent Claims (8, 9, 10, 11, 12)
the successive overlay video image frames are generated in the overlay video image frames generating step in near real time; and
the successive overlay video image frames are combined in the combining step with the successive background video image frames in near real time to generate the successive overlaid video image frames in near real time.
-
-
9. The method of claim 8 further comprising the step of broadcasting the successive overlaid video image frames in near real time for display in near-real time.
-
10. The method of claim 7 further comprising the steps of:
-
generating background camera orientation, zoom, and focus control signals and background camera orientation and zoom data sets representing the orientation and degree of zoom of the background video camera when the successive background video image frames are generated;
adjusting the background video camera'"'"'s orientation, zoom, and focus in response to the background camera orientation, zoom, and focus control signals so that the background video camera is oriented toward, zoomed in on, and focused on the playing field in the large field of view;
generating from the successive predicted position data sets successive tracking camera orientation and zoom data sets representing the successive orientations and degrees of zoom of the tracking video camera when the successive tracking video image frames are generated;
the successive overlay video image frames being generated in the overlay video image frames generating step also from the successive tracking camera orientation and zoom data sets and the successive background camera orientation and zoom data sets.
-
-
11. The method of claim 10 wherein:
-
the tracking and background video cameras are positioned over the playing field in the positioning step with a moving object on which the tracking and background video cameras are mounted;
the method further comprising the steps of;
generating successive precise tracking camera position data sets that represent successive precise positions of the tracking video camera with respect to the playing field when the successive tracking video image frames are generated;
generating successive precise background camera position data sets that represent successive precise positions of the background video camera with respect to the playing field when the successive background video image frames are generated;
the successive predicted position data sets are generated in the successive predicted position data sets generating step also from the successive precise tracking camera position data sets; and
the successive overlay video image frames are generated in the successive overlay video image frames generating step also from the successive precise tracking camera and background camera position data sets.
-
-
12. The method of claim 7 wherein the successive overlay and overlaid video images are generated in the overlay video image frames generating and combining steps such that the path of the ball in the successive overlay and overlaid video images is represented by a comma shaped curve.
-
13. A system for enhancing display of a sporting event by tracking the path of a ball in a playing field of the sporting event while the ball is moving and generating successive overlaid video image frames that represent successive overlaid video images of the path of the ball in the playing field within an overhead large field of view over the playing field, the system comprising:
-
a tracking video camera that is mounted on a moving object, positioned over the playing field with the moving object, and generates successive tracking video image frames while the ball is moving, the successive tracking video image frames representing successive tracking video images of successive overhead small fields of view that contain the ball and are within the overhead large field of view;
a background video camera that is mounted on a moving object, positioned over the playing field with the moving object, and generates a background video image frame, the background video image frame representing a background video image of the playing field within the overhead large field of view;
a precise positioning system that generates successive precise tracking camera position data sets and a precise background camera position data set that respectively represent successive precise positions of the tracking video camera with respect to the playing field when the successive tracking video image frames are generated and a precise position of the background video camera with respect to the playing field when the background video image frame was generated;
a tracking processor that generates from the successive tracking video image frames successive determined location data sets that represent successive determined locations of the ball within the successive tracking video images;
a path prediction processor that generates from the successive determined location data sets and the successive precise tracking camera position data sets successive predicted position data sets that represent successive predicted positions of the ball with respect to the tracking video camera so as to predict the path of the ball;
tracking camera orientation, zoom, and focus controllers that generate tracking camera orientation, zoom, and focus control signals from the successive predicted position data sets;
the tracking video camera adjusting its orientation, zoom, and focus in response to the tracking camera orientation, zoom, and focus control signals so as to be oriented toward, zoomed in on, and focused on the ball in the overhead small fields of view while the ball is moving so that the ball is tracked; and
an overlay processor that (1) generates from the successive determined location data sets and the successive precise tracking camera and background camera position data sets successive overlay video image frames that represent successive overlay video images of the path of the ball within the overhead large field of view but without the playing field in the background, and (2) combines the successive overlay video image frames with the background video image frame to generate the successive overlaid video image frames such that the successive overlaid video images comprise the successive overlay video images overlaid on the background video image. - View Dependent Claims (14, 15, 16, 17)
background camera orientation, zoom, and focus controllers that generate background camera orientation, zoom, and focus control signals and background camera orientation and zoom data sets representing the orientation and degree of zoom of the background video camera when the background video image frame is generated;
the background video camera adjusting its orientation, zoom, and focus in response to the background camera orientation, zoom, and focus control signals so as to be oriented toward, zoomed in on, and focused on the playing field in the large field of view;
the tracking camera orientation and zoom controllers also generating from the successive predicted position data sets successive tracking camera orientation and zoom data sets representing the successive orientations and degrees of zoom of the tracking video camera when the successive tracking video image frames are generated; and
the overlay processor generates the successive overlay video image frames also from the successive tracking camera orientation and zoom data sets and the background camera orientation and zoom data sets.
-
-
17. The system of claim 13 wherein the overlay processor generates the successive overlay and overlaid video images such that the path of the ball in the successive overlay and overlaid video images is represented by a comma shaped curve.
-
18. A method for enhancing display of a sporting event by tracking the path of a ball in a playing field of the sporting event while the ball is moving and generating successive overlaid video image frames that represent successive overlaid video images of the path of the ball in the playing field within an overhead large field of view over the playing field, the method comprising:
-
positioning a tracking video camera and a background video camera over the playing field with a moving object on which the tracking and background video cameras are mounted;
with the tracking video camera, generating successive tracking video image frames while the ball is moving that represent successive tracking video images of successive overhead small fields of view that contain the ball and are within the overhead large field of view;
generating successive precise tracking camera position data sets that represent successive precise positions of the tracking video camera with respect to the playing field when the successive tracking video image frames are generated;
generating from the successive tracking video image frames successive determined location data sets that represent successive determined locations of the ball within the successive tracking video images;
generating from the successive determined location data sets and the successive precise tracking camera position data sets successive predicted position data sets that represent successive predicted positions of the ball with respect to the tracking video camera so as to predict the path of the ball;
generating tracking camera orientation, zoom, and focus control signals from the successive predicted position data sets;
adjusting the tracking video camera'"'"'s orientation, zoom, and focus in response to the tracking camera orientation, zoom, and focus control signals so that the tracking video camera is oriented toward, zoomed in on, and focused on the ball in the overhead small fields of view while the ball is moving so that the ball is tracked;
with the background video camera, generating a background video image frame that represents a background video image of the playing field within the overhead large field of view;
generating a precise background camera position data set that represents a precise position of the background camera with respect to the playing field when the background video image frame is generated;
generating from the successive determined location data sets and the successive precise tracking camera and background camera position data sets successive overlay video image frames that represent successive overlay video images of the path of the ball within the overhead large field of view but without the playing field in the background; and
combining the successive overlay video image frames with the background video image frame to generate the successive overlaid video image frames such that the successive overlaid video images comprise the successive overlay video images overlaid on the background video image. - View Dependent Claims (19, 20, 21, 22)
the successive overlay video image frames are generated in the overlay video image frames generating step in near real time; and
the successive overlay video image frames are combined in the combining step with the background video image frame in near real time to generate the successive overlaid video image frames in near real time.
-
-
20. The method of claim 19 further comprising the step of broadcasting the successive overlaid video image frames in near real time for display in near-real time.
-
21. The method of claim 18 further comprising the steps of:
-
generating background camera orientation, zoom, and focus control signals and background camera orientation and zoom data sets representing the orientation and degree of zoom of the background video camera when the background video image frame is generated;
adjusting the background video camera'"'"'s orientation, zoom, and focus in response to the background camera orientation, zoom, and focus control signals so that the background video camera is oriented toward, zoomed in on, and focused on the playing field in the large field of view;
generating from the successive predicted position data sets successive tracking camera orientation and zoom data sets representing the successive orientations and degrees of zoom of the tracking video camera when the successive tracking video image frames are generated; and
the successive overlay video image frames being generated in the overlay video image frames generating step also from the successive tracking camera orientation and zoom data sets and the background camera orientation and zoom data sets.
-
-
22. The method of claim 18 wherein the successive overlay and overlaid video images are generated in the overlay video image frames generating and combining steps such that the path of the ball in the successive overlay and overlaid video images is represented by a comma shaped curve.
Specification