Method and apparatus for a declarative representation of distortion correction for add-on graphics in broadcast video
First Claim
1. A method of distorting add-on graphics to be composited with a streaming video feed comprising:
- receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and distortion parameters corresponding to the image distortions of the image frame;
creating a virtual camera;
setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
generating add-on graphics having a size and an insertion position within the image frame based on the virtual camera;
creating a distortion grid;
distorting the add-on graphics to match the image distortions of the image frame; and
compositing the distorted add-on graphics with the image frame of the streaming video feed.
2 Assignments
0 Petitions
Accused Products
Abstract
An apparatus and a method for distorting add-on graphics to be composited with a streaming video feed comprising, receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame, measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame, creating a virtual camera, setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data, generating add-on graphics having a size and an insertion position within the image frame based on the virtual camera, creating a distortion grid, distorting the add-on graphics to match the image distortions of the image frame, and compositing the distorted add-on graphics with the image frame of the streaming video feed.
-
Citations
79 Claims
-
1. A method of distorting add-on graphics to be composited with a streaming video feed comprising:
-
receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and distortion parameters corresponding to the image distortions of the image frame;
creating a virtual camera;
setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
generating add-on graphics having a size and an insertion position within the image frame based on the virtual camera;
creating a distortion grid;
distorting the add-on graphics to match the image distortions of the image frame; and
compositing the distorted add-on graphics with the image frame of the streaming video feed. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A computer program product embodied in a computer readable medium for distorting add-on graphics to be composited with a streaming video feed comprising:
-
code means for receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
code means for measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame;
code means for creating a virtual camera;
code means for setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
code means for generating add-on graphics having a size and an insertion position within the image frame based on the virtual camera;
code means for creating a distortion grid;
code means for distorting the add-on graphics to match the image distortions of the image frame; and
code means for compositing the distorted add-on graphics with the image frame of the streaming video feed. - View Dependent Claims (27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50)
-
-
51. An apparatus of distorting add-on graphics to be composited with a streaming video feed comprising:
-
means for receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
means for measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame;
means for creating a virtual camera;
means for setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
means for generating add-on graphics having a size and an insertion position within the image frame based on the virtual camera;
means for creating a distortion grid;
means for distorting the add-on graphics to match the image distortions of the image frame; and
means for compositing the distorted add-on graphics with the image frame of the streaming video feed. - View Dependent Claims (52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75)
-
-
76. A system for creating add-on graphics into a streaming video feed comprising:
-
means for generating a streaming video feed;
means for collecting camera instrumentation data;
means for transmitting the streaming video feed and the camera instrumentation data down to a receiver;
means for receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
means for measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame;
means for creating a virtual camera;
means for setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
means for generating add-on graphics having a size and an insertion position within the image frame based on the virtual camera;
means for creating a distortion grid;
means for distorting the add-on graphics to match the image distortions of the image frame; and
means for compositing the distorted add-on graphics with the image frame of the streaming video feed.
-
-
77. A method of distorting add-on graphics to be composited with a streaming video feed comprising:
-
receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame;
creating a virtual camera;
using a declarative markup language, said virtual camera being used in generating add-on graphics having a size and an insertion position within the image frame, the virtual camera rendering the add-on graphics at a virtual view point and a virtual field of view corresponding to the view point and the field of view of the real camera, the size and the insertion position of the add-on graphics within the image frame corresponding to the size and the position of an image of a real asset within the image frame;
setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
creating a distortion grid using the declarative markup language, the grid having a set of coordinate values based on the distortion parameters;
distorting the add-on graphics to match the image distortions of the image frame using the set of coordinate values; and
compositing the distorted add-on graphics with the image frame of the streaming video feed.
-
-
78. An apparatus of distorting add-on graphics to be composited with a streaming video feed comprising:
-
means for receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
means for measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame;
means for creating a virtual camera;
using a declarative markup language, said virtual camera being used in generating add-on graphics having a size and an insertion position within the image frame, the virtual camera rendering the add-on graphics at a virtual view point and a virtual field of view corresponding to the view point and the field of view of the real camera , the size and the insertion position of the add-on graphics within the image frame corresponding to the size and the position of an image of a real asset within the image frame;
means for setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
means for creating a distortion grid using the declarative markup language, the grid having a set of coordinate values based on the distortion parameters;
means for distorting the add-on graphics to match the image distortions of the image frame using the set of coordinate values; and
means for compositing the distorted add-on graphics with the image frame of the streaming video feed.
-
-
79. A computer program product embodied in a computer readable medium for distorting add-on graphics to be composited with a streaming video feed comprising;
-
code means for receiving a streaming video feed captured using a real camera, said streaming video feed including an image frame taken from a particular view point and a particular field of view, said real camera introducing image distortions into the image frame;
code means for measuring a plurality of camera instrumentation data corresponding to at least said view point, said field of view, and a distortion parameters corresponding to the image distortions of the image frame;
code means for creating a virtual camera;
using a declarative markup language, said virtual camera being used in generating add-on graphics having a size and an insertion position within the image frame, the virtual camera rendering the add-on graphics at a virtual view point and a virtual field of view corresponding to the view point and the field of view of the real camera, the size and the insertion position of the add-on graphics within the image frame corresponding to the size and the position of an image of a real asset within the image frame;
code means for setting the virtual view point and the virtual field of view of the virtual camera using the plurality of camera instrumentation data;
code means for creating a distortion grid using the declarative markup language, the grid having a set of coordinate values based on the distortion parameters;
code means for distorting the add-on graphics to match the image distortions of the image frame using the set of coordinate values; and
code means for compositing the distorted add-on graphics with the image frame of the streaming video feed.
-
Specification