SYSTEM FOR COMMUNICATING AND METHOD
First Claim
1. A system for communicating a representation of a scene which includes a plurality of objects disposed on a plane to one or more client devices, the representation being generated from one or more video images of a scene captured by a video camera, the system comprisingan image processing apparatus operable to receive the video images of the scene which includes a view of the objects on the plane, received from the video camera,to process the captured video images so as to extract one or more image features from each object,to compare the one or more image features with sample image features from a predetermined set of possible example objects which the video images may contain,to identify the objects from the comparison of the image features with the predetermined image features of the possible example objects,to generate object path data for each object which identifies the respective object;
- and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
to calculate a projection matrix for projecting the position of each of the objects according to the object path data from the plane in the video images into the three dimensional model of the plane, anda distribution server operable to receive the object path data and the projection matrix generated by the image processing apparatus for distribution of the object path data and the projection matrix to one or more client devices.
1 Assignment
0 Petitions
Accused Products
Abstract
A system communicates a representation of a scene, which includes a plurality of objects disposed on a plane, to one or more client devices. The representation is generated from one or more video images of the scene captured by a video camera. The system comprises an image processing apparatus operable to receive the video images of the scene which includes a view of the objects on the plane, to process the captured video images so as to extract one or more image features from each object, to compare the one or more image features with sample image features from a predetermined set of possible example objects which the video images may contain, to identify the objects from the comparison of the image features with the predetermined image features of the possible example objects, and to generate object path data for each object which identifies the respective object; and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time. The image processing apparatus is further operable to calculate a projection matrix for projecting the position of each of the objects according to the object path data from the plane in the video image into the three dimensional model of the plane. A distribution server is operable to receive the object path data and the projection matrix generated by the image processing apparatus for distribution of the object path data and the projection matrix to one or more client devices. The system is arranged to generate a representation of an event, such as a sporting event, which provides a substantial data in an amount of information which must be communicated to represent the event. As such, the system can be used to communicate the representation of the event, via a bandwidth limited communications network, such as the internet, from the server to one or more client devices in real time. Furthermore, the system can be used to view one or more of the objects within the video images by extracting the objects from the video images.
-
Citations
21 Claims
-
1. A system for communicating a representation of a scene which includes a plurality of objects disposed on a plane to one or more client devices, the representation being generated from one or more video images of a scene captured by a video camera, the system comprising
an image processing apparatus operable to receive the video images of the scene which includes a view of the objects on the plane, received from the video camera, to process the captured video images so as to extract one or more image features from each object, to compare the one or more image features with sample image features from a predetermined set of possible example objects which the video images may contain, to identify the objects from the comparison of the image features with the predetermined image features of the possible example objects, to generate object path data for each object which identifies the respective object; - and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
to calculate a projection matrix for projecting the position of each of the objects according to the object path data from the plane in the video images into the three dimensional model of the plane, and a distribution server operable to receive the object path data and the projection matrix generated by the image processing apparatus for distribution of the object path data and the projection matrix to one or more client devices. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
- and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
-
10. A client device operable to generate a three dimensional representation of a scene which includes a plurality of objects disposed on a plane, the three dimensional representation being generated from one or more video images captured by a camera from a view of the scene which includes the plurality of objects, the client device including
a communications interface operable to receive data representative of object path data and a projection matrix generated by an image processing apparatus, the object path data providing for each object an identity of the respective object; - and a position of the identified object on a three dimensional model of the plane in the video images with respect to time, and
a data processor operable to generate the three dimensional representation of the scene which includes a synthesised representation of each of the plurality of objects on the plane from the object path data and the projection matrix received from the server. - View Dependent Claims (11, 12, 15)
- and a position of the identified object on a three dimensional model of the plane in the video images with respect to time, and
-
13. A client device operable to display a part of a one or more video image of a scene which includes a plurality of objects disposed on a plane, the video images being captured by a camera from a view of the scene which includes the plurality of objects, the client device including
a communications interface operable to receive data representative of object path data and a projection matrix generated by an image processing apparatus, the object path data providing for each object an identity of the respective object; - and a position of the identified object on a three dimensional model of the plane in the video images with respect to time, and to receive the one or more video images,
a data processor operable to identify each of the objects on the plane within the video images, using the object path data and the projection matrix, and in response to a user selection, to display a part of the video images within which one of more of the identified objects are located. - View Dependent Claims (14)
- and a position of the identified object on a three dimensional model of the plane in the video images with respect to time, and to receive the one or more video images,
-
16. A server for distributing object path data and a projection matrix to one or more client devices produced by an image processing apparatus, the image processing apparatus producing the object path data and the projection matrix from one or more video images of a scene which includes a view of a plurality of objects on a plane, the video images being produced by a video camera, processing the captured video images so as to extract one or more image features from each object, comparing the one or more image features with sample image features from a predetermined set of possible example objects which the video images may contain, identifying the objects from the comparison of the image features with the stored image features of the possible example objects, generating the object path data for each object which identifies the respective object;
- and provides a position of the identified object on the plane of the three dimensional model with respect to time; and
calculating the projection matrix for projecting the position of each of the objects according to the object path data from the plane in the video image into a three dimensional model of the scene, the server being operableto receive the object path data and the projection matrix, and to communicate on request, the object path data and the projection matrix to the client devices.
- and provides a position of the identified object on the plane of the three dimensional model with respect to time; and
-
17. A method of communicating a representation of a scene which includes a plurality of objects disposed on a plane to one or more client devices, the representation being generated from one or more video images of the scene, which include the objects on the plane produced by a video camera, the method comprising
processing the captured video images so as to extract one or more image features from each object, comparing the one or more image features with sample image features from a predetermined set of possible example objects which the video images may contain, identifying the objects from the comparison of the image features with the predetermined image features of the possible example objects, generating object path data for each object, which identifies the respective object; - and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
calculating a projection matrix for projecting the position of each of the objects according to the object path data from the plane in the video image into the three dimensional model of the plane, and communicating the object path data and the projection matrix to one or more client devices. - View Dependent Claims (18, 19, 20)
- and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
-
21. An apparatus for communicating a representation of a scene which includes a plurality of objects disposed on a plane to one or more client devices, the representation being generated from one or more video images of the scene, which include the objects on the plane produced by a video camera, the apparatus comprising
means for processing the captured video images so as to extract one or more image features from each object, means for comparing the one or more image features with sample image features from a predetermined set of possible example objects which the video images may contain, means for identifying the objects from the comparison of the image features with the predetermined image features of the possible example objects, means for generating object path data for each object, which identifies the respective object; - and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
means for calculating a projection matrix for projecting the position of each of the objects according to the object path data from the plane in the video image into the three dimensional model of the plane, and means for communicating the object path data and the projection matrix to one or more client devices.
- and provides a position of the identified object on a three dimensional model of the plane in the video images with respect to time;
Specification