Interactive system and method
First Claim
1. A method, comprising:
- receiving at least one stream of input images representing a physical scene having three spatial dimensions and a temporal dimension, representing a movement of at least two natural objects in the physical scene, at least one of the at least two natural objects being alive;
processing at least the at least one stream of input images, with at least one automated processor, to generate a spatial and temporal computer model of the at least two natural objects, moving and interacting according to a set of intrinsic parameters describing at least a first motion of the at least two natural objects in the physical scene, comprising both first independent motion and first contact between the at least two natural objects, consistent with the laws of physics comprising at least conservation of mass, conservation of momentum, and conservation of energy of the at least two natural objects;
receiving a set of extrinsic parameters which are distinct from the set of intrinsic motion parameters, the set of extrinsic parameters describing at least a second motion of the at least two natural objects interacting in the physical scene, comprising both second independent motion and second contact between the at least two natural objects, the first independent motion being different from the second independent motion and the first contact being different from the second contact;
receiving at least one statistic for a random variable associated with an outcome of the second motion and the second contact, comprising a likelihood of an injury to the at least one of the at least two natural objects which is alive, as a result of at least the set of extrinsic parameters;
rendering the spatial and temporal computer model, with the at least one automated processor, to define a spatial and temporal representation of the at least two natural objects within the physical scene according to at least the set of extrinsic parameters, portions of the set of intrinsic parameters consistent with the set of extrinsic parameters, and a performance statistic for a predefined activity represented in the defined spatial and temporal representation; and
generating a rendered output of the animated computer model, with the at least one automated processor, as at least one stream of output images defining at least two spatial dimensions and a temporal dimension.
0 Assignments
0 Petitions
Accused Products
Abstract
A system and method for receiving an ordered set of images and analyzing the images to determine at least one position in space and at least one motion vector in space and time for at least one object represented in the images is disclosed. Using these vectors, a four dimensional model of at least a portion of the information represented in the images is formulated. This model generally obeys the laws of physics, though aberrations may be imposed. The model is then exercised with an input parameter, which, for example, may represent a different perspective than the original set of images. The four dimensional model is then used to produce a modified set of ordered images in dependence on the input parameter and optionally the set of images, e.g., if only a portion of the data represented in the images is modeled. The set of images may then be rendered on a display device.
106 Citations
19 Claims
-
1. A method, comprising:
-
receiving at least one stream of input images representing a physical scene having three spatial dimensions and a temporal dimension, representing a movement of at least two natural objects in the physical scene, at least one of the at least two natural objects being alive; processing at least the at least one stream of input images, with at least one automated processor, to generate a spatial and temporal computer model of the at least two natural objects, moving and interacting according to a set of intrinsic parameters describing at least a first motion of the at least two natural objects in the physical scene, comprising both first independent motion and first contact between the at least two natural objects, consistent with the laws of physics comprising at least conservation of mass, conservation of momentum, and conservation of energy of the at least two natural objects; receiving a set of extrinsic parameters which are distinct from the set of intrinsic motion parameters, the set of extrinsic parameters describing at least a second motion of the at least two natural objects interacting in the physical scene, comprising both second independent motion and second contact between the at least two natural objects, the first independent motion being different from the second independent motion and the first contact being different from the second contact; receiving at least one statistic for a random variable associated with an outcome of the second motion and the second contact, comprising a likelihood of an injury to the at least one of the at least two natural objects which is alive, as a result of at least the set of extrinsic parameters; rendering the spatial and temporal computer model, with the at least one automated processor, to define a spatial and temporal representation of the at least two natural objects within the physical scene according to at least the set of extrinsic parameters, portions of the set of intrinsic parameters consistent with the set of extrinsic parameters, and a performance statistic for a predefined activity represented in the defined spatial and temporal representation; and generating a rendered output of the animated computer model, with the at least one automated processor, as at least one stream of output images defining at least two spatial dimensions and a temporal dimension. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for processing a stream of images, comprising:
-
a first input port configured to receive at least one stream of input images representing a physical scene having three spatial dimensions and a temporal dimension, representing a movement of at least two natural objects in the physical scene; at least one automated processor, configured to; process at least the at least one stream of input images to generate a spatial and temporal computer model of the at least two natural objects, moving and interacting according to a set of intrinsic parameters describing at least a first motion of the at least two natural objects in the physical scene, comprising both first independent motion and first contact between the at least two natural objects, consistent with the laws of physics comprising at least conservation of mass, conservation of momentum, and conservation of energy of the at least two natural objects; extract the set of intrinsic parameters; receive a set of extrinsic parameters from a second input port, which are distinct from the set of intrinsic motion parameters, the set of extrinsic parameters describing at least a second motion of the at least two natural objects interacting in the physical scene, comprising both second independent motion and second contact between the at least two natural objects, the first independent motion being different from the second independent motion and the first contact being different from the second contact; determine at least one statistic for a random variable associated with an outcome of the second independent motion and the second contact, comprising a likelihood of damage to at least one of the at least two natural objects, as a result of movement according to at least the set of extrinsic parameters; render the spatial and temporal computer model, to define a spatial and temporal representation of the at least two natural objects within the physical scene according to at least the set of extrinsic parameters, portions of the set of intrinsic parameters consistent with the set of extrinsic parameters, and a performance statistic for a predefined activity represented in the defined spatial and temporal representation; and generate a rendered output of the animated computer model as at least one stream of output images defining at least two spatial dimensions and a temporal dimension; and an output port configured to communicate the generated rendered output. - View Dependent Claims (11, 12, 13)
-
-
14. A method, comprising:
-
receiving a first stream of input images representing a three dimensional physical scene over time, representing a movement and contact of at least two natural objects in the physical scene, at least one of the at least two natural objects comprising a sports competitor of a competitive game represented in the first stream of input images; generating, with at least one automated processor, a spatial and temporal model of each of the at least two natural objects, the model reflecting laws of physics comprising at least conservation of mass, conservation of momentum, and conservation of energy; extracting, with the at least one automated processor, a set of intrinsic parameters describing the movement and contact of the at least two natural objects in the physical scene, consistent with the generated spatial and temporal model of each of the at least two natural objects; receiving a set of extrinsic parameters which differ from the set of intrinsic motion parameters; applying, with the at least one automated processor, the set of extrinsic parameters and the at least one statistic for the random variable, to the generated spatial and temporal model of each of the at least two natural objects, to represent a modification of the movement and contact of the at least two natural objects in the physical scene; rendering, with the at least one automated processor, the generated spatial and temporal model of each of the at least two natural objects, to define a modified representation of the three dimensional scene over time according to at least the modification of the movement and contact of the at least two natural objects in the physical scene; outputting a second stream of output images comprising the rendered generated spatial and temporal model of each of the at least two natural objects defining the modified representation of the three dimensional scene over time; and receiving at least one statistic for a random variable associated with an outcome of the modification of the movement and contact of the at least two natural objects in the physical scene, comprising a likelihood of injuries to the sports competitor represented in the second stream as a result of at least movement of the at least two natural objects in the physical scene according to the set of extrinsic parameters. - View Dependent Claims (15, 16, 17, 18, 19)
-
Specification