Coordination and combination of video sequences with spatial and temporal normalization
First Claim
1. A computer method for generating a composite video sequence from a plurality of given video sequences for display on a display device in communication with a computer processor, wherein each of the given video sequences comprises a representation of a respective one of a plurality of elements with action relative to a respective environment, the method comprising the steps of:
- (a) forming a background representation, using the computer processor, said background representation including a common environment;
(b) aligning said plurality of given video sequences, using the computer processor, based on a matching in size and position of elements, from a background and/or from a foreground, which are present in at least two of the plurality of given video sequences;
(c) forming the composite video sequence, using the computer processor, based on the formed background representation and the aligned video sequences; and
(d) displaying the composite video sequence on the display device.
1 Assignment
0 Petitions
Accused Products
Abstract
Given two video sequences, a composite video sequence can be generated (15) which includes visual elements from each of the given sequences, suitably synchronized (11) and represented in a chosen focal plane. A composite video sequence can be made also by similarly combining a video sequence with an audio sequence. In the composite video sequence, contestants, action figures or objects can be shown against a common background (12) even if the given video sequences differ as to background, with the common background taken from one or the other of the given sequences, for example. Alternatively, a different suitable background can be used, e.g. as derived from the given video sequences, as obtained from another video sequence or image, or as otherwise synthesized.
-
Citations
54 Claims
-
1. A computer method for generating a composite video sequence from a plurality of given video sequences for display on a display device in communication with a computer processor, wherein each of the given video sequences comprises a representation of a respective one of a plurality of elements with action relative to a respective environment, the method comprising the steps of:
-
(a) forming a background representation, using the computer processor, said background representation including a common environment; (b) aligning said plurality of given video sequences, using the computer processor, based on a matching in size and position of elements, from a background and/or from a foreground, which are present in at least two of the plurality of given video sequences; (c) forming the composite video sequence, using the computer processor, based on the formed background representation and the aligned video sequences; and (d) displaying the composite video sequence on the display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50)
-
-
51. A system for generating a composite video sequence from a plurality of given video sequences wherein each of the given video sequences comprises a representation of a respective one of a plurality of elements with action relative to a respective environment, the system comprising:
-
(a) a computer processor forming a background representation, said background representation including a common environment; (b) said computer processor aligning said plurality of video sequences, based on a matching in size and position of elements from a background and/or from a foreground which are present in at least two of the plurality of given video sequences with a visual element in another of the given video sequences, wherein said visual elements are background elements; (c) said computer processor further forming the composite video sequence based on the formed background representation and the aligned video sequences; and (d) a display device in communication with the computer processor, said display device displaying the composite video sequence.
-
-
52. A non-transitory tangible medium comprising a representation of computer instructions for generating a non-transitory composite video sequence from a plurality of given video sequences and displaying the composite video sequence on a display device, wherein each of the given video sequences comprises a representation of a respective one of a plurality of elements with action relative to a respective environment, the computer instructions comprising:
-
(a) instructions for forming a background representation, said background representation including a common environment; (b) instructions for aligning said plurality of video sequences, based on a matching in size and position of elements from a background and/or from a foreground which are present in at least two of given video sequences; (c) instructions for forming the non-transitory composite video sequence based on the formed background representation and the aligned video sequences; and (d) instructions for displaying the non-transitory composite video sequence on the display device.
-
-
53. A computer method for generating a composite video sequence from a plurality of given video sequences and displaying the composite video sequence on a display device in communication with a computer processor, wherein each of the given video sequences comprises a representation of a respective one of a plurality of elements with action relative to a respective environment, the method comprising the steps of:
-
(a) forming a background representation using the computer processor, said background representation including a common environment, wherein for each video sequence a weighted mask sequence is computed, said weighted mask sequence describing the probability of a pixel to belong to the background; (c) aligning said plurality of given video sequences using the computer processor, based on a matching in size and position of elements from a background and/or from a foreground which are present in at least two of the plurality of given video sequences; (d) forming the composite video sequence, using the computer processor, based on the formed background representation and the aligned video sequences; and (e) displaying the composite video sequence on the display device.
-
-
54. A computer method for a computer processor to generate a composite video sequence from a plurality of given video sequences wherein each of the given video sequences comprises a representation of a respective one of a plurality of elements with action relative to a respective environment, the method comprising the steps of:
-
(a) forming a background representation including a common environment, using the computer processor; (b) ascertaining the representation of the respective one of the plurality of elements in each of the given video sequences, using the computer processor; (c) coordinating the actions of the ascertained representations, using the computer processor, wherein said coordinating includes a spatial normalization between the given video sequences, for matching as to size and position a first visual element in one of the given video sequences with a second visual element in another of the given video sequences, wherein said visual elements are background elements; (d) forming the composite video sequence based on the formed background representation and the coordinated representations, using the computer processor, such that the coordinated representations appear in the common environment; and (e) displaying the composite video sequence on a display device.
-
Specification