INTERACTIVE SYSTEMS AND METHODS FOR VIDEO COMPOSITING

• US 20100027961A1
• Filed: 06/30/2009
• Published: 02/04/2010
• Est. Priority Date: 07/01/2008
• Status: Active Grant

• Current Assignee: NOO INC.
• Original Assignee: YOOSTAR ENTERTAINMENT GROUP, INC
• Inventors: Veenstra, Matthew, Waldrep, Mark, Wilker, Scott, Gentile, John, Gentile, Anthony
• Granted Patent: US 8,824,861 B2
• Time in Patent Office: Days
• US Class Current: 386/278
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

Certain interactive role performance systems and methods are disclosed that allow users to select a role to play in a prerecorded video, such as a movie scene, and to replace an original actor of that role with the user'"'"'s performance. In certain examples, the user selects a prerecorded scene from which a character has been removed and records his or her performance. The interactive role performance system can insert the user'"'"'s performance in place of the original character, thereby creating the appearance that the user is interacting, such as in real-time, with the other characters in the movie scene. Moreover, systems and methods can further utilize background subtraction techniques to isolate the user image. In further examples, the recorded user performance is stored separately from the prerecorded video.

Claims

1. A method for combining video images in an interactive video system, the method comprising:

receiving a first video signal associated with prerecorded video content having multiple frames;

receiving metadata associated with the first video signal, the metadata being indicative of selected ones of the multiple frames in which an original character of the prerecorded video content has been removed prior to said receiving the first video signal;

receiving a second video signal comprising second video content having a background image and a video image of a participant playing a role of the original character in front of the background image;

filtering the second video signal to remove the background image to create a modified second video signal with the video image of the participant; and

combining the first video signal and the modified second video signal to create combined video content, said combining comprising selectively inserting the video image of the participant in the selected ones of the multiple frames such that the participant appears in place of the original character by overlaying the modified second video signal on the first video signal such that placement of the video image of the participant is unrestricted within each of the selected ones of the multiple frames.

2. The method of claim 1, additionally comprising displaying the combined video content in real time with respect to said receiving the second video signal.

3. The method of claim 1, wherein said filtering comprises:

receiving a third signal consisting essentially of the background image;

comparing the second video signal with the third signal to identify matching portions of the second video signal and the third signal; and

modifying the second video signal by designating the matching portions within the second video signal to be transparent.

4. The method of claim 1, wherein the prerecorded video content comprises a portion of at least one of a movie, a television show, and a commercial.

5. The method of claim 1, wherein the prerecorded video content comprises a still image.

6. The method of claim 1, wherein said receiving the first video signal comprises receiving the first video signal via a network.

7. The method of claim 1, additionally comprising displaying a script to the participant during said receiving the second video signal, wherein the script corresponds to lines of the original character.

8. The method of claim 1, additionally comprising storing the modified second video signal separate from the first video signal for later playback.

9. The method of claim 8, wherein said storing comprises uploading the modified second video signal onto a network.

10. The method of claim 1, additionally comprising:

receiving a third video signal comprising a second video image of a second participant; and

combining the first video signal and the third video signal to selectively insert the second video image of the second participant in place of a second original character of the prerecorded video content.

11. The method of claim 1, wherein said combining further comprises placing one or more elements delineated by a matte layer in a foreground of the combined video content to overlay at least a portion of the inserted video image of the participant.

12. A system for interactive video entertainment, the system comprising:

a first database comprising,

prerecorded video content having multiple frames, and

metadata associated with the prerecorded video content, the metadata identifying selected ones of the multiple frames in which an original character of the prerecorded video content has been removed;

a video input configured to receive a real-time video signal comprising a video image of a participant and a background image; and

a processing module configured to execute on a computing device, the processing module configured to,

filter the real-time video signal to remove the background image to create a modified real-time video signal, and

combine, based at least on the metadata, the prerecorded video content and the modified real-time video signal to selectively insert the video image of the participant in the selected ones of the multiple frames such that the video image of the participant appears in place of the original character and such that the video image of the participant can appear anywhere within each of the selected ones of the multiple frames.

13. The system of claim 12, further comprising a video recorder configured to generate the real-time video signal and to transmit the real-time video signal to the video input.

14. The system of claim 13, wherein the video recorder comprises a webcam.

15. The system of claim 12, wherein the processing module is further configured to cause a display of the combined prerecorded content and modified real-time video signal.

16. The system of claim 12, wherein the processing module is further configured to cause a display of a character outline at a location from which the original character was removed from within the prerecorded video content.

17. The system of claim 12, further comprising a second database configured to store second video content based on the modified second video signal without the prerecorded video content.

18. The system of claim 12, wherein the processing module comprises a graphics processing unit (GPU).

19. A system for combining video images, the system comprising:

means for identifying selected ones of multiple frames of prerecorded video content in which an original character has been removed from the prerecorded video content;

means for receiving a second video signal comprising a video image of a participant and a background image;

means for filtering the second video signal to remove the background image and to create a modified second video signal; and

means for combining, based at least on said identifying means, the prerecorded video content and the modified second video signal to selectively insert the video image of the participant in the selected ones of the multiple frames such that the video image of the participant appears in place of the original character, wherein said combining further comprises overlaying the modified second video signal on the prerecorded video content such that placement of the video image of the participant is unrestricted within each of the selected ones of the multiple frames.

20. The system of claim 19, further comprising means for causing a real-time display of the combined prerecorded video content and modified second video signal without storing the prerecorded video content jointly with the modified second video signal as a single file.