On-location video assistance system with computer generated imagery overlay

• US 6,570,581 B1
• Filed: 10/25/1999
• Issued: 05/27/2003
• Est. Priority Date: 10/25/1999
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Smith, Kevin Anthony
• Primary Examiner(s): BRIER, JEFFERY A
• Application Number:
  US09/427,197
• Time in Patent Office: 1,310 Days
• Field of Search: 345/158, 345/435, 345/632, 345/638, 348/239, 348/330.01, 348/330.02, 348/330.03, 348/584, 348/589
• US Class Current: 345/632
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications
• CPC Class Codes: H04N 5/2228 Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing

Abstract

A video playback system for assisting on-location film production. One embodiment of the invention includes a computer system capable of generating computer generated imagery (CGI) and receiving live video feed from a camera. The computer system is also coupled to a first display screen for displaying computer generated images and a second display screen for displaying the live video feed overlaid with computer generated images. In one embodiment of the present invention, a portion of the first display screen containing computer generated images can be selected for overlaying on the live video feed. The video playback system of the present invention is also capable of storing the live video feed and the images resulted from overlaying the computer generated images and the live video feed. The present invention provides the advantages of allowing live/CGI composites to be played and viewed on the director'"'"'s monitor for review while on-location.

Claims

1. A video playback system comprising:

means for generating computer generated imagery;

means for displaying said computer generated imagery on a first display screen;

means for selecting a portion of said first display screen, said portion including said computer generated imagery;

means for receiving a live video stream;

means for overlaying video signals representative of said portion of said first display screen on said live video stream to generate an overlaid video stream;

means for rendering said overlaid video stream on a second display screen; and

means for storing said overlaid video stream.

2. A video playback system as recited in claim 1 further comprising means for recording a live audio stream.

3. A video playback system as recited in claim 1 wherein said means for receiving comprises a radio frequency (RF) receiver.

4. A video playback system as recited in claim 1 further comprising a hand-held controller unit for controlling the display of said overlaid video stream.

5. A video playback system comprising:

means for generating computer generated imagery;

means for displaying said computer generated imagery on a first display screen;

means for selecting a portion of said first display screen, said portion including said computer generated imagery;

means for receiving a live video stream;

means for overlaying video signals representative of said portion of said first display screen on said live video stream to generate an overlaid video stream;

means for rendering said overlaid video stream on a second display screen; and

means for replaying said live video stream at a different speed than a speed at which said live video stream is filmed.

6. A video playback system as recited in claim 5 further comprising means for recording a live audio stream.

7. A video playback system as recited in claim 5 wherein said means for receiving comprises a radio frequency (RF) receiver.

8. A video playback system as recited in claim 5 further comprising a hand-held controller unit for controlling the display of said overlaid video stream.

9. A computer readable memory having stored therein computer readable program code for causing a computer system to perform a method of displaying a live video feed, said method comprising the steps of:

generating computer generated imagery;

displaying said computer generated imagery on a first display screen;

selecting a portion of said first display screen, said portion including said computer generated imagery;

receiving a live video stream;

overlaying video signals representative of said portion of said first display screen on said live video stream to generate an overlaid video stream;

rendering said overlaid video stream on a second display screen; and

storing said overlaid video stream.

10. A computer readable memory as recited in claim 9 wherein said method further comprises the step of recording a live audio stream.

11. A computer readable memory as recited in claim 9 wherein said method further comprises the step of converting a radio frequency (RF) signal representing said live video stream into digital representation for said live video stream.

12. A computer readable memory as recited in claim 9 wherein said method further comprises the step of receiving control signals from a hand-held controller unit.

13. A computer readable memory having stored therein computer readable program code for causing a computer system to perform a method of displaying a live video feed, said method comprising the steps of:

generating computer generated imagery;

displaying said computer generated imagery on a first display screen;

selecting a portion of said first display screen, said portion including said computer generated imagery;

receiving a live video stream;

overlaying video signals representative of said portion of said first display screen on said live video stream to generate an overlaid video stream;

rendering said overlaid video stream on a second display screen; and

replaying said live video stream at a different speed than a speed at which said live video stream is filmed.

14. A computer readable memory as recited in claim 13 wherein said method further comprises the step of recording a live audio stream.

15. A computer readable memory as recited in claim 13 wherein said method further comprises the step of converting a radio frequency (RF) signal representing said live video stream into digital representation for said live video stream.

16. A computer readable memory as recited in claim 13 wherein said method further comprises the step of receiving control signals from a hand-held controller unit.

17. A method of displaying a live video feed, said method comprising the steps of:

generating computer generated imagery;

displaying said computer generated imagery on a first display screen;

selecting a portion of said first display screen, said portion including said computer generated imagery;

receiving a live video stream;

overlaying video signals representative of said portion of said first display screen on said live video stream to generate an overlaid video stream;

rendering said overlaid video stream on a second display screen; and

storing said overlaid video stream.

18. A method as recited in claim 17 wherein said method further comprises the step of recording a live audio stream.

19. A method as recited in claim 17 wherein said method further comprises the step of converting a radio frequency (RF) signal representing said live video stream into digital representation for said live video stream.

20. A method as recited in claim 17 wherein said method further comprises the step of receiving control signals from a hand-held controller unit.

21. A method of displaying a live video feed, said method comprising the steps of:

generating computer generated imagery;

displaying said computer generated imagery on a first display screen;

selecting a portion of said first display screen, said portion including said computer generated imagery;

receiving a live video stream;

overlaying video signals representative of said portion of said first display screen on said live video stream to generate an overlaid video stream;

rendering said overlaid video stream on a second display screen; and

replaying said live video stream at a slower speed than a speed at which said live video stream is filmed.

22. A method as recited in claim 21 wherein said method further comprises the step of recording a live audio stream.

23. A method as recited in claim 21 wherein said method further comprises the step of converting a radio frequency (RF) signal representing said live video stream into digital representation for said live video stream.

24. A method as recited in claim 21 wherein said method further comprises the step of receiving control signals from a hand-held controller unit.