Video composition and position system and media signal communication system

• US 6,020,931 A
• Filed: 04/24/1997
• Issued: 02/01/2000
• Est. Priority Date: 04/25/1996
• Status: Expired due to Fees

• Current Assignee: George S. Sheng
• Original Assignee: George S. Sheng
• Inventors: Bilbrey, Brett, Gust, Lawrence A.
• Primary Examiner(s): HSIA, SHERRIE Y
• Application Number:
  US08/840,014
• Time in Patent Office: 1,013 Days
• Field of Search: 348/584, 348/585, 348/586, 348/587, 348/589, 348/590, 348/592, 348/593, 348/598, 348/599, 348/591, 382/284, 382/285
• US Class Current: 348/584
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A video signal compositing system uses advanced communication techniques to make compositing with virtual studio, blue screen, multi-color compositing, dynamic blue screen, add insertion, synthetic transfiguration, or panoramic displays more economical. A data communication system comprises a number of shared communications channels for transmitting data streams in a bi-directional manner. Multiple interface subsystems are coupled to the communications channels. The interface subsystems have a time slot controller that allocates time slots between the communication channels. A router is used in conjunction with the interface subsystems to define the time slots in which data on the shared communications channels are valid. Processing elements connected via the interface subsystem allow reconfiguration, via the shared communications channels, of processing operations performed. Shared communications channels solve problems in video timing and routing of video signals, including but limited to video compositing and spatial positioning. Multiple mask, dynamic tracking, 3-D depth imaging, image processing and stereoscopic imaging enhance image compositing on systems ranging from NTSC video, to HDTV, to panoramic display systems.

Claims

1. A video signal compositing system, comprising:

a first source of video signals comprising an image;

an additional source of video signals;

a source of control signals defining a spatial mapping relationship for the additional source of video signals to be mapped into the first source of video signals;

transformation means for mapping the additional source of video signals responsive to the control signals and producing remapped additional source of video signals; and

means for combining the remapped additional source of video signals onto the first source of video signals responsive to the control signals.

2. The system as in claim 1, wherein the control signals are computer generated to define a region within the image for mapping onto by the additional source of video signals.

3. The system as in claim 1, wherein the first source of video signals is a video camera which provides a video signal representing an image and ancillary data;

and

wherein the control signals are derived responsive to the ancillary data.

4. The system as in claim 3, wherein the ancillary data is representative of camera position.

5. The system as in claim 4, wherein the additional source of video signals is selected from among a plurality of additional video sources each associated with a different relative camera position, responsive to the ancillary data.

6. The system as in claim 4, wherein the additional source of video signals is processing differently for different relative camera positions responsive to the ancillary data.

7. The system as in claim 1, wherein the source of control signals are derived from the first source of video signals.

8. The system as in claim 7 wherein the source of control signals are matte signals.

9. The system as in claim 8, wherein the first source of video signals is comprised of at least one colored region and wherein the matte signals are derived from detection of the said colored region.

10. The system as in claim 9, wherein there are at least two colored regions, wherein there are multiple ones of the matte signals, each associated with a respective one of the colored regions.

11. The system as in claim 8, wherein the matte signals are derived from detecting the edges of the colored region.

12. The system as in claim 8, wherein the matte signals are provided by a source independent of the first source of video signals.

13. The system as in claim 8, wherein the matte signals are provided by a source external to the first source of video signals.

14. The system as in claim 8, wherein the first source of video signals is further comprised of ancillary data, and wherein the matte signals are derived responsive to the ancillary data.

15. The system as in claim 14, wherein the matte signals are provided by the ancillary data.

16. The system as in claim 14, wherein the matte signals are synthesized responsive to the ancillary data.

17. The system as in claim 3, wherein the ancillary data defines a virtual region, and wherein the source of control signals maps the additional source of video signals onto the virtual region.

18. A video signal compositing system comprising:

means for providing a first source of video signals comprising an image;

means for providing an additional source of video signals;

means for providing a source of transformation control signals;

means for providing a source of combining control signals;

transformation means, responsive to the transformation control signals, to transform video signals from the additional source of video signals; and

means for combining, responsive to the first source of video signals, the transformed additional source of video signals, and the combining control signals, for providing a composited output combining the transformed additional source of video signals with the first source of video signals.

19. The system as is claim 18, wherein the transformation control signals are derived from the first source of video signals.

20. The system as in claim 18, wherein the transformation control signals are derived from ancillary data.

21. The system as in claim 20, wherein the ancillary data is comprised of control signals originating from the first source of video signals.

22. The system as is claim 20, wherein the ancillary data is comprised of externally provided computer data.

23. The system as in claim 22, wherein the externally provided computer data is output from a shot box.

24. The system as in claim 18, wherein the combining control signals are derived from the first source of video signals.

25. The systems as in claim 18, wherein the combining control signals are derived from ancillary data.

26. The system as in claim 18, wherein the first source of video signals is comprised of a video camera output.

27. The system as in claim 18, wherein the first source of video signals is comprised of computer-generated image data.

28. The system as in claim 18, wherein the additional source of video signals is comprised of a video camera output.

29. The system as in claim 18, wherein the additional source of video signals is comprised of a computer-generated image data.

30. The system as in claim 25, wherein the ancillary data is provided as an output from the means for providing the first source of video signals.

31. The system as in claim 18, wherein the transformation means is comprised of a digital video effects processor.

32. The system as in claim 18, wherein the means for combining is comprised of a video keyer.

33. A video signal compositing system, comprising:

a first source of video signals comprising an image, wherein the image is comprised of multiple colored regions, having a spatial relationship to one another;

an additional source of video signals;

means for associating the additional source of video signals with a specific respective one of the multiple colored regions;

control means for mapping the additional source of video to its respective one of the multiple colored regions, responsive to the means for associating and to the spatial relationship; and

means for combining the first source and additional source of video signals to provide a composite output video signal, responsive to the control means.

34. The system as in claim 33,

wherein the additional source of video signals is comprised of a plurality of additional sources of video signals;

wherein the means for associating provides means for associating each one of the plurality of additional sources of video signals with a respective exclusive one of the multiple colored regions;

wherein the control means provides means for mapping each of the additional sources of video signals to its respective one of the multiple colored regions responsive to the means for associating; and

wherein the means for combining provides means for combining the first source of video signals and the additional sources of video signals to provide the composite output video signal responsive to the control means.

35. The system as in claim 33, wherein there are at least two colored regions.

36. The system as in claim 33, wherein the additional source of video signals is video imagery.

37. The system as in claim 33, wherein the additional source of video signals is a texture map.

38. The system as in claim 33, wherein the additional source of video signals is a still frame image.

39. The system as in claim 33, wherein the additional source of video signals is a graphic.

40. The system as in claim 33, wherein the additional source of video signals is provided from an external source.

41. The system as in claim 33, wherein the additional source of video signals is provided from a source internal to the system.

42. The system as in claim 33, wherein the spatial relationship is determined responsive to positional information from a video camera.

43. The system as in claim 33, wherein the spatial relationship is determined responsive to signals from an alpha channel.

44. The system as in claim 33, wherein the spatial relationship is determined responsive to a calibration pattern within each one of the colored regions.

45. The system as in claim 33, wherein the spatial relationship is determined responsive to the relative position of edges of each of the colored regions.

46. The system as in claim 33, further comprising:

a third source of video signals providing a perceived depth level; and

wherein the control means is responsive to the third source of video signals in providing for the mapping.

47. The system as in claim 46 wherein the third source of video signals is an alpha channel.

48. The system as in claim 46, wherein the third source of video signals is a non-camera generated source.

49. The system as in claim 46, wherein the third source of video signals is an artificially generated depth.

50. The system as in claim 33, wherein the first source of video signals is provided from a video camera.

51. The system as in claim 50, wherein the video camera is rotatable around a first pivot axis, and movable along a second axis independent of the first pivot axis.

52. The system as in claim 50, wherein the video camera provides an output comprised of video data and environmental information representative of the position of the video camera.