Real-time chromakey matting using image statistics
First Claim
1. A method for generating an alpha matte based on chromakey information in real-time, comprising:
- (a) off-line training comprising calibration of chroma key parameterization by sampling chroma color and statistically analyzing invariant properties of chroma key pixels using principal component analysis (PCA) to transform the chroma color into a transformed color space;
(b) real-time classification via a processor comprising estimating an alpha matte using a classifier to classify pixels, p, in a video frame using geometric objects whose boundaries define opacity used for alpha matting;
(c) outputting a resulting alpha matte to allow for alpha blending to composite a virtual scene with a video feed.
3 Assignments
0 Petitions
Accused Products
Abstract
A method, system and computer readable media for real-time chromakey matting using image statistics. To identify the chroma key spectrum, the system/method executes in three stages. In an off-line training stage, the system performs semi-automatic calibration of the chroma key parameterization. In the real-time classification stage, the system estimates the alpha matte on a GPU. Finally, an optional error minimization stage improves the estimated matte, accounting for misclassifications and signal noise. Given the resulting matte, standard alpha blending composites the virtual scene with the video feed to create the illusion that both worlds coexist.
40 Citations
20 Claims
-
1. A method for generating an alpha matte based on chromakey information in real-time, comprising:
-
(a) off-line training comprising calibration of chroma key parameterization by sampling chroma color and statistically analyzing invariant properties of chroma key pixels using principal component analysis (PCA) to transform the chroma color into a transformed color space; (b) real-time classification via a processor comprising estimating an alpha matte using a classifier to classify pixels, p, in a video frame using geometric objects whose boundaries define opacity used for alpha matting; (c) outputting a resulting alpha matte to allow for alpha blending to composite a virtual scene with a video feed. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 20)
-
-
12. A system for generating an alpha matte based on chroma key information in real-time, said system comprising:
- a display device;
a memory; and
a processor with hardware and software components for;(a) off-line training comprising calibration of chroma key parameterization by sampling chroma color and statistically analyzing invariant properties of chroma key pixels using principal component analysis (PCA) to transform the chroma color into a transformed color space; (b) real-time classification via a processor comprising estimating an alpha matte using a classifier to classify pixels, p, in a video frame using geometric objects whose boundaries define opacity used for alpha matting; (c) outputting a resulting alpha matte to allow for alpha blending to composite a virtual scene with a video feed. - View Dependent Claims (13, 14, 15)
- a display device;
-
16. An article of manufacture comprising:
- a computer usable medium having computer readable code means embodied therein for;
(a) off-line training comprising calibration of chroma key parameterization by sampling chroma color and statistically analyzing invariant properties of chroma key pixels using principal component analysis (PCA) to transform the chroma color into a transformed color space; (b) real-time classification via a processor comprising estimating an alpha matte using a classifier to classify pixels, p, in a video frame using geometric objects whose boundaries define opacity used for alpha matting; (c) outputting a resulting alpha matte to allow for alpha blending to composite a virtual scene with a video feed. - View Dependent Claims (17, 18, 19)
- a computer usable medium having computer readable code means embodied therein for;
Specification