Video object clipping method and apparatus
First Claim
Patent Images
1. A video object clipping method comprising:
- storing, in a storage unit, a plurality of sequential original images each including representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object;
determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images;
determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and
deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images,wherein determining the deformation parameter includes determining the deformation parameter based on matching of the criteria original image with the criteria reference alpha image,wherein the method further includes,generating a string of the reference alpha images at a frame rate in a time axis,determining a set of the criteria original image and the criteria reference alpha image,performing a phase matching by equalizing a frame rate between a string of the sequential original images and the string of the reference alphas images, the frame rate being equalized by downsampling the string of the reference alpha images using the determined criteria alpha image, andgenerating the output alpha images using the string of reference alpha images having the same frame rate as that of the string of the sequential original images.
1 Assignment
0 Petitions
Accused Products
Abstract
A video object clipping method includes storing, in a storage unit, original images each including a video object to be clipped and reference alpha images representing objects prepared, determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images, determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image, and deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images.
-
Citations
10 Claims
-
1. A video object clipping method comprising:
-
storing, in a storage unit, a plurality of sequential original images each including representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein determining the deformation parameter includes determining the deformation parameter based on matching of the criteria original image with the criteria reference alpha image, wherein the method further includes, generating a string of the reference alpha images at a frame rate in a time axis, determining a set of the criteria original image and the criteria reference alpha image, performing a phase matching by equalizing a frame rate between a string of the sequential original images and the string of the reference alphas images, the frame rate being equalized by downsampling the string of the reference alpha images using the determined criteria alpha image, and generating the output alpha images using the string of reference alpha images having the same frame rate as that of the string of the sequential original images.
-
-
2. A video object clipping method comprising:
-
storing, in a storage unit, a plurality of sequential original images each including representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein determining the deformation parameter includes determining the deformation parameter based on matching of the criteria original image with the criteria reference alpha image, wherein the string of the reference alpha images has a higher frame rate than the string of the sequential original images, and wherein the method further includes, generating a plurality of temporary reference alpha image strings with a plurality of phases by downsampling the string of the reference alpha images using a plurality of temporary criteria alpha images, generating a plurality of temporary output alpha image strings based on the temporary reference alpha image strings, and selecting one of the temporary output alpha images as a final output alpha image string.
-
-
3. A video object clipping method comprising:
-
storing, in a storage unit, a plurality of sequential original images each including representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein determining the deformation parameter includes determining the deformation parameter based on matching of the criteria original image with the criteria reference alpha image, wherein the method further includes, attaching a first marking to each of the reference alpha images, attaching a second marking to the original object of the criteria original image, and performing a phase matching by finding the criteria reference alpha image and the criteria original image which are nearest in time to each other referring to the first marking and the second marking.
-
-
4. A video object clipping method comprising:
-
storing, in a storage unit, a plurality of sequential original images each including representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein determining the deformation parameter includes determining the deformation parameter based on matching of the criteria original image with the criteria reference alpha image, wherein the method further includes, storing a background image of the criteria original mage in the storage unit, detecting a position of the original object by obtaining a difference between the background image and the criteria original image, and performing a phase matching by finding one of the criteria reference alpha images which is nearest in time to the criteria original image based on a detection result.
-
-
5. A video object clipping method comprising:
-
storing, in a storage unit, a plurality of sequential original images each including representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; determining a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; determining a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and deforming remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein determining the deformation parameter includes determining the deformation parameter based on matching of the criteria original image with the criteria reference alpha image, wherein the method further includes, generating a first differential image between the criteria original image and a past image of the sequential original images, generating a second differential image between the criteria original image and a future image of the sequential original images, detecting a position of the object based on a logical multiplication image obtained by subjecting pixel values of the first differential image and the second differential image to a logical multiplication, and performing a phase matching by finding one of the reference alpha images which is nearest in time to the criteria sequential image based on a detection result.
-
-
6. A video object clipping apparatus comprising:
-
a storage unit configured to store a plurality of sequential original images representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; a critical image determination unit configured to determine a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; a deformation parameter determination unit configured to determine a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and a deform unit configured to deform remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein the deformation parameter determination unit comprises a determination unit configured to determine the deformation parameter based on matching of the criteria original image and the criteria reference alpha image, wherein the apparatus further includes, means for generating a string of the reference alpha images at a frame rate in a time axis, means for determining a set of the criteria original image and the criteria reference alpha image, means for performing a phase matching by equalizing a frame rate between a string of the sequential original images and the string of the reference alphas images, the frame rate being equalized by downsampling the string of the reference alpha images using the determined criteria alpha image, and means for generating the output alpha images using the string of the reference alpha images having the same frame rate as that of the string of the sequential original images.
-
-
7. A video object clipping apparatus comprising:
-
a storage unit configured to store a plurality of sequential original images representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; a critical image determination unit configured to determine a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; a deformation parameter determination unit configured to determine a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and a deform unit configured to deform remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein the deformation parameter determination unit comprises a determination unit configured to determine the deformation parameter based on matching of the criteria original image and the criteria reference alpha image, wherein the string of the reference alpha images has a higher frame rate than the string of the sequential original images, and wherein the apparatus further includes, means for generating a plurality of temporary reference alpha image strings with a plurality of phases by downsampling the string of the reference alpha images using a plurality of temporary criteria alpha images as a criteria, means for generating a plurality of temporary output alpha image strings based on the string of the temporary reference alpha images with plural phases, and means for selecting one of the temporary output alpha images as a final output alpha image string.
-
-
8. A video object clipping apparatus comprising:
-
a storage unit configured to store a plurality of sequential original images representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; a critical image determination unit configured to determine a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; a deformation parameter determination unit configured to determine a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and a deform unit configured to deform remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein the deformation parameter determination unit comprises a determination unit configured to determine the deformation parameter based on matching of the criteria original image and the criteria reference alpha image, wherein the apparatus further includes; means for attaching a first marking to each of the reference alpha images, means for attaching a second marking to the original object of the criteria original image, and means for performing a phase matching by finding the criteria reference alpha image and the criteria original image which are nearest in time to each other referring to the first marking and the second marking.
-
-
9. A video object clipping apparatus comprising:
-
a storage unit configured to store a plurality of sequential original images representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; a critical image determination unit configured to determine a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; a deformation parameter determination unit configured to determine a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and a deform unit configured to deform remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein the deformation parameter determination unit comprises a determination unit configured to determine the deformation parameter based on matching of the criteria original image and the criteria reference alpha image, wherein the storage unit stores a background image of the criteria original image, and wherein the apparatus further includes, means for detecting a position of the original object by obtaining a difference between the background image and the criteria original image, and means for performing a phase matching by finding one of the criteria reference alpha images which is nearest in time to the criteria original image based on a detection result.
-
-
10. A video object clipping apparatus comprising:
-
a storage unit configured to store a plurality of sequential original images representing a substantially constant movement of a to-be-clipped object and a plurality of prepared reference alpha images representing a plurality of sequential reference images representing a substantially constant movement of a reference object; a critical image determination unit configured to determine a criteria original image and a criteria reference alpha image from the original images and the reference alpha images; a deformation parameter determination unit configured to determine a deformation parameter by deforming the criteria reference alpha image to correspond to the criteria original image; and a deform unit configured to deform remaining ones of the reference alpha images according to the determined deformation parameter to generate output alpha images corresponding to the original images, wherein the deformation parameter determination unit comprises a determination unit configured to determine the deformation parameter based on matching of the criteria original image and the criteria reference alpha image, wherein the apparatus further includes, means for generating a first differential image between the criteria original mage and a past image of the sequential original images, means for generating a second differential image between the criteria original image and a future image of the sequential original images, means for detecting a position of the object based on a logical multiplication image obtained by subjecting pixel values of the first differential image and the second differential image to a logical multiplication, and means for performing a phase matching by finding one of the reference alpha images which is nearest in time to the criteria sequential image based on a detection result.
-
Specification