Complex-valued phase-based eulerian motion modulation
First Claim
1. A method of amplifying temporal variation in at least two images, the method comprising:
- converting at least two images to a transform representation in a transform domain;
for each particular spatial position within the at least two images, examining a plurality of coefficient values representing a neighborhood of the spatial position, the neighborhood of the spatial position being spatially the same across each of the at least two images;
calculating a first vector in the transform domain based on the plurality of coefficient values representing the particular spatial position, the first vector representing change from a first image to a second image of the at least two images describing deformation;
modifying the first vector to create a second vector in the transform domain representing amplified movement at the particular spatial position between the first and second images;
calculating a second plurality of coefficients based on the second vector of the transform domain; and
from the second plurality of coefficients, generating an output image showing motion amplified according to the second vector for each particular spatial position and alternatively amplified color variation between the first and second images.
5 Assignments
0 Petitions
Accused Products
Abstract
In one embodiment, a method of amplifying temporal variation in at least two images includes converting two or more images to a transform representation. The method further includes, for each spatial position within the two or more images, examining a plurality of coefficient values. The method additionally includes calculating a first vector based on the plurality of coefficient values. The first vector can represent change from a first image to a second image of the at least two images describing deformation. The method also includes modifying the first vector to create a second vector. The method further includes calculating a second plurality of coefficients based on the second vector.
29 Citations
18 Claims
-
1. A method of amplifying temporal variation in at least two images, the method comprising:
-
converting at least two images to a transform representation in a transform domain; for each particular spatial position within the at least two images, examining a plurality of coefficient values representing a neighborhood of the spatial position, the neighborhood of the spatial position being spatially the same across each of the at least two images; calculating a first vector in the transform domain based on the plurality of coefficient values representing the particular spatial position, the first vector representing change from a first image to a second image of the at least two images describing deformation; modifying the first vector to create a second vector in the transform domain representing amplified movement at the particular spatial position between the first and second images; calculating a second plurality of coefficients based on the second vector of the transform domain; and from the second plurality of coefficients, generating an output image showing motion amplified according to the second vector for each particular spatial position and alternatively amplified color variation between the first and second images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 17)
-
-
9. A system for amplifying temporal variation in at least two images, the system comprising:
-
a transform module configured to convert at least two images to a transform representation in a transform domain; a coefficient examination module configured to, for each particular spatial position within the at least two images, examine plurality of coefficient values representing a neighborhood of the spatial position, the neighborhood of the spatial position being spatially the same across each of the at least two images; a vector calculation module configured to calculate a first vector in the transform domain based on the plurality of coefficient values representing the particular spatial position, the first vector representing change from a first image to a second image of the at least two images describing deformation; a vector modification module configured to modify the first vector to create a second vector in the transform domain representing amplified movement at the particular spatial position between the first and second images; a calculation module configured to calculate a second plurality of coefficients based on the second vector in the transform domain; and a modified image generation module configured to generate at least one image based on the second plurality of coefficients, the generated at least one image showing amplified motion according to the second vector for each particular spatial position and alternatively amplified color variation between the first and second images. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 18)
-
Specification