IMAGE PROCESSING METHOD AND IMAGE PROCESSING APPARATUS
1 Assignment
0 Petitions
Accused Products
Abstract
To provide an image processing apparatus which robustly performs segmentation on an image including an object such as a moving person with its deformation. The image processing apparatus includes: an image inputting unit (101) which receives temporally successive images; a motion analyzing unit (102) which calculates motions of blocks using at least two temporally different images and calculates, based on the motions of the blocks, temporal motion trajectories of the blocks in the temporally successive images; a distance calculating unit (103) which calculates a distance which indicates a similarity of the motions of the blocks, using a temporal motion trajectory of a block i and a temporal motion trajectory of a block other than the block i calculated by the motion analyzing unit; and a nonlinear space processing unit (104) which projects the distance calculated by the distance calculating unit into a nonlinear space and performs the segmentation on a result of the projection in the nonlinear space.
36 Citations
27 Claims
-
1-16. -16. (canceled)
-
17. An image processing method for performing segmentation on an image including an articulated object whose shape changes, based on motions of blocks, each of which is made up of one pixel or adjacent pixels, said method comprising:
-
an image receiving step of receiving temporally successive images; a motion analyzing step of calculating the motions of the blocks using at least two temporally different images and calculating, based on the motions of the blocks, temporal motion trajectories of the blocks in the temporally successive images; a distance calculating step of calculating distances, each of which indicates a similarity of the motions of the blocks, based on (a) a difference of positions, (b) an angle, (c) a difference of angle of motion or (d) a change of motion, between a temporal motion trajectory of a block i and a temporal motion trajectory of a block other than the block i calculated in said motion analyzing step; and a nonlinear space processing step of projecting the distances calculated in said distance calculating step into a nonlinear space by calculating nonlinearized distances using one of the following alternatives; (i) infinitizing distances among distances to the block i which are greater than the k-th smallest distances; (ii) infinitizing distances among the distances to the block i which are greater than a threshold; and (iii) transforming the distances using exponential function, and transforming the nonlinearized distances into vectors by dimensionality reduction and performing the segmentation of the vectors, wherein, in said distance calculating step, using two distance functions, distances are calculated for each of pairs of the blocks, and wherein, in said nonlinear space processing step, each of the distances is transformed into vectors in respective different nonlinear spaces, and segmentation of concatenated vectors is performed which is the concatenation of the two vectors of the different nonlinear spaces. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 27)
-
-
26. An image processing apparatus for performing segmentation on an image including an articulated object whose shape changes, based on motions of blocks, each of which is made up of one pixel or adjacent pixels, said apparatus comprising:
-
an image receiving unit operable to receive temporally successive images; a motion analyzing unit operable to calculate the motions of the blocks using at least two temporally different images and to calculate, based on the motions of the blocks, temporal motion trajectories of the blocks in the temporally successive images; a distance calculating unit operable to calculate distances, each of which indicates a similarity of the motions of the blocks, based on (a) a difference of positions;
(b) an angle, (c) a difference of angle of motion or (d) a change of motion, between a temporal motion trajectory of a block i and a temporal motion trajectory of a block other than the block i calculated by said motion analyzing unit; anda nonlinear space processing unit operable to project the distances calculated by said distance calculating unit into a nonlinear space by calculating nonlinearized distances using one of the following alternatives; (i) infinitizing distances among distances to the block i which are greater than the k-th smallest distances; (ii) infinitizing distances among the distances to the block i which are greater than a threshold; and (iii) transforming the distances using exponential function, and transforming the nonlinearized distances into vectors by dimensionality reduction and performing the segmentation of the vectors, wherein said distance calculating unit, using two distance functions, calculates distances for each of pairs of the blocks, and wherein said non linear space processing unit transforms each of the distances transformed into vectors in respective different nonlinear spaces, and performs segmentation of concatenated vectors which is the concatenation of the two vectors of the different nonlinear spaces.
-
Specification