METHOD OF OCCLUSION-BASED BACKGROUND MOTION ESTIMATION
First Claim
1. A method of motion estimation programmed in a memory of a device comprising:
- a. performing motion segmentation to segment an image into different objects using motion vectors to obtain a segmentation result;
b. generating an occlusion matrix using the segmentation result, occluded pixel information and image data; and
c. estimating background motion using the occlusion matrix.
1 Assignment
0 Petitions
Accused Products
Abstract
A technique for estimating background motion in monocular video sequences is described herein. The technique is based on occlusion information contained in video sequences. Two algorithms are described for estimating background motion: one fits well for general cases, and the other fits well for a case when available memory is very limited. The significance of the technique includes: a motion segmentation algorithm with adaptive and temporally stable estimate of the number of objects is developed, two algorithms are developed to infer occlusion relations among segmented objects using the detected occlusions and background motion estimation from the inferred occlusion relations.
21 Citations
22 Claims
-
1. A method of motion estimation programmed in a memory of a device comprising:
-
a. performing motion segmentation to segment an image into different objects using motion vectors to obtain a segmentation result; b. generating an occlusion matrix using the segmentation result, occluded pixel information and image data; and c. estimating background motion using the occlusion matrix. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method of motion segmentation programmed in a memory of a device comprising:
-
a. generating a histogram using input motion vectors; b. performing K-means clustering with a different number of clusters and generating a cost; c. determining a number of clusters using the cost; d. computing a centroid of each cluster; and e. clustering a motion vector at each pixel with a nearest centroid, wherein the clustered motion vector and nearest centroid segments a frame into object. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A method of occlusion relation inference programmed in a memory of a device comprising:
-
a. finding a first corresponding motion segment of an occluding object; b. finding a pixel location in the next frame; c. finding a second corresponding motion segment of the occluded object; d. incrementing an entry in an occlusion matrix; and e. repeating the steps a-d until all occlusion pixels have been traversed. - View Dependent Claims (12, 13)
-
-
14. A method of occlusion relation inference programmed in a memory of a device comprising:
-
a. using a sliding window to locate occlusion regions and neighboring regions; b. moving the window if there are no occluded pixels are in the window; c. computing a first luminance histogram at the occluded pixels; d. computing a second luminance histogram for each motion segment inside the window; e. comparing the first luminance histogram and the second luminance histogram; f. identifying a first motion segment with a closest luminance histogram to an occlusion region as a background object in the window; g. identifying a second motion segment with the most pixels among all but background motion segments as an occluding, foreground object; h. incrementing an entry in an occlusion matrix by the number of pixels in the occlusion region in the window; and i. repeating the steps a-h until an entire frame has been traversed. - View Dependent Claims (15)
-
-
16. A method of background motion estimation programmed in a memory of a device comprising:
-
a. designing a metric to measure an amount of contradiction when selecting a motion segment as a background object; b. assigning a background motion to be the motion segment with a minimum amount of contradiction; and c. subtracting the background motion of the background object from motion vectors to obtain a depth map. - View Dependent Claims (17, 18)
-
-
19. An apparatus comprising:
-
a. a video acquisition component for acquiring a video; b. a memory for storing an application, the application for; i. performing motion segmentation to segment an image of the video into different objects using motion vectors to obtain a segmentation result; ii. generating an occlusion matrix using the segmentation result, occluded pixel information and image data; and iii. estimating the background motion using the occlusion matrix; and c. a processing component coupled to the memory, the processing component configured for processing the application. - View Dependent Claims (20, 21, 22)
-
Specification