Method and apparatus for determining motion in images
First Claim
Patent Images
1. A method of determining motion in a set of input images, said method comprising:
- providing a processing device to implement the following step;
receiving said set of input images, said set of input images having background motion and foreground motion;
determine a first motion direction for a first group of pixels within a reference image within said set of input images;
determine a second motion direction for a second group of pixel within said reference image;
designating the dominant group of pixels within said reference image as background pixels;
designating said background pixels as stationary content;
registering the remaining images in said set of input images to said reference image to identify background stationary content therein;
generating difference images based on the registered images;
segmenting the input images into regions;
estimating local motion within each of said regions; and
determining whether the regions include moving content or static content based on the difference images and the local estimated motion within said regions;
wherein said local motion estimating comprises generating a motion vector for each region in each of said images with the exception of the last image in said set;
wherein said region content determining for each region comprises;
determining whether the motion vector for the region signifies movement above a threshold and if so labeling the region as representing foreground moving content;
if not, determining whether the percentage of pixels in the region have a pixel value above a threshold in the corresponding difference image and if so labeling the region as representing foreground moving content; and
if not labeling the region as representing background stationary content; and
for a given region in a grayscale input image designated as background stationary content, checking the labeling of its three corresponding regions in three previous grayscale input images, and if more than seventy percent of the pixels within the three corresponding regions are designated as representing foreground movement content, then changing the designation of the given region from background stationary content to foreground movement content.
2 Assignments
0 Petitions
Accused Products
Abstract
A method of determining motion in a set of input images comprises registering the images in the set to identify stationary background content therein and generating difference images based on the registered images. The input images are segmented into regions and local motion within each of the regions is estimated. A determination as to whether the regions include moving content or static content is determined based on the difference images and the estimated local motion within the regions.
-
Citations
14 Claims
-
1. A method of determining motion in a set of input images, said method comprising:
-
providing a processing device to implement the following step; receiving said set of input images, said set of input images having background motion and foreground motion; determine a first motion direction for a first group of pixels within a reference image within said set of input images; determine a second motion direction for a second group of pixel within said reference image; designating the dominant group of pixels within said reference image as background pixels; designating said background pixels as stationary content; registering the remaining images in said set of input images to said reference image to identify background stationary content therein; generating difference images based on the registered images; segmenting the input images into regions; estimating local motion within each of said regions; and determining whether the regions include moving content or static content based on the difference images and the local estimated motion within said regions; wherein said local motion estimating comprises generating a motion vector for each region in each of said images with the exception of the last image in said set; wherein said region content determining for each region comprises; determining whether the motion vector for the region signifies movement above a threshold and if so labeling the region as representing foreground moving content; if not, determining whether the percentage of pixels in the region have a pixel value above a threshold in the corresponding difference image and if so labeling the region as representing foreground moving content; and if not labeling the region as representing background stationary content; and for a given region in a grayscale input image designated as background stationary content, checking the labeling of its three corresponding regions in three previous grayscale input images, and if more than seventy percent of the pixels within the three corresponding regions are designated as representing foreground movement content, then changing the designation of the given region from background stationary content to foreground movement content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13)
-
-
12. A method of determining motion in a set of input images, said method comprising:
-
providing a processing device to implement the following step; receiving said set of input images, said set of input images having background motion and foreground motion; determine a first motion direction for a first group of pixels within a reference image within said set of input images; determine a second motion direction for a second group of pixel within said reference image; designating the dominant group of pixels within said reference image as background pixels; designating said background pixels as stationary content; registering the remaining images in said set of input images to said reference image to identify background stationary content therein; generating difference images based on the registered images; segmenting the input images into regions; estimating local motion within each of said regions; and determining whether the regions include moving content or static content based on the difference images and the local estimated motion within said regions; wherein said local motion estimating comprises generating a motion vector for each region in each of said images with the exception of the last image in said set; wherein said region content determining for each region comprises; determining whether the motion vector for the region signifies movement above a threshold and if so labeling the region as representing foreground moving content; if not, determining whether the percentage of pixels in the region have a pixel value above a threshold in the corresponding difference image and if so labeling the region as representing foreground moving content; and if not labeling the region as representing background stationary content; and for a given region within a given grayscale input image designated as foreground movement content, determining if its neighboring regions within the given grayscale input image are designated as representing background stationary content, and if so, then if the total size of neighboring regions designated as representing background stationary content is larger than the size of the given region and the given region is further smaller than a predefined size, then changing the designation of the given region from foreground movement content to background stationary content. - View Dependent Claims (14)
-
Specification