Visual saliency estimation for images and video
First Claim
1. A method for deriving a saliency measure for an image of a video frame, comprising:
- decomposing, by a processor, the image into elements, wherein elements cluster the image and each element consists of spatially connected pixels;
calculating, by the processor, a first image measure indicative of each element'"'"'s uniqueness in the image on a per element basis anda second image measure indicative of each element'"'"'s spatial distribution in the image on a per element basis, wherein calculating the first and second image measures comprises;
identifying, by the processor, based on a saliency measure of an adjacent video frame image, a background portion of the adjacent video frame image,computing, by the processor, based on the identified background portion, a global transformation that aligns the video frame image with the adjacent video frame image, andcomputing, by the processor, the first and second image measures based on the global transformation; and
providing, by the processor, a per element saliency measure by combining the first image measure and the second image measure.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatus for deriving a saliency measure for images and video are described. In an embodiment, a process includes decomposing, by a processor, an image into elements, wherein elements cluster the image and each element consists of spatially connected pixels. The processor then calculates a first image measure indicative of each element'"'"'s uniqueness in the image on a per element basis, and calculates a second image measure indicative of each element'"'"'s spatial distribution in the image on a per element basis. The processor then provides a per element saliency measure by combining the first image measure and the second image measure.
-
Citations
21 Claims
-
1. A method for deriving a saliency measure for an image of a video frame, comprising:
-
decomposing, by a processor, the image into elements, wherein elements cluster the image and each element consists of spatially connected pixels; calculating, by the processor, a first image measure indicative of each element'"'"'s uniqueness in the image on a per element basis and a second image measure indicative of each element'"'"'s spatial distribution in the image on a per element basis, wherein calculating the first and second image measures comprises; identifying, by the processor, based on a saliency measure of an adjacent video frame image, a background portion of the adjacent video frame image, computing, by the processor, based on the identified background portion, a global transformation that aligns the video frame image with the adjacent video frame image, and computing, by the processor, the first and second image measures based on the global transformation; and providing, by the processor, a per element saliency measure by combining the first image measure and the second image measure. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A non-transitory computer-readable medium storing instructions for deriving a saliency measure for an image of a video frame configured to cause a processor to:
-
decompose the image into elements, wherein elements cluster the image and each element consists of spatially connected pixels; calculate a first image measure indicative of each element'"'"'s uniqueness in the image on a per element basis and a second image measure indicative of each element'"'"'s spatial distribution in the image on a per element basis, wherein calculating the first and second image measures comprises; identifying, based on a saliency measure of an adjacent video frame image, a background portion of the adjacent video frame image, computing, based on the identified background portion, a global transformation that aligns the video frame image with the adjacent video frame image, and computing the first and second image measures based on the global transformation; and provide a per element saliency measure by combining the first image measure and the second image measure. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. An apparatus for deriving a saliency measure for an image of a video frame, comprising:
-
a processor; a communication device operably connected to the processor; and a storage device operably connected to the processor, the storage device storing non-transitory instructions configured to cause the processor to; decompose the image into elements, wherein elements cluster the image and each element consists of spatially connected pixels; calculate a first image measure indicative of each element'"'"'s uniqueness in the image on a per element basis and a second image measure indicative of each element'"'"'s spatial distribution in the image on a per element basis, wherein calculating the first and second image measures comprises; identifying, based on a saliency measure of an adjacent video frame image, a background portion of the adjacent video frame image, computing, based on the identified background portion, a global transformation that aligns the video frame image with the adjacent video frame image, and computing the first and second image measures based on the global transformation; and provide a per element saliency measure by combining the first image measure and the second image measure. - View Dependent Claims (20, 21)
-
Specification