Multi-resolution feature extraction for video abstraction
First Claim
Patent Images
1. A method for feature extraction comprising the steps of:
- storing into a storage area at least a raw image of a frame in a video sequence;
making a request for an image of the frame having a desired attribute;
in response to the request, if possible, returning one of the images of the frame having the desired attribute in the storage area;
otherwise, returning and adding in the storage area an image having the desired attribute, which is transformed from one of the images of the frame in the storage area; and
calculating a value of a feature of the frame using the returned image.
3 Assignments
0 Petitions
Accused Products
Abstract
A method for feature extraction. At least a raw image of a frame in a video sequence is stored in a storage area. A request is made for an image of the frame having a desired attribute. In response to the request, one of the images of the frame having the desired attribute in the storage area is returned if possible; otherwise, an image having the desired attribute, which is transformed from one of the images of the frame in the storage area, is returned and added the storage area. A value of a feature of the frame is calculated using the returned image.
22 Citations
27 Claims
-
1. A method for feature extraction comprising the steps of:
-
storing into a storage area at least a raw image of a frame in a video sequence;
making a request for an image of the frame having a desired attribute;
in response to the request, if possible, returning one of the images of the frame having the desired attribute in the storage area;
otherwise, returning and adding in the storage area an image having the desired attribute, which is transformed from one of the images of the frame in the storage area; and
calculating a value of a feature of the frame using the returned image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for video abstraction comprising the steps of:
-
a) capturing one of the frames from a video sequence;
b) applying scene detection to the captured frame;
c) extracting features of the captured frame by the steps of;
c1) storing a raw image of the captured frame in a storage area;
c2) for a selected one of the features, making a request for an image of the captured frame having a desired attribute;
c3) in response to the request, if possible, returning one of the images of the captured frame having the desired attribute in the storage area;
otherwise, returning and adding into the storage area an image having the desired attribute, which is transformed from one of the images of the captured frame in the storage area;
c4) calculating a value of the selected feature for the captured frame using the returned image; and
c5) repeating the steps c2˜
c4 until all the features are selected;
d) repeating the steps a˜
c until a transition from a current to a next scene is detected in the step b or all the frames are captured;
e) calculating a score of the current scene using the values of the features of the frames therein;
f) repeating the steps a˜
e until all the frames are captured; and
g) selecting the scenes according to the scores thereof and composing the selected scenes to yield an abstraction result. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method for video abstraction comprising the steps of:
-
a) capturing one of the frames from a video sequence;
b) applying scene detection to the captured frame;
c) extracting a first feature of the captured frame by the steps of;
c0) implementing steps c1˜
c4 only if the captured frame is determined as a representative frame according to the scene detection result, otherwise, setting the value of the first feature of the captured frame the same as that of a representative frame previously determined,c1) storing a raw image of the captured frame in a storage area;
c2) making a request for an image of the captured frame having a first desired attribute;
c3) in response to the request, if possible, returning one of the images of the captured frame having the first desired attribute in the storage area;
otherwise, returning and adding the storage area an image having the first desired attribute, which is transformed from one of the images of the captured frame in the storage area; and
c4) calculating a value of the first feature for the captured frame using the returned image;
d) extracting a second feature of the captured frame by the steps of;
d0) storing into the storage area two raw images respectively of a previous and the currently captured frame;
d1) making a request for two images respectively of the previous and currently captured frames having a second desired attribute; and
d2) in response to the request and for each of the two requested images, if possible, returning one of images of the corresponding frame having the second desired attribute in the storage area;
otherwise, returning and adding to the storage area an image having the second desired attribute, which is transformed from one of the images of the corresponding frame in the storage area; and
d3) calculating a value of the second feature for the captured frame using the two returned images;
e) repeating the steps a˜
d until a transition from a current to a next scene is detected in the step b or all the frames are captured;
f) calculating a score of the current scene using the values of the features of the frames therein;
g) repeating the steps a˜
f until all the frames are captured; and
h) selecting the scenes according to the scores thereof and composing the selected scenes to yield an abstraction result. - View Dependent Claims (23, 24, 25, 26, 27)
-
Specification