Redundancy elimination in a content-adaptive video preview system
First Claim
1. A method, implemented on a display system having at least a display device, for previewing a video file on the display device by selecting video frames to be displayed for a preview, comprising:
- calculating, at the display system, differences between histograms associated with an active video frame and other frames of the video file, the calculating including determining the neighboring frame which is a frame with a difference between a histogram of the neighboring frame and a histogram of the active video frame that is closest to but greater than a predefined redundancy threshold than all the other frames, determining the neighboring frame being based on the differences previously calculated, the calculating including increasing a frame number of the next frame to be tested by a number greater than 1 when a difference between a histogram of a current frame being tested and the histogram of the active frame is less than the predefined redundancy threshold, and decreasing the frame number of the next frame to be tested when the difference between the histogram of the current frame being tested and the histogram of the active frame is greater than the predefined redundancy threshold;
comparing, at the display system, at least one of the differences or a cumulative difference value representing a sum of the differences to the predefined redundancy threshold, the redundancy threshold being a time dependent variable;
selecting, at the display system, particular video frames for the preview only when the at least one of said differences in the histograms of the particular video frames or said cumulative difference value exceeds the redundancy threshold so as to remove the redundancy of video frame content;
adapting, at the display system, said redundancy threshold to change a speed of browsing of the preview so that fast changing content is previewed slowly with more video frames selected per unit of time in comparison to slow changing content, and slow changing content is previewed fast with fewer video frames selected per unit of time in comparison to fast changing content; and
displaying the particular video frames for the preview on the display device.
2 Assignments
0 Petitions
Accused Products
Abstract
A content-adaptive video preview system (100) allows to go faster through a video than existing video skimming techniques. Thereby, a user can interactively adapt (S1) the speed of browsing and/or the abstraction level of presentation.
According to one embodiment of the invention, this adaptation procedure (S1) is realized by the following steps: First, differences between precalculated spatial color histograms associated with chronologically subsequent pairs of video frames said video file is composed of are calculated (S1a). Then, these differences and/or a cumulative difference value representing the sum of these differences are compared (S1b) to a predefined redundancy threshold (S(t)). In case differences in the color histograms of particular video frames (302a-c) and/or said cumulative difference value exceed this redundancy threshold (S(t)), these video frames are selected (S1c) for the preview. Intermediate video frames (304a-d) are removed and/or inserted (S1d) between each pair of selected chronologically subsequent video frames depending on the selected abstraction level of presentation. Thereby, said redundancy threshold value (S(t)) can be adapted (S1b′) for changing the speed of browsing and/or the abstraction level of presentation.
41 Citations
16 Claims
-
1. A method, implemented on a display system having at least a display device, for previewing a video file on the display device by selecting video frames to be displayed for a preview, comprising:
-
calculating, at the display system, differences between histograms associated with an active video frame and other frames of the video file, the calculating including determining the neighboring frame which is a frame with a difference between a histogram of the neighboring frame and a histogram of the active video frame that is closest to but greater than a predefined redundancy threshold than all the other frames, determining the neighboring frame being based on the differences previously calculated, the calculating including increasing a frame number of the next frame to be tested by a number greater than 1 when a difference between a histogram of a current frame being tested and the histogram of the active frame is less than the predefined redundancy threshold, and decreasing the frame number of the next frame to be tested when the difference between the histogram of the current frame being tested and the histogram of the active frame is greater than the predefined redundancy threshold; comparing, at the display system, at least one of the differences or a cumulative difference value representing a sum of the differences to the predefined redundancy threshold, the redundancy threshold being a time dependent variable; selecting, at the display system, particular video frames for the preview only when the at least one of said differences in the histograms of the particular video frames or said cumulative difference value exceeds the redundancy threshold so as to remove the redundancy of video frame content; adapting, at the display system, said redundancy threshold to change a speed of browsing of the preview so that fast changing content is previewed slowly with more video frames selected per unit of time in comparison to slow changing content, and slow changing content is previewed fast with fewer video frames selected per unit of time in comparison to fast changing content; and displaying the particular video frames for the preview on the display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16)
-
-
14. A method, implemented on a display system having at least a display device, for previewing a video file by selecting video frames to be displayed for a preview, comprising:
-
calculating, at the display system, differences between histograms associated with subsequent video frames of the video file; and comparing, at the display system, at least one of the differences or a cumulative difference value representing a sum of the differences to a predefined redundancy threshold, wherein when the at least one of said differences in the histograms of particular video frames or said cumulative difference value exceeds the predefined redundancy threshold, selecting, at the display system, the particular video frames for the preview, and the predefined redundancy threshold is a time-dependent variable that is adjusted depending on histogram differences of subsequent video frames, the method further comprising, defining, at the display system, an initial distance between the selected video frame of said selecting and a new video frame to be selected for the preview, the initial distance being an integer value greater than one; when the difference between the selected video frame and the new video frame falls below the predefined redundancy threshold, multiplying, at the display system, said distance with a constant integer factor and defining a result of said multiplying as a new distance between the selected video frame and a new video frame to be selected for the preview; when the difference between the selected video frame and the new video frame does not fall below the predefined redundancy threshold, dividing, at the display system, said distance by said constant integer factor and defining a result of said dividing rounded down to a nearest integer as a new distance between the selected video frame and a new video frame to be selected for the preview; iterating, at the display system, at least one of said multiplying or dividing until a minimum for said distance is found such that said difference is a smallest difference exceeding said redundancy threshold among all differences compared with said predefined redundancy threshold for a given initial distance; when said initial distance is an integer value greater than one, decrementing, at the display system, said initial value by one; and repeating, at the display system, at least one of said multiplying, dividing, or iterating until a global minimum for said distance is found such that said difference is the smallest difference exceeding said redundancy threshold among all differences compared with said predefined redundancy threshold for all chosen initial distances.
-
Specification