Selective reduction of video data using variable sampling rates based on importance within the image
First Claim
1. Apparatus for reducing video data, to prepare said data for efficient storage and transmission over communication media, said data consisting of a series of picture frames captured at a predetermined frequency, which frames when replayed in succession at said predetermined frequency are useful to display motion pictures, said apparatus comprising:
- a frame buffer store for storing data representing said series of frames and images contained therein;
editing apparatus for displaying said frames and images therein, and for enabling portions of said images therein to be marked with importance weighting indications;
said weighting indications denoting at least a first level of primary importance and a second level of secondary importance less than said primary importance;
apparatus for storing data representing said marked image portions in association with importance weights represented by respective markings;
processing apparatus, coupled to said frame buffer and said data storing apparatus, for variably sampling said marked image portions to produce a series of modified frames corresponding to the frames stored in said frame buffer;
said processing apparatus sampling said image portions marked as having primary importance at a first frequency and said image portions marked as having secondary importance at a second frequency lower than said first frequency, whereby said image portions having primary importance effectively appear in all of said modified frames and said portions having secondary importance effectively appear in some but not all of said modified frames.
1 Assignment
0 Petitions
Accused Products
Abstract
In a reduction process, data in portion buffers are selectively sampled at different sampling rates proportional to their assigned weights. For instance, portions assigned highest weights could be sampled at a reference rate corresponding to the repetition frequency of the originally received frames, portions assigned lowest weights could be sampled at {fraction (1/10)}th the reference rate, and portions assigned weights intermediate the lowest and highest ones could be sampled at rates less than the reference rate but more than {fraction (1/10)}th the reference rate. Accordingly, sampled portions assigned less than highest weights, but containing data representing objects in motion, could be subject to reproduction with less clarity than sampled portions assigned highest weight. In one application, video data depicting a public figure addressing an audience is processed to assign highest weights to the speaker'"'"'s facial features, arms and other relevant body parts, and lesser weights to other picture elements including members of the audience. In another example, video data captured by a surveillance camera is processed to assign highest weights to picture elements capable of representing unauthorized intrusion into a scanned area, and lesser weights to data representing objects that are either static or in the equivalent of a static condition. In another example, video data representing a commercial to be televised is processed to assign highest weights to an advertised object or product worn or carried by a person in motion (e.g. sneakers worn by a moving athlete) and lesser weights to picture parts not directly relevant to the advertised object.
90 Citations
11 Claims
-
1. Apparatus for reducing video data, to prepare said data for efficient storage and transmission over communication media, said data consisting of a series of picture frames captured at a predetermined frequency, which frames when replayed in succession at said predetermined frequency are useful to display motion pictures, said apparatus comprising:
-
a frame buffer store for storing data representing said series of frames and images contained therein;
editing apparatus for displaying said frames and images therein, and for enabling portions of said images therein to be marked with importance weighting indications;
said weighting indications denoting at least a first level of primary importance and a second level of secondary importance less than said primary importance;
apparatus for storing data representing said marked image portions in association with importance weights represented by respective markings;
processing apparatus, coupled to said frame buffer and said data storing apparatus, for variably sampling said marked image portions to produce a series of modified frames corresponding to the frames stored in said frame buffer;
said processing apparatus sampling said image portions marked as having primary importance at a first frequency and said image portions marked as having secondary importance at a second frequency lower than said first frequency, whereby said image portions having primary importance effectively appear in all of said modified frames and said portions having secondary importance effectively appear in some but not all of said modified frames.- View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
Specification