Supporting region-of-interest cropping through constrained compression

• US 20100232504A1
• Filed: 03/11/2010
• Published: 09/16/2010
• Est. Priority Date: 03/13/2009
• Status: Abandoned Application

• Current Assignee: Oregon State University (Oregon University System)
• Original Assignee: Oregon State University (Oregon University System), Portland State University (Oregon University System)
• Inventors: Feng, Wu-chi
• Application Number:
  US12/661,262
• Publication Number:
  US 20100232504A1
• Time in Patent Office: Days
• US Class Current: 375/240.130
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/55 Motion estimation with spatial constraints, e.g. at image or region borders
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Region-of-interest cropping of high-resolution video is supported video compression and extraction methods. The compression method divides each frame into virtual tiles, each containing a rectangular array of macroblocks. Intra-frame compression uses constrained motion estimation to ensure that no macroblock references data beyond the edge of a tile. Extra slice headers are included on the left side of every macroblock row in the tiles to permit access to macroblocks on the left edge of each tile during extraction. The compression method may also include breaking skipped macroblock runs into multiple smaller skipped macroblock runs. The extraction method removes slices from virtual tiles that intersect the region-of-interest to produce cropped frames. The cropped digital video stream and the compressed digital video stream have the same video sequence header information.

Claims

1. A computer-implemented method for compressing a digital video stream to support region-of-interest cropping, the method comprising:

dividing each frame of the digital video stream into macroblocks, wherein each of the macroblocks contains a set of 16×

16 pixels;

dividing each frame into virtual tiles, wherein each of the virtual tiles contains a set of multiple macroblocks;

performing intra-frame compression of the digital video stream using constrained motion estimation to ensure that no macroblock in the tile references data beyond the edge of the tile;

performing inter-frame compression of the digital video stream by separately compressing each of the macroblocks in each frame using a discrete cosine transform;

and

generating a compressed video stream from results of the inter-frame compression and intra-frame compression.

2. The method of claim 1 wherein each of the virtual tiles contains a set of N×

M macroblocks, where 4≦

N≦

100 and 4≦

M≦

100.

3. The method of claim 2 wherein N is at least 30 and M is at least 30.

4. The method of claim 1 wherein the tiles are rectangles with an aspect ratio no larger than 2.

5. The method of claim 1 wherein each frame is divided into a set of 4×

4 virtual tiles.

6. The method of claim 1 wherein the compressed video stream includes extra slice headers on the left side of every macroblock row in each of the virtual tiles to permit access to macroblocks on the left edge of each tile.

7. The method of claim 1 further comprising breaking skipped macroblock runs into multiple smaller skipped macroblock runs.

8. A computer-implemented method for extracting a region-of-interest from a compressed digital video stream, the method comprising:

dividing each frame of the compressed digital video stream into macroblocks, wherein each of the macroblocks represents compressed 16×

16 pixels;

dividing each frame of the compressed digital video stream into virtual tiles, wherein each of the virtual tiles contains a set of multiple macroblocks;

removing slices from virtual tiles that do not intersect the region-of-interest to produce cropped frames;

generating a cropped digital video stream from the cropped frames, wherein the cropped digital video stream and the compressed digital video stream have the same video sequence header information.

9. The method of claim 8 wherein each of the virtual tiles contains a set of N×

M macroblocks, where 4≦

N≦

100 and 4≦

M≦

100.

10. The method of claim 9 wherein N is at least 30 and M is at least 30.

11. The method of claim 8 wherein the tiles are rectangles with an aspect ratio no larger than 2.

12. The method of claim 8 wherein each frame is divided into a set of 4×

4 virtual tiles.