REGION OF INTEREST (ROI) VIDEO ENCODING

• US 20110235706A1
• Filed: 03/22/2011
• Published: 09/29/2011
• Est. Priority Date: 03/25/2010
• Status: Abandoned Application

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Demircin, Mehmet Umut, Nagori, Soyeb, Srinivasamurthy, Naveen, Koul, Manoj, Kwon, Do-Kyoung
• Application Number:
  US13/053,419
• Publication Number:
  US 20110235706A1
• Time in Patent Office: Days
• US Class Current: 375/240.03
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object

Abstract

A method of encoding an image frame in a video encoding system. The image frame has a region of interest (ROI) and a non region of interest (non-ROI). In the method, quantization scale for the image frame based on rate control information is determined. ROI statistics based on residual energy of the ROI and non-ROI is then calculated. Quantization scale for the image frame based on ROI priorities and ROI statistics is calculated. Further, quantization scales for ROI and non-ROI based on ROI priorities are determined.

Claims

1. A method for encoding an image frame in a video encoder, the method comprising:

determining quantization scale for the image frame based on rate control information, the image frame having a region of interest (ROI) and a non region of interest (non-ROI);

calculating ROI statistics based on residual energy of the ROI and non-ROI;

modulating quantization scale for the image frame based on ROI priorities and ROI statistics; and

determining quantization scales for ROI and non-ROI based on ROI priorities.

2. The method of claim 1, wherein prior to determining quantization scale for the image frame, comprising:

receiving an input video stream comprising the image frame;

receiving ROI coordinates; and

receiving ROI priorities.

3. The method of claim 1, wherein modulating quantization scale for the image frame comprises modulating based on available bit rate for the video encoder and distortion requirements for ROI and non-ROI.

4. The method of claim 1, wherein determining quantization scales for ROI and non-ROI further comprises calculating a relationship between quantization scales of ROI and non-ROI using bit rate approximation.

5. The method of claim 1, wherein calculating ROI statistics based on residual energy of the ROI and non-ROI further comprises:

calculating the residual energy using one of a sum of absolute difference, sum of square error, spatial activity and cost measurement metrics.

6. The method of claim 1 further comprising:

encoding the image frame; and

generating compressed bit streams of the image frame.

7. The method of claim 1, determining quantization scales for ROI and non-ROI based on ROI priorities and ROI statistics further comprises:

defining a guard band around the area of the ROI in the non ROI; and

determining quantization scale for the guard band, wherein size of the guard band is proportional to the size of the ROI.

8. A method for encoding an image frame having a region of interest (ROI) in a video encoder, the method comprising:

determining average motion within the ROI for a current image frame;

determining an ROI for a next image frame by moving the ROI in the current image frame in the direction of motion by a value corresponding to the average motion; and

using the ROI for the next image frame in a subsequent image frame in response to a temporal discontinuity between the next image frame and the subsequent image frame.

9. The method of claim 8 further comprising, prior to determining average motion within the ROI for a current frame, detecting the temporal discontinuity in the subsequent image frame.

10. The method of claim 8, wherein determining average motion within the ROI for a current image frame comprises determining average motion within a plurality of ROIs in the current image frame.

11. The method of claim 10, wherein determining average motion within a plurality of ROIs further comprises determining average motion within each of the plurality of ROIs independently.

12. The method of claim 11, wherein determining average motion comprises determining velocity and direction within the ROI.

13. A video encoding system comprising:

a set of prediction engines that calculate region of interest (ROI) statistics based on residual energy of a ROI and a non region of interest non-ROI in an image frame; and

a rate controller that receives encoded bits of an image frame, average quantization scale of the image frame, ROI priorities and the ROI statistics and that generates quantization scale for the image frame by modulating quantization scale for the image frame.

14. The video encoding system of claim 13, wherein the set of prediction engines comprise an inter-frame prediction engine and an intra-frame prediction engine.

15. The video encoding system of claim 13 further comprising a quantizer that receives the quantization scale to be used for quantization from rate controller.