Apparatus for image capture with automatic and manual field of interest processing with a multi-resolution camera

• US 20080129844A1
• Filed: 10/26/2007
• Published: 06/05/2008
• Est. Priority Date: 10/27/2006
• Status: Abandoned Application

• Current Assignee: Agilence Incorporated
• Original Assignee: Agilence Incorporated
• Inventors: Cusack, Francis J., Cook, Jonathan
• Application Number:
  US11/977,887
• Publication Number:
  US 20080129844A1
• Time in Patent Office: Days
• US Class Current: 348/241
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

An apparatus for capturing a video image comprising a means for generating a digital video image, a means for classifying the digital video image into one or more regions of interest and a background image, and a means for encoding the digital video image, wherein the encoding is selected to provide at least one of; enhancement of the image clarity of the one or more ROI relative to the background image encoding, and decreasing the video quality of the background image relative to the one or more ROI. A feedback loop is formed by the means for classifying the digital video image using a previous video image to generate a new ROI and thus allow for tracking of targets as they move through the imager field-of-view.

Claims

1. An apparatus for capturing a video image comprising:

a. means for generating a digital video image;

b. means for classifying the digital video image into one or more regions of interest (ROI) and a background image; and

c. means for encoding the digital video image, wherein the encoding is selected to provide at least one of, enhancement of the image clarity of the one or more ROI relative to the background image encoding, and decreasing the clarity of the background image relative to the one or more ROI.

2. The apparatus of claim 1, further comprising a feedback loop formed by the means for classifying the digital video image using at least one of a preceding digital video image and a preceding ROI position prediction, to determine the one or more ROI, wherein the preceding digital video image is delayed by one or more video frames.

3. The apparatus of claim 2, further comprising an associated ROI priority, wherein the means for classifying the digital video image determines the associated ROI priority of the one or more ROI, and wherein one or more levels of encoding are set for each ROI according to the associated ROI priority.

4. The apparatus of claim 3, wherein the means for encoding the digital video image produces a fixed encoding bit rate comprising a background image bit rate and one or more ROI bit rates, and wherein the background bit rate is reduced in proportion to the increase in the one or more ROI bit-rates, thereby maintaining the fixed encoding bit rate while an enhanced encoded one or more ROI is generated.

5. The apparatus of claim 3, wherein the means for encoding the digital video image produces a fixed encoding bit rate comprised of a background image bit rate and one or more ROI bit rates, and wherein the means for classifying a video image processes images from a plurality of means for generating a digital video image, and wherein the means for classifying the digital video image controls the ROI bit-rates and background image bit rates from each means for generating the digital video image, wherein the background image bit rates are reduced in proportion to the increase in the ROI bit-rates, thereby maintaining the fixed encoding bit rate for all the ROIs and background images.

6. The apparatus of claim 3, wherein the means for encoding the digital video image produces an average encoding bit rate comprised of an average background image bit rate, and one or more average ROI bit rates, and wherein the average background bit rate is reduced in proportion to the increase in the one or more average ROI bit-rates to maintain the average encoding bit rate.

7. The apparatus of claim 3, wherein the encoding is H.264.

8. The apparatus of claim 3, wherein the means for classifying a digital video image generates metadata and alarms regarding the one or more ROI.

9. The apparatus of claim 8, further comprising a storage device configured to store at least one of the metadata, the alarms, the one or more encoded ROI, and the encoded background image.

10. The apparatus of claim 8, further comprising a network module, wherein the networking module is configured to transmit to a network at least one of, the metadata, the one or more alerts, the one or more encoded ROI, and the encoded background image data.

11. An apparatus for capturing a video image comprising:

a. means for generating a digital video image;

b. means for classifying the digital video image into one or more regions of interest (ROI) and a background image;

c. means for generating one or more ROI streams and a background image stream; and

d. means for controlling at least one of, one or more ROI stream resolutions, one or more ROI positions, one or more ROI geometries, one or more ROI stream frame rates, and a background image stream frame rate based on the classification of the one or more ROI, thereby controlling the image quality of the one or more ROI streams and implementing Pan Tilt and Zoom imaging capabilities.

12. The apparatus in claim 11, further comprising:

means for encoding the one or more ROI streams and encoding the background image stream, the means for encoding having an associated encoding compression rate, wherein the associated encoding compression rate for each of the one or more ROI streams is less than the encoding compression rate for the background image stream, thereby producing an encoded one or more ROI with an improved image quality.

13. The apparatus of claim 12, further comprising a feedback loop formed by the means for classifying the digital video image using at least one of a preceding digital video image and a preceding ROI position prediction, to determine the one or more ROI, wherein the preceding digital video image is delayed by one or more video frames.

14. The apparatus of claim 13, further comprising an associated ROI priority, wherein the means for classifying the digital video image determines the associated ROI priority of the one or more ROI streams, and wherein one or more levels of encoding compression for the one or more ROI streams are set according to the associated ROI priority.

15. The apparatus of claim 13, wherein the means for encoding produces a fixed encoding bit rate comprised of one or more ROI stream bit rates and a background image bit rate, wherein the one or more ROI bit rates are increased according to the associated ROI priority and the background bit rate is reduced in proportion, thereby maintaining the fixed encoding bit rate while the enhanced encoded one or more ROI are generated.

16. The apparatus of claim 14, wherein the means for encoding produces an average encoding bit rate comprised of one or more ROI stream average bit-rates and a background image average bit rate, wherein the one or more ROI average bit rates are increased according to the associated ROI priority and the background average bit rate is reduced in proportion, thereby maintaining the average encoding bit rate while the enhanced encoded one or more ROI are generated.

17. The apparatus of claim 14 further comprising a means for human interaction, wherein the means for human interaction implements at least one of the Pan Tilt and Zoom functions through coupling with the means for controlling at least one of, the one or more ROI resolution, the one or more ROI positions, and one or more ROI geometries.

18. The apparatus of claim 14, further comprising a display device that decodes and displays the one or more ROI streams and background image stream, wherein the one or more ROI streams are merged with the background image stream and displayed on the monitor, wherein the display device is configured with a means to select the ROI that an operator has classified as an ROI.

19. The apparatus of claim 14, further comprising a first and a second display device, wherein at least one of the one or more ROI are displayed on the first display device and the background image is displayed on the second display device.

20. An apparatus for capturing and displaying a video image comprising:

a. means for generating a digital video image;

b. means for classifying the digital video image into one or more regions of interest (ROI) and a background image;

c. means for encoding the digital video image, wherein the encoding produces one or more encoded ROI and an encoded background image; and

d. means for controlling a display image quality of one or more ROI by controlling at least one of, the encoding of the one or more encoded ROI, the encoding of the encoded background image, an image resolution of the one or more ROI, an image resolution of the background image, a frame rate of one or more ROI, and a frame rate of the background image.

21. The apparatus of claim 20, further comprising a feedback loop formed by the means for classifying the digital video image using at least one of a preceding digital video image and a preceding ROI position prediction, to determine the one or more ROI, wherein the preceding digital video image is delayed by one or more video frames.

22. The apparatus of claim 20, wherein the means for classifying the digital video image determines control parameters for the means of controlling the display image quality.

23. An apparatus for capturing a video image comprising:

a. means for generating a digital video image having one or more configurable image acquisition parameters;

b. means for classifying the digital video image into one or more regions of interest (ROI) and a background image, wherein the one or more regions of interest have an associated one or more ROI image characteristics; and

c. means for controlling at least one of the image acquisition parameters based on at least one of the associated one or more ROI image characteristics, thereby improving the image quality of at least one of the one or more ROI.

24. The apparatus of claim 23, wherein the image acquisition parameters comprises at least one of brightness, contrast, shutter speed, automatic gain control, integration time, white balance, anti-bloom, and chromatic bias.

25. The apparatus of claim 24, wherein each of the one or more ROI have an associated dynamic range, and wherein the means for controlling the one or more image acquisition parameters maximizes the dynamic range of at least one of the one or more ROI.