Apparatus and method employing pre-ATR-based real-time compression and video frame segmentation
First Claim
1. A method of intraframe real time, video image processing for reducing transmission bandwidth or computing time;
- the method comprising the following steps;
a) selecting principal and secondary image frame signatures;
b) selecting and extracting contours of regions of interest;
c) applying multifacet inhomogeneous compression for the regions of interest of step b) and for the remaining portions of the video frame; and
d) performing steps a), b) and c) all within the duration of the frame.
3 Assignments
0 Petitions
Accused Products
Abstract
One subject of this invention is the development of a novel region of interest (ROI) method, or Frame Segmentation Method that can be provided within a video stream, in real-time, or more precisely within a few milliseconds of video frame duration of 30 msec, or even in the sub-millisecond range. This video frame segmentation is the basis of Pre-ATR-based Ultra-Real-Time (PATURT) video compression. Still other subjects of this invention are morphing compression, and watermarking, also based on the PATURT. The applications of the PATURT innovation include ROI-based real-time video recording that has special applications for aircraft pilot/cockpit video recording in “black-box” devices, recording aircraft accidents, or catastrophes. Such black-box devices usually need to pass high impact (3400 g), high temperature (1100° C., in 1 h), and other harsh environmental tests. In this invention, they also have the capability of reporting the last cockpit events up to 0.5 seconds before an accident, including all cockpit sensor readings, as well as pilots'"'"' behavior, the latter with fully scrambled and non-recoverable facial information. Further applications include video surveillance. The latter can be also applied to missile defense (recognizing real target or real missile, from false targets (decoys)), or to other Ultra-Real-Time (URT) civilian and military scenarios.
-
Citations
40 Claims
-
1. A method of intraframe real time, video image processing for reducing transmission bandwidth or computing time;
- the method comprising the following steps;
a) selecting principal and secondary image frame signatures; b) selecting and extracting contours of regions of interest; c) applying multifacet inhomogeneous compression for the regions of interest of step b) and for the remaining portions of the video frame; and d) performing steps a), b) and c) all within the duration of the frame. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
- the method comprising the following steps;
-
14. A method of nearly real time, video image processing for reducing transmission bandwidth or computing time;
- the method comprising the following steps;
a) selecting principal and secondary image frame signatures; b) selecting and extracting contours of regions of interest; and c) applying predictive morphing compression to the regions of interest of step b).
- the method comprising the following steps;
-
15. A method of nearly real time, video image processing for reducing transmission bandwidth or computing time;
- the method comprising the following steps;
a) selecting principal and secondary image frame signatures; b) selecting and extracting contours of regions of interest; and c) applying nearly real time target acquisition expansion.
- the method comprising the following steps;
-
16. A method of watermarking a video image frame;
- the method comprising the steps of;
a) selecting principal and secondary image frame signatures; b) selecting and extracting contours of regions of interest; c) selecting video data bits of least significance in a portion of the frame not in any region of interest; and d) altering the bits selected in step c) to provide some hidden information distinct from said image frame.
- the method comprising the steps of;
-
17. An ATR method of representing an original full-resolution video image as a phase-space Gaussian Mixture to provide a reduced pixel count version of the image;
- the method comprising the steps of;
a) generating a multi-resolution pyramid of the original image using a wavelet transform; and b) modeling wavelet coefficients of said wavelet transform as a Gaussian Scale Mixture where wavelet coefficient magnitudes are arranged in phase-scale Gaussian vector form.
- the method comprising the steps of;
-
18. A flight recorder for recording at least one of video, audio and sensor data information generated in an aircraft up to 0.5 seconds before a catastrophic crash during a flight;
- the recorder comprising;
at least one solid state memory device for storing said information, said device being enclosed in a container, said container having a material surrounding said device for cushioning said device against an impact force generated during said crash of said aircraft. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25)
- the recorder comprising;
- 26. A solid state crash survivable recorder comprising a memory device configured for recording at least two hours of up to two channels of video information, up to four channels of audio information, up to eight channels of discrete sensor data and up to sixteen channels of analog sensor data generated up to 0.5 seconds prior to a crash.
-
32. A crash survivable memory comprising:
-
a solid state memory device; a crash-resistant capsule for enclosing said memory device; and a shock absorbing material within the capsule and surrounding said memory device. - View Dependent Claims (33, 34)
-
-
35. A crash survivable video recorder for aircraft cockpit event recording up to no more than 0.5 seconds prior to some catastrophic event;
- the recorder comprising;
at least one video camera; and image processing electronics for analyzing each frame of video data generated in said camera and determining various regions of interest in said frame for selectively compressing the data in each said region of interest by a compression ratio dependent upon the information content in said each region of interest. - View Dependent Claims (36)
- the recorder comprising;
-
37. A method of intraframe real time, video image processing for reducing bandwidth and computation time;
- the method comprising the following steps;
a) selecting image frame signatures; b) filtering and decimation; c) pixel-wise subtraction; and d) edge smoothing; wherein steps a), b), c) and d) are all performed within the duration of a single frame of video. - View Dependent Claims (38, 39, 40)
- the method comprising the following steps;
Specification