Content-driven surveillance image storage optimization apparatus and method of operation

• US 10,412,420 B2
• Filed: 10/29/2016
• Issued: 09/10/2019
• Est. Priority Date: 03/07/2014
• Status: Active Grant

• Current Assignee: Eagle Eye Networks, Inc.
• Original Assignee: Eagle Eye Networks, Inc.
• Inventors: Drako, Dean, Roskowski, Steven
• Primary Examiner(s): Motsinger, Sean T
• Application Number:
  US15/338,327
• Publication Number:
  US 20170048556A1
• Time in Patent Office: 1,046 Days
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• CPC Class Codes: H04N 5/915 for field- or frame-skip recording or reproducing
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A content-driven video storage optimization apparatus applies motion analysis at purge time or when the images are initially archived. Retention meta data is determined for image segments with and segments without motion. When triggered by a directive, segments that do not contain motion are purged. A lossy compression method optimizes storage for a security surveillance network. An appliance transforms image files into a key frame and at least one subsequent frame compatible with JPEG. A circuit filters for motion and stores metadata for each train of a key frame and its subsequent frames. The transformation operates on coefficients of frequency bins. Meta data enables content based purging of least consequential files.

Claims

1. A content-driven surveillance storage optimization apparatus comprising:

a purging circuit;

a surveillance image transformation circuit;

a surveillance image store communicatively coupled to the purging circuit and to the surveillance image transformation circuit;

a retention meta data store communicatively coupled to the purging circuit and to the surveillance image transformation circuit; and

a triggers, inhibitors, policies controller communicatively coupled to the purging circuit, whereby transformed content of the surveillance images provides retention meta data to be used by the purging circuit when activated by the controller to select images for deletion

wherein the surveillance image transformation circuit comprises;

an image frame receiver which receives JPEG compatible files from a plurality of network attached security surveillance cameras;

the image frame receiver is coupled to

a subsequent frame store;

the subsequent frame store coupled to

a Huffman decoder;

a plurality of coefficient stores coupled to the Huffman decoder;

coupled to

a coefficient differencer circuit which subtracts the coefficients of the subsequent frame from the coefficients of the key frame;

the coefficient differencer is coupled to

a DC level trigger which determines a condition that at least one block of the image have substantially changed and upon such determination records a metric into said retention meta data store.

3. The apparatus of claim 1 wherein said surveillance image transformation circuit further comprises a circuit to set a movement flag into a file header when a DC level trigger determines that at least one block of the image have substantially changed.

2. A content-driven surveillance storage optimization apparatus comprising:

a purging circuit;

a surveillance image transformation circuit;

a surveillance image store communicatively coupled to the purging circuit and to the surveillance image transformation circuit;

a retention meta data store communicatively coupled to the purging circuit and to the surveillance image transformation circuit; and

a triggers, inhibitors, policies controller communicatively coupled to the purging circuit, whereby transformed content of the surveillance images provides retention meta data to be used by the purging circuit when activated by the controller to select images for deletion,

wherein the purging circuit comprises;

a circuit to read retention meta data;

a circuit to read purging directives;

a circuit to set a retention flag by applying the directives to retention meta data; and

a circuit to issue file operation commands according to the result of matching retention meta data with thresholds, triggers, and policies of the purging directives.

4. A method for surveillance image storage optimization comprising:

receiving one or more purging control directives;

retrieving a retention meta data array for each of a plurality of image segment identifiers;

masking each retrieved retention meta data array by each received purging control directive to set a retention flag for each image segment identifier;

purging from surveillance image store, the image segments corresponding to image segment identifiers not set for retention;

receiving surveillance image frames from capture devices;

transforming captured surveillance image frames into image segments and retention meta data arrays;

storing transformed image segments into surveillance image store;

transforming image frames into a series of JPEG frames;

referencing each series of JPEG frames to an image segment;

receiving a key JPEG frame (Kframe) and a subsequent frame (Jframe);

reversing Huffman encoding of coefficients of pixel blocks;

differencing the low frequency coefficients between corresponding pixel blocks in Kframes and Jframes;

determining a metric of relative movement by normalizing the difference of low frequency coefficients; and

,

storing into retention meta data store an image segment identifier and an associated metric of relative movement.

5. The method of claim 4, further comprising:

storing a movement flag into file headers of stream segments and Kframes when a metric of relative movement exceeds a threshold.

6. A method for surveillance image storage optimization comprising:

receiving at least one purging control directive;

retrieving a retention meta data array for each of a plurality of image segment identifiers;

masking each retrieved retention meta data array by each received purging control directive to set a retention flag for each image segment identifier; and

purging from surveillance image store, the image segments corresponding to image segment identifiers not set for retention,

wherein said purging control directive is inoperative on a file having a movement flag in its header.