High definition surveillance image storage optimization and retention triggering apparatus

• US 20200236328A1
• Filed: 04/05/2019
• Published: 07/23/2020
• Est. Priority Date: 09/07/2014
• Status: Active Grant

• Current Assignee: Eagle Eye Networks, Inc.
• Original Assignee: Eagle Eye Networks, Inc.
• Inventors: Drako, Dean, Roskowski, Steven
• Granted Patent: US 10,798,342 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 11/24 High-definition television systems
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• CPC Class Codes: H04N 2007/243 Bitstream control arrangements
• CPC Class Codes: H04N 21/23113 involving housekeeping operations for stored content, e.g. prioritizing content for deletion because of storage space restrictions storage management, e.g. defragmentation G06F3/0604; snloading stored programs G06F9/445; housekeeping operations in file systems, e.g. deletion policies G06F16/10; buffering arrangements in a network node or in an end terminal in packet networks H04L49/90
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4335 Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions storage management, e.g. defragmentation G06F3/0604; unloading stored programs G06F9/445; storage management in file systems G06F16/10; buffering arrangements in a network node or in an end terminal in packet networks H04L49/90
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/015 High-definition television systems
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/24 Systems for the transmission of television signals using pulse code modulation H04N21/00 takes precedence

Abstract

A high definition surveillance video storage optimization system executes purging directives according to policy and retention meta data. Segments of video are purged from storage when thresholds of retention metrics are applied and when policy permits. Retention metrics are determined from acoustic sound energy, radiation energy, access control events, and movement. Policies reflect calendars and elapsed time, percentage of available storage, statutory and judicial mandates, and utility of the stored segments. Extrinsic sensor data and operations are recorded into non-transitory retention meta data stores. Metrics are transformed into retention flags at either time of recordation or time of purgation. Security file storage includes metadata about the environment acquired by sensors include doors, audio noise, object identification and tracking and inputs which influence retention or purging. A circuit filters for motion and stores metadata per segment. Meta data enables content based purging of least consequential files.

Claims

1-3. -3. (canceled)

4. An apparatus for image storage optimization and retention comprising:

a purging module;

communicatively coupled to,

a network interface to extrinsic sensors;

communicatively coupled to,

an extrinsic retention meta-data store;

coupled to the purging module and further coupled to

a camera network interface to a plurality of high definition video cameras;

said modules interfaces and store interconnected by communication circuits and switches;

a circuit to receive H.264 streams from high definition video cameras;

a circuit to segment H.264 streams into files and embed retention meta-data in each header of a file;

a processor core configured to determine that an extrinsic sensor measurement or event is of substantial significance to a surveillance system; and

a circuit to set a retention flag in an extrinsic retention meta-data store,

wherein said purging module comprises;

a retention policy store

a statutory and judicial requirements store;

a metric threshold store;

a camera and location ownership store;

an interface to disk file management; and

a circuit to store retention metadata; and

a calendar module comprising a calendar processor configured to match video file segment timestamps with date-time of purging directives and when true, trigger purging of segments unprotected by retention meta-data.

6. The apparatus of claim 4 further comprises:

a circuit to receive a purging directive; and

a circuit to remove pointers to video file segment files without a retention flag set.

16. The apparatus of claim 4 further comprising:

an interface to at least one extrinsic sensor coupled to said extrinsic retention meta-data store to encode in non-transitory media associated by time with video segments extrinsic events and sensor measurements of at least one of portal transit, occupancy of rooms, halls, and location space, and physical access request and actuation.

17. The apparatus of claim 16 further comprising:

sensor measurement of at least one of vibration and movement from accelerometers, temperature and heat, wind speed and humidity.

18. The apparatus of claim 16 further comprising:

sensor measurement of at least one of acoustical sound energy, electromagnetic signals from motion, from smoke, from fire, and from CO detectors.

19. The apparatus of claim 16 further comprising sensor measurement of at least one of intrusion alarm of equipment and intrusion alarm of perimeter.

5. (canceled)

7. An apparatus for high definition surveillance image storage optimization comprises:

a purging module;

communicatively coupled to,

a camera network interface to a plurality of high definition video cameras, said purging module, and network interface interconnected by communication circuits and switches;

wherein said purging module comprises;

a retention policy store;

a statutory and judicial requirements store;

a metric threshold store;

a camera and location ownership store;

an interface to disk file management;

a circuit to store retention metadata; and

a calendar module comprising a calendar processor configured to match video file segment timestamps with date-time of purging directives and when true, trigger purging of segments unprotected by retention meta-data.

8. (canceled)

9. An apparatus for high definition surveillance image storage optimization comprises:

a camera network interface to a plurality of high definition video cameras; and

a video stream transformation module (vtransformation module);

wherein said transformation module comprises;

a first digital logic circuit to receive H.264 streams transmitted from high definition video cameras coupled to said camera network interface;

a first processor core configured by instructions to transform a received H.264 stream into at least one video segment;

communicatively coupled to,

a second digital logic circuit to transmit a file write operation to media controller to store metrics into file headers encoded into a non-transitory media storage device, wherein said processor cores are one of the group;

physical, and virtual; and

said circuits, interfaces, modules, cores, and media controller interconnected by communication circuits and switches.

10. The apparatus of claim 9 further comprising:

a second processor core configured by instructions to annotate said video segment by insertion of at least one metric of acoustic energy transitions;

communicatively coupled to said digital logic circuits and interfaces.

11. The apparatus of claim 9 further comprising:

a third processor configured by instructions to annotate video segments by insertion of metrics of visible and non-visible spectrum energy transitions;

communicatively coupled to said digital logic circuits and interfaces.

12. The apparatus of claim 9 further comprising:

a fourth processor core configured by instructions to transform video segments of the received H.264 video stream into metrics of movement vectors of pixel blocks;

communicatively coupled to said digital logic circuits and interfaces.

13. The apparatus of claim 9 further comprising:

a fifth processor core configured by instructions to transform video segments of the received H.264 video stream into JPEG pixel blocks;

communicatively coupled to said digital logic circuits and interfaces.

14. The apparatus of claim 9 further comprising:

a sixth processor core configured by instructions to transform frequency coefficients of said JPEG pixel blocks into movement metrics;

communicatively coupled to said digital logic circuits and interfaces.

15. The apparatus of claim 9 further comprising:

a circuit to set a retention flag when said metric exceeds a threshold;

a circuit to receive a purging directive; and

a circuit to remove pointers to video file segment files without a retention flag set.