Method and apparatus for classifying video data

• US 9,860,482 B2
• Filed: 09/16/2016
• Issued: 01/02/2018
• Est. Priority Date: 09/16/2005
• Status: Active Grant

• Current Assignee: III Holdings 10, LLC (Intellectual Ventures LLC)
• Original Assignee: III Holdings 10, LLC (Intellectual Ventures LLC)
• Inventors: Burke, Trevor John
• Primary Examiner(s): Ye, Lin
• Assistant Examiner(s): Morehead, III, John H
• Application Number:
  US15/267,364
• Publication Number:
  US 20170006254A1
• Time in Patent Office: 473 Days
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19697 Arrangements wherein non-video detectors generate an alarm themselves
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/9206 the additional signal being a character code signal
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method of classifying video data representing activity within a space to be monitored. A method comprises storing video data obtained from a camera configured to monitor the space. Sensor data indicative of a condition occurring within the space is obtained, and a plurality of program elements are defined within the video data. Each program element has an associated classification code, and each classification code is selected using the sensor data.

Claims

1. A method of classifying video data, the method comprising:

defining, by a computing device, a plurality of programme elements within video data, wherein each programme element has an associated classification code selected based on content of the video data, and wherein the content of the video data is determined at least in part based on sensor data obtained from a sensor device;

storing, by the computing device, video data representing the plurality of programme elements;

storing, by the computing device, the classification codes associated with the plurality of programme elements;

selecting video data to be deleted based on the classification codes; and

deleting the video data to be deleted, wherein the video data to be deleted is associated with one or more programme elements of the plurality of programme elements, wherein the video data to be deleted comprises video data representing periods of activity within the space being monitored that is below a calculated average level of activity for programme elements within the monitored space.

2. The method of claim 1, further comprising:

receiving the video data from a video recording device configured to monitor a space; and

receiving the sensor data from the sensor device, wherein the sensor device is configured to sense conditions occurring within the space, and wherein the sensor data is indicative of a sensed condition occurring within the space.

3. The method of claim 2, wherein the sensor data comprises motion data obtained from a motion sensor.

4. The method of claim 2, wherein the sensor data comprises audio data obtained from a sound sensor.

5. The method of claim 2, wherein the sensor data comprises pressure data obtained from a pressure sensor.

6. The method of claim 1, wherein the content of the video data is obtained by the sensor device during a time period of capture of a respective programme element by the video recording device.

7. The method of claim 1, wherein the classification codes represent values on a scale extending from a low value to a high value, and wherein the scale represents activity within the space being monitored.

8. The method of claim 1, further comprising receiving video data from a plurality of video recording devices, wherein the classification code associated with each programme element identifies a specific video recording device of the plurality of video recording devices which was used to obtain the video data of the respective programme element.

9. The method of claim 1, wherein storing video data representing the plurality of programme elements comprises:

determining whether each classification code satisfies a predetermined condition; and

storing a programme element in response to a determination that an associated classification code satisfies the predetermined condition.

10. The method of claim 1, wherein said classification codes are selected from a predetermined set of classification codes.

11. The method of claim 1, wherein the classification codes represent upon a number of activations of the sensor device occurring within a corresponding predetermined time period.

12. The method of claim 1, further comprising:

receiving a user selection of a classification code; and

displaying programme elements associated with the classification code associated with the user selection.

13. The method of claim 12, further comprising:

receiving a user input representing a request to display programme elements representing periods of activity within the space being monitored that is above a calculated average level of activity for programme elements within the monitored space;

determining at least one classification code associated with programme elements representing periods of activity within the space being monitored that is above a calculated average level of activity for programme elements within the monitored space; and

displaying programme elements associated with the determined at least one classification code.

14. The method of claim 13, wherein said determining comprises:

calculating an average level of activity for all programme elements of the plurality of programme elements; and

determining classification codes representing periods of above activity that is at the calculated average level of activity for programme elements within the monitored space.

15. A non-transitory computer-readable memory storing computer program code to cause a computer to:

define a plurality of programme elements within video data, wherein each programme element has an associated classification code selected based on content of the video data, and wherein the content of the video data is determined at least in part based on sensor data obtained from a sensor device;

store video data representing the plurality of programme elements;

store the classification codes associated with the plurality of programme elements;

select video data to be deleted based on the classification codes; and

delete the video data to be deleted, wherein the video data to be deleted is associated with one or more programme elements of the plurality of programme elements, wherein the video data to be deleted comprises video data representing periods of activity within the space being monitored that is below a calculated average level of activity for programme elements within the monitored space.

16. A system for classifying video data, the system comprising:

a program memory configured to store processor readable instructions; and

a processor configured to read and execute instructions stored in the program memory, wherein the processor readable instructions comprise instructions to cause the processor to;

define a plurality of programme elements within video data, wherein each programme element has an associated classification code selected based on content of the video data, and wherein the content of the video data is determined at least in part based on sensor data obtained from a sensor device;

store video data representing the plurality of programme elements;

store the classification codes associated with the plurality of programme elements;

select video data to be deleted based on the classification codes; and

delete the video data to be deleted, wherein the video data to be deleted is associated with one or more programme elements of the plurality of programme elements, wherein the video data to be deleted comprises video data representing periods of activity within the space being monitored that is below a calculated average level of activity for programme elements within the monitored space.

17. The system of claim 16, further comprising:

the sensor device;

a video recording device configured to capture the video data; and

a storage device configured to store the video data.

18. The system of claim 17, wherein the sensor device comprises at least one of a motion sensor, a pressure sensor, and a sound sensor.