Method and apparatus for classifying video data

• US 9,449,481 B2
• Filed: 09/16/2005
• Issued: 09/20/2016
• Est. Priority Date: 09/16/2005
• Status: Active Grant

• Current Assignee: III Holdings 10, LLC
• Original Assignee: III Holdings 10, LLC
• Inventors: Burke, Trevor John
• Primary Examiner(s): Moe, Aung S
• Assistant Examiner(s): Morehead, III, John H
• Application Number:
  US12/066,639
• Publication Number:
  US 20090028512A1
• Time in Patent Office: 4,022 Days
• Field of Search: 348/152, 348/154
• US Class Current: 1/1
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19697 Arrangements wherein non-video detectors generate an alarm themselves
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/9206 the additional signal being a character code signal
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method of classifying video data representing activity within a space to be monitored. A method comprises storing video data obtained from a camera configured to monitor the space. Sensor data indicative of a condition occurring within the space is obtained, and a plurality of program elements are defined within the video data. Each program element has an associated classification code, and each classification code is selected using the sensor data.

Claims

1. A method of classifying video data representing activity within a space to be monitored, the method comprising:

receiving video data from a camera configured to monitor the space;

receiving sensor data indicative of a condition occurring within the space;

defining a plurality of programme elements within said video data, each programme element having an associated classification code selected using a plurality of samples of said sensor data obtained by a sensor during a time period of capture of the programme element by the camera;

storing video data representing said programme elements; and

storing said classification codes associated with said programme elements;

wherein said classification codes represent values on a scale extending from a low value to a high value, said scale representing relative activity within the space being monitored.

2. A method according to claim 1, wherein said sensor data is obtained using a motion sensor.

3. A method according to claim 1, wherein said sensor data is obtained using a sound sensor.

4. A method according to claim 1, wherein said sensor data is obtained using a pressure sensor.

5. A method according to claim 1, further comprising:

receiving video data from a plurality of cameras; and

storing data from one of said plurality of cameras selected on the basis of said sensor data.

6. A method according to claim 5, wherein the classification code associated with each programme element identifies the camera of said plurality of cameras which was used to obtain the video data making up said programme element.

7. A method according to claim 1, wherein storing video data representing said programme elements comprises:

determining whether each classification code satisfies a predetermined condition; and

storing a programme element if but only if its associated classification code satisfies said predetermined condition.

8. A method according to claim 1, wherein said classification codes are selected from a predetermined set of classification codes.

9. A method according to claim 1, wherein each classification code is selected in dependence upon a number of activations of the sensor occurring within a corresponding predetermined time period.

10. A method according to claim 1, further comprising:

deleting video data representing some programme elements, wherein video data to be deleted is selected on the basis of said classification codes.

11. A method according to claim 1, wherein video data to be deleted is video data representing periods of relatively low activity within the space being monitored.

12. A method according to claim 1, further comprising:

receiving user selection of a classification code; and

displaying programme elements associated with said classification code.

13. A method according to claim 9, further comprising:

receiving user input representing a request to display programme elements representing periods of relatively high activity within the space being monitored;

determining at least one classification code associated with programme elements representing periods of relatively high activity within the space being monitored; and

displaying programme elements associated with the determined classification codes.

14. A method according to claim 13, wherein said determining comprises:

calculating an average level of activity for all programme elements; and

determining classification codes representing periods of above average activity.

15. A non-transitory computer-readable memory storing computer program code to cause a computer to carry out the method of claim 1.

16. An apparatus for classifying video data representing activity within a space to be monitored, the apparatus comprising:

a program memory storing processor readable instructions; and

a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of claim 1.

17. An apparatus for classifying video data representing activity within a space to be monitored, the apparatus comprising:

a storage device configured to store video data obtained from a video camera configured to monitor the space;

a controller configured to receive sensor data indicative of a condition occurring within the space;

wherein the controller is configured to define a plurality of programme elements within said video data, each programme element having an associated classification code selected using a plurality of samples of said sensor data obtained by a sensor during a time period of capture of the programme element by the video camera;

wherein said classification codes represent values on a scale extending from a low value to a high value, said scale representing relative activity within the space being monitored.

18. An apparatus according to claim 17, further comprising the video camera.

19. An apparatus according to claim 17, further comprising the sensor.

20. An apparatus according to claim 19, wherein said sensor is a motion sensor.

21. An apparatus according to claim 19, wherein said sensor is a pressure sensor.

22. An apparatus according to claim 19, wherein said sensor is a sound sensor.

23. A method of classifying video data representing activity within a space to be monitored, the method comprising:

receiving video data from a camera configured to monitor the space;

receiving sensor data indicative of a condition occurring within the space;

defining a plurality of programme elements within said video data, each programme element having an associated classification code selected using a plurality of samples of said sensor data obtained by a sensor during a time period of capture of the programme element by the camera;

storing video data representing said programme elements; and

storing said classification codes associated with said programme elements.

24. An apparatus for classifying video data representing activity within a space to be monitored, the apparatus comprising:

a storage device configured to store video data obtained from a video camera configured to monitor the space;

a controller configured to receive sensor data indicative of a condition occurring within the space;

wherein the controller is configured to define a plurality of programme elements within said video data, each programme element having an associated classification code selected using a plurality of samples of said sensor data obtained by a sensor during a time period of capture of the programme element by the video camera.