Identifying spatial locations of events within video image data

• US 8,971,580 B2
• Filed: 05/28/2013
• Issued: 03/03/2015
• Est. Priority Date: 03/19/2009
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Desimone, Michael J., Hampapur, Arun, Lu, Zuoxuan, Mercier, Carl P., Milite, Christopher S., Russo, Stephen R., Shu, Chiao-Fe, Tan, Chek K.
• Primary Examiner(s): Lu, Tom Y
• Application Number:
  US13/903,237
• Publication Number:
  US 20130259316A1
• Time in Patent Office: 644 Days
• Field of Search: 382/103, 382/107
• US Class Current: 382/103
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

Claims

1. A method for identifying a spatial location of an event within video image data comprising:

generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising;

identifying one or more pixel regions from the plurality of pixel regions containing trajectory data;

performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and

generating a transition chain code based on the multi-point neighborhood scan, the transition chain code defining a direction of trajectory of the object;

generating a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code; and

generating a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

2. The method according to claim 1, further comprising inputting each of the set of compressed spatial representations of the trajectory data of the trajectory of the object for the event and the lossless contour code of the trajectory data of the trajectory of the object for the event into a relational database.

3. The method according to claim 2, further comprising searching the relational database to identify a spatial location of the event within the video image data.

4. The method according to claim 3, the searching comprising:

converting the area of interest to a lossy query code; and

comparing the lossy query code to a searchable code of the trajectory data of the event within the video image data.

5. The method according to claim 4, further comprising:

decompressing a contour-coded blob corresponding to the lossy query code based on the comparing; and

plotting a trajectory of the event within the video image data from the contour-coded blob.

6. A system for identifying a spatial location of an event within video image data comprising:

at least one processing unit;

memory operably associated with the at least one processing unit; and

a spatial representation tool storable in memory and executable by the at least one processing unit, the spatial representation tool comprising;

a compression component configured to;

generate trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the trajectory data generated by;

identifying one or more pixel regions from the plurality of pixel regions containing trajectory data;

performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and

generating a transition chain code based on the multi-point neighborhood scan, the transition chain code defining a direction of trajectory of the object;

generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code; and

generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

7. The system of claim 6, the spatial representation tool further comprising a database component configured to input each of the set of compressed spatial representations of the trajectory data of the trajectory of the object for the event and the lossless contour code of the trajectory data of the trajectory of the object for the event into a relational database.

8. The system of claim 7, further comprising a search component configured to search the relational database to identify a spatial location of the event within the video image data.

9. The system of claim 8, the search component further configured to:

convert the region of interest to a lossy query code; and

compare the lossy query code to a searchable code of the trajectory data of the event within the video image data.

10. The spatial representation tool according to claim 9 further comprising a display component configured to:

decompress a contour-coded blob corresponding to the lossy query code based on the comparison of the lossy query code to the searchable code of the trajectory data of the event within the video image data; and

plot a trajectory of the event within the video image data from the contour-coded blob.

11. A computer-readable storage device storing computer instructions, which when executed, enables a computer system to identify a spatial location of an event within video image data, the computer instructions comprising:

generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising;

identifying one or more pixel regions from the plurality of pixel regions containing trajectory data;

performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and

generating a transition chain code based on the multi-point neighborhood scan, the transition chain code defining a direction of trajectory of the object;

generating a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code; and

generating a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

12. The computer-readable storage device according to claim 11, further comprising computer instructions for inputting each of the set of compressed spatial representations of the trajectory data of the trajectory of the object for the event and the lossless contour code of the trajectory data of the trajectory of the object for the event into a relational database.

13. The computer-readable storage device according to claim 12, further comprising computer instructions for searching the relational database to identify a spatial location of the event within the video image data.

14. The computer-readable storage device according to claim 13, the computer instructions for searching comprising:

converting the area of interest to a lossy query code; and

comparing the lossy query code to a searchable code of the trajectory data of the event within the video image data.

15. The computer-readable storage device according to claim 14, further comprising computer instructions for:

decompressing a contour-coded blob corresponding to the lossy query code based on the comparing; and

plotting a trajectory of the event within the video image data from the contour-coded blob.