Coding scheme for identifying spatial locations of events within video image data

• US 9,883,193 B2
• Filed: 05/03/2016
• Issued: 01/30/2018
• Est. Priority Date: 03/19/2009
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated (Kyndryl Holdings, Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Desimone, Michael J., Hampapur, Arun, Lu, Zuoxuan, Mercier, Carl P., Milite, Christopher S., Russo, Stephen R., Shu, Chiao-Fe, Tan, Chek K.
• Primary Examiner(s): PEREZ FUENTES, LUIS M
• Application Number:
  US15/145,161
• Publication Number:
  US 20160249063A1
• Time in Patent Office: 637 Days
• Field of Search: 37524016
• CPC Class Codes: G06V 10/469 Contour-based spatial representations, e.g. vector-coding
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/25 with scene description coding, e.g. binary format for scenes [BIFS] compression
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An approach for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of a trajectory of an object for an event within video image data; generate a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of the object for the event within video image data; generate a lossy searchable code of the trajectory of the object for the event within the video image data; convert a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and compare the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.

Claims

1. A method for generating a coding scheme for identifying a spatial location of an event within video image data comprising:

receiving trajectory data of a trajectory of an object for an event within video image data;

generating a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of an object for the event within the video image data;

generating a lossy searchable code, which corresponds to the lossless compressed contour-coded blob and is not in the video image data, of the trajectory data of the trajectory of the object for the event within the region of interest;

converting a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and

comparing the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.

2. The method according to claim 1, the generating the lossless compressed contour-coded blob comprising:

dividing the video image data into a plurality of pixel regions; and

determining whether each of the plurality of pixel regions contains trajectory data of the trajectory of the object for the event within the video image data.

3. The method according to claim 2, the generating the lossy searchable code comprising:

dividing the video image data into a second plurality of pixel regions, the second plurality of pixel regions comprising less pixel regions than the plurality of pixel regions for the lossless compressed contour-coded blob; and

determining whether each of the second plurality of pixel regions contains trajectory data of the trajectory of the object for the event within the video image data.

4. The method according to claim 1, further comprising inputting the lossless compressed contour-coded blob, the lossy searchable code, and a trajectory identifier into the relational database.

5. The method according to claim 1, further comprising searching the relational database based on the trajectory data of the trajectory of the object for the event within the video image data.

6. The method according to claim 1, further comprising specifying, via a user input, the region of interest corresponding to the sub-section of the visual display output of the video image data.

7. A system for generating a coding scheme for identifying a spatial location of an event within video image data comprising:

at least one processing unit;

memory operably associated with the at least one processing unit; and

a spatial representation tool storable in memory and executable by the at least one processing unit, the spatial representation tool comprising a compression component configured to;

receive trajectory data of a trajectory of an object for an event within video image data;

generate a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of the object for the event within video image data;

generate a lossy searchable code, which corresponds to the lossless compressed contour-coded blob and is not in the video image data, of the trajectory of the object for the event within the video image data;

convert a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and

compare the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.

8. The spatial representation tool according to claim 7, the compression component further configured to:

divide the video image data into a plurality of pixel regions; and

determine whether each of the plurality of pixel regions contains trajectory data of the trajectory of the object for the event within the video image data.

9. The spatial representation tool according to claim 8, the compression component further configured to:

divide the video image data into a second plurality of pixel regions, the second plurality of pixel regions comprising less pixel regions than the plurality of pixel regions for the lossless compressed contour-coded blob; and

determine whether each of the second plurality of pixel regions contains trajectory data of the trajectory of the object for the event within the video image data.

10. The spatial representation tool according to claim 7, further comprising an input component configured to input the lossless compressed contour-coded blob, the lossy searchable code, and a trajectory identifier into the relational database.

11. The spatial representation tool according to claim 7, the compression component further configured to search the relational database based on the trajectory data of the trajectory of the object for the event within the video image data.

12. The spatial representation tool according to claim 7, the compression component further configured to specify, via a user input, the region of interest corresponding to the sub-section of the visual display output of the video image data.

13. A computer-readable storage-device that is not a signal and stores computer instructions, which when executed, enables a computer system to generate a coding scheme for identifying a spatial location of an event within video image data, the computer instructions comprising:

receiving trajectory data of a trajectory of an object for an event within video image data;

generating a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of an object for the event within the video image data;

generating a lossy searchable code, which corresponds to the lossless compressed contour-coded blob and is not in the video image data, of the trajectory data of the trajectory of the object for the event within the region of interest;

converting a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and

comparing the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.

14. The computer-readable storage-device according to claim 13, the computer instructions for generating the lossless compressed contour-coded blob further comprising:

dividing the video image data into a plurality of pixel regions; and

determining whether each of the plurality of pixel regions contains trajectory data of the trajectory of the object for the event within the video image data.

15. The computer-readable storage-device according to claim 14, the computer instructions for generating the lossy searchable code further comprising:

dividing the video image data into a second plurality of pixel regions, the second plurality of pixel regions comprising less pixel regions than the plurality of pixel regions for the lossless compressed contour-coded blob; and

determining whether each of the second plurality of pixel regions contains trajectory data of the trajectory of the object for the event within the video image data.

16. The computer-readable storage-device according to claim 13 further comprising computer instructions for inputting the lossless compressed contour-coded blob, the lossy searchable code, and a trajectory identifier into the relational database.

17. The computer-readable storage-device according to claim 13 further comprising computer instructions for searching the relational database based on the trajectory data of the trajectory of the object for the event within the video image data.

18. The computer-readable storage-device according to claim 13 further comprising computer instructions for specifying, via a user input, the region of interest corresponding to the sub-section of the visual display output of the video image data.