Vehicle counting methods and systems utilizing compressed video streams

• US 9,424,747 B2
• Filed: 04/23/2012
• Issued: 08/23/2016
• Est. Priority Date: 10/20/2011
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Bernal, Edgar A., Loce, Robert P., Bulan, Orhan
• Primary Examiner(s): Vo, Tung
• Assistant Examiner(s): CATTUNGAL, ROWINA J
• Application Number:
  US13/453,245
• Publication Number:
  US 20130278767A1
• Time in Patent Office: 1,583 Days
• Field of Search: 348/143, 348/148
• US Class Current: 1/1
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G08G 1/0133 for classifying traffic situation
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

This disclosure provides method and systems of recording a predetermined event associated with a moving object, the predetermined event captured with an image capturing unit and one or more of the associated frames compressed, producing one or more motion vectors. According to one exemplary embodiment, vehicle counting is performed based on motion vectors produced during the data compression process, either inline or offline.

Claims

1. A computer implemented method of recording the occurrence of a predetermined event associated with a moving object, the predetermined event captured using an image capturing device directed towards a target region associated with the predetermined event, the method comprising:

a) the image capturing device acquiring a series of temporal related image frames including the target region, each image frame including pixel data representative of the image frame;

b) compressing the pixel data associated with one or more of the image frames using a compression process configured to generate one or more motion vectors representative of the moving object, step b) including;

b1) compressing the pixel data associated with the one or more image frames using a compression process configured to generate one or more motion vectors representative of the moving object;

b2) communicating the compressed pixel data of step b1) to a data storage device; and

b3) extracting the one or more motion vectors from the compressed pixel data communicated to the storage device;

c) determining if the predetermined event occurred based on the one or more motion vectors representative of the moving object; and

d) recording and incrementally counting the occurrence of the predetermined event if step c) determines the predetermined event occurred.

2. The computer implemented method according to claim 1, wherein the image capturing device is one of a video camera, infrared camera, thermal camera or satellite imaging camera.

3. The computer implemented method according to claim 1, step b) comprising:

compressing the pixel data associated with one or more of the image frames using a first compression process to generate reference frames, the first compression process not requiring pixel data associated with other image frames to perform compression of the pixel data associated with the reference frames; and

compressing the pixel data associated with one or more of the image frames using a second compression process to generate non-reference frames, the second compression process generating the one or more motion vectors representative of the moving object.

4. The computer implemented method of claim 1, wherein the moving object is one of a vehicle, a person, a vessel, a train, an airplane, and an animal, and the predetermined event is associated with movement of the object within the target region.

5. The computer implemented method of claim 1, wherein the moving object is a vehicle and the predetermined event is the movement of the vehicle past a predetermined target region.

6. The computer implemented method of claim 1,

the compression process of step b) configured to generate one or more motion vector blocks representative of the moving object;

and

step c) determining if the predetermined event occurred based on the one or more motion vector blocks representative of the moving object.

7. The computer implemented method of claim 1, wherein step d) records the occurrence of the predetermined event in the form of metadata embedded in compressed data associated with the video sequence.

8. The computer implemented method of claim 1, wherein the image capturing device is one of stationary and scanning.

9. An image capturing system for recording an occurrence of a predetermined event associated with a moving object, the image capturing system comprising:

an image capturing device directed towards a target region associated with the predetermined event, an image processor operatively associated with the image capturing device, the image processor configured to perform a method of recording the occurrence of the predetermined event associated with the moving object comprising;

a) the image capturing device acquiring a series of temporal related image frames including the target region, each image frame including pixel data representative of the image frame;

b) compressing the pixel data associated with one or more of the image frames using a compression process configured to generate one or more motion vectors representative of the moving object, step b) including;

b1) compressing the pixel data associated with the one or more image frames using a compression process configured to generate one or more motion vectors representative of the moving object;

b2) communicating the compressed pixel data of step b1) to a data storage device; and

b3) extracting the one or more motion vectors from the compressed pixel data communicated to the storage device;

c) determining if the predetermined event occurred based on the one or more motion vectors representative of the moving object; and

d) recording and incrementally counting the occurrence of the predetermined event if step c) determines the predetermined event occurred.

10. The image capturing system according to claim 9, wherein the image capturing device is one of a video camera, infrared camera, thermal camera or satellite imaging camera.

11. The image capturing system according to claim 9, step b) comprising:

compressing the pixel data associated with one or more of the image frames using a first compression process to generate reference frames, the first compression process not requiring pixel data associated with other image frames to perform compression of the pixel data associated with the reference frames; and

compressing the pixel data associated with one or more of the image frames using a second compression process to generate non-reference frames, the second compression process generating the one or more motion vectors representative of the moving object.

12. The image capturing system according to claim 9, wherein the moving object is one of a vehicle, a person, a vessel, a train, an airplane, and an animal, and the predetermined event is associated with movement of the object within the target region.

13. The image capturing system according to claim 9, wherein the moving object is a vehicle and the predetermined event is the movement of the vehicle past a predetermined threshold associated with the target region.

14. The image capturing system according to claim 9,

the compression process of step b) configured to generate one or more motion vector blocks representative of the moving object;

and

step c) determining if the predetermined event occurred based on the one or more motion vector blocks representative of the moving object.

15. The image capturing system according to claim 9, wherein step d) records the occurrence of the predetermined event in the form of metadata embedded in compressed data associated with the video sequence.

16. The image capturing system according to claim 9, wherein the image capturing device is one of stationary and scanning.