METHOD FOR STOP SIGN LAW ENFORCEMENT USING MOTION VECTORS IN VIDEO STREAMS

• US 20140071286A1
• Filed: 09/13/2012
• Published: 03/13/2014
• Est. Priority Date: 09/13/2012
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Bernal, Edgar A., Bulan, Orhan, Loce, Robert P.
• Granted Patent: US 10,018,703 B2
• Time in Patent Office: Days
• US Class Current: 348/149
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/269 using gradient-based methods
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G08G 1/0175 by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096741 where the source of the transmitted information selects which information to transmit to each vehicle
• CPC Class Codes: G08G 1/096783 where the origin of the information is a roadside individual element
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/513 Processing of motion vectors

Abstract

A method for enforcing traffic signal compliance includes acquiring a series of temporal related image frames including a target area. Each image frame includes pixel data representative of the target area. The method includes generating one or more motion vectors between two or more of the image frames. The motion vectors are the type produced by compressing the pixel data associated with the two or more image frames. The method includes associating a cluster of motion vectors with a vehicle. The method further includes tracking a position of the vehicle across the two or more image frames. Using the tracking results, the method includes determining whether the vehicle stops in the target area. For the vehicle being determined as not stopping, the method includes signaling an occurrence of noncompliance.

Claims

1. A method for enforcing traffic signal compliance, the method comprising:

receiving video data from a camera;

defining a target area in the received video data;

identifying motion vectors in the video data;

associating a cluster of the motion vectors with a vehicle;

tracking a position of the vehicle across two or more video frames;

using the tracking results, determining whether the vehicle stops in the target area; and

,

for the vehicle being determined as not stopping, signaling an occurrence of noncompliance.

2. The method according to claim 1 wherein the motion vectors are a type produced in the process of compressing pixel data associated with the two or more video frames.

3. The method according to claim 2, wherein the video data is compressed video data, and wherein the identifying the motion vectors includes extracting the motion vectors from the compressed video data.

4. The method according to claim 2, wherein the received video data includes a live uncompressed video stream, and wherein the motion vectors are identified as the motion vectors are generated during video compression.

5. The method according to claim 1 wherein the motion vectors are one of those extracted from optical flow data between the two or more video frames and those establishing correspondences between frames across a plurality of video frames.

6. The method of claim 1, further comprising:

defining the target area in image coordinates as including one or more of a polygon, a circle, an ellipse, a closed curve, an open curve, and a line.

7. The method of claim 1, wherein the target area includes a stationary stop indicator.

8. The method of claim 7, wherein the stop indicator is selected from a group consisting of:

an intersection;

a stop line;

a crosswalk;

a stop signal;

a stop sign; and

, a combination of the above.

9. The method of claim 7, wherein the target area extends at least one vehicle length behind the stop indicator.

10. The method of claim 1, wherein the associating the cluster of motion vectors with the vehicle includes:

comparing a magnitude of each motion vector to a first threshold;

defining a cluster as including one or more connected motion vectors meeting and exceeding the first threshold;

comparing a size of the cluster to a second threshold; and

,

for the size meeting and exceeding the second threshold, associating the cluster as belonging to the vehicle.

11. The method of claim 1, wherein the associating the cluster of motion vectors with the vehicle further includes:

counting a number of consecutive frames across which the cluster persists;

comparing the number of consecutive frames to a threshold; and

,

for the number of consecutive frames meeting and exceeding the threshold, associating the vehicle as an oncoming vehicle.

12. The method of claim 1, wherein the determining whether the vehicle stops in the target area includes:

determining a first frame in the series corresponding to when the cluster disappears and determining a second frame in the series corresponding to when the cluster reappears;

counting a number of frames between the first and second frames;

comparing the number of frames to a threshold; and

for the number of frames not meeting the threshold, associating the vehicle as not stopping.

13. The method of claim 1, further comprising:

in response to the vehicle not stopping, transmitting at least one of a signal and compressed pixel data to a second device.

14. A computer program product comprising tangible media which encodes instructions for performing the method of claim 1.

15. A system for enforcing traffic signal compliance, the system comprising:

a video capture device comprising memory which stores instructions for performing the method of claim 1 and a processor, in communication with the memory for executing the instructions.

16. A system for enforcing traffic signal compliance, the system comprising:

a video capture device including;

a video capture module adapted to acquire a series of temporal related image frames including a target area, each image frame including pixel data representative of the target area;

a motion vector extraction module adapted to;

generate one or more motion vectors between two or more of the image frames, wherein the motion vectors are the type produced in the process of compressing the pixel data associated with the two or more image frames,

associate a cluster of motion vectors with a vehicle, and

track a position of the vehicle across the two or more image frames; and

,

a processor adapted to implement the modules; and

,

the system further including;

a violation determination module adapted to;

use the tracking results to determine whether the vehicle stops in the target area, and

for the vehicle being determined as not stopping, signal an occurrence of noncompliance; and

a processor adapted to implement the violation determination module.

17. The system of claim 16, wherein the motion vector extraction module is further adapted to:

in a current frame, define the target area in image coordinates as including one or more of a polygon, a circle, an ellipse, a closed curve, an open curve, and a line.

18. The system of claim 17, wherein the target area includes a stationary stop indicator selected from a group consisting:

an intersection;

a stop line;

a crosswalk;

a stop signal;

a stop sign; and

, a combination of the above.

19. The system of claim 17, wherein the target area extends at least one vehicle length behind the stop indicator.

20. The system of claim 16, wherein the motion vector extraction module is further adapted to:

compare a magnitude of each motion vector to a first threshold;

define a cluster as including the one or more connected motion vectors meeting and exceeding the first threshold;

compare a size of the cluster to a second threshold; and

,

for the size meeting and exceeding the second threshold, associate the cluster as belonging to the vehicle.

21. The system of claim 16, wherein the a motion vector extraction module is further adapted to:

count a number of consecutive frames across which the cluster persists;

compare the number of consecutive frames to a third threshold; and

,

for the number of consecutive frames meeting and exceeding the third threshold, associate the vehicle as an oncoming vehicle.

22. The system of claim 16, wherein the violation determination module is further adapted to:

determine a first frame in the series corresponding to when the cluster disappears and determine a second frame in the series corresponding to when the cluster reappears;

count a number of frames between the first and second frames;

compare the number of frames to a threshold; and

for the number of frames not meeting the threshold, associate the vehicle as not complying with a stop indicator.

23. The system of claim 16, wherein the violation determination module is further adapted to:

in response to the vehicle not stopping in the target area, transmit at least one of a signal and the compressed pixel data to a second device.

24. The system of claim 16, wherein the violation determination module is included in one of the image capture device and a second, remote device.