System and method for street-parking-vehicle identification through license plate capturing

• US 8,682,036 B2
• Filed: 05/01/2012
• Issued: 03/25/2014
• Est. Priority Date: 04/06/2012
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Wang, Yao Rong, Fan, Zhigang, Pennington, Graham S., Ding, Hengzhou
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US13/461,191
• Publication Number:
  US 20130266190A1
• Time in Patent Office: 693 Days
• Field of Search: 382/100, 382103-107, 382/155, 382/162, 382/168, 382/173, 382/181, 382/199, 382/209, 382/232, 382/254, 382/274, 382/276, 382286-294, 382/305, 382/312, 340/932.2, 340/937, 340/432, 340/148, 348/169, 348/148
• US Class Current: 382/105
• CPC Class Codes: G06V 20/625 License plates
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names

Abstract

A method and a system for identifying a vehicle in a parking area includes receiving video data from a video camera observing a parking area from a first field of view over duration of time and receiving image data from a still camera observing a second field of view overlapping the first field of view. The method includes tracking a location of a vehicle across a sequence of frames. The tracking includes determining a time instant at which each frame was captured. The method includes comparing a select frame captured by the video camera with an image captured by the still camera. Based on the comparing, the method includes matching the vehicle in the image with the vehicle in the frame. The method includes determining a license plate number of the vehicle by locating a license plate on the vehicle in the image.

Claims

1. A method for identifying a vehicle in a parking area, the method comprising:

receiving video data in a sequence of frames provided by an associated video capture device observing a parking area from a first field of view over a duration of time;

receiving image data from an associated image capture device observing the street traffic from a second field of view at least partially overlapping the first field of view;

determining a presence of a vehicle in the parking area by identifying an object in motion in the video data;

tracking a location of a vehicle across the sequence of frames, wherein the tracking;

comparing a select frame captured by the associated video capture device with an image captured by the associated image capture device;

based on the comparing, matching the vehicle in the image with the vehicle in the frame; and

,

determining a license plate number of the vehicle by locating a license plate on the vehicle in the image.

2. The method in claim 1, where in the associated image capture device is a video capturing device.

3. The method of claim 1, wherein the tracking includes:

determining a spatial location of the vehicle in a plurality of frames; and

,

determining spatio-temporal information describing the location of the vehicle as a function of time by associating the spatial location of the vehicle across the plurality of frames with a time instant at which each frame of the plurality of frames was captured.

4. The method of claim 1, wherein the determining the presence of the vehicle is performed by one of background subtraction, temporal difference, optical flow and an initialization process.

5. The method of claim 1, wherein the comparing includes:

comparing the frame corresponding to a select time instant with an image captured at the same time instant.

6. The method of claim 5, wherein the comparing includes:

determining spatio-temporal information describing the location of the vehicle as a function of time by associating the spatial location of the vehicle across the plurality of frames with the time instant at which the frame was captured

determining a change in the spatio-temporal information; and

,

associating a time corresponding to the change as the select time instant.

7. The method of claim 1, wherein the matching includes:

matching location fields of the associated video capture device and the associated image capture device.

8. The method of claim 1 further comprising:

providing the license plate number to an associated user device.

9. The method of claim 8, wherein the user device is associated with one of a violation enforcement authority and a for-fee parking collection authority.

10. The method of claim 1 further comprising:

determining whether the vehicle is violating a parking regulation; and

,

providing a user device with the license plate number in response to the vehicle violating the parking regulation.

11. The method of claim 1 further comprising:

determining whether the vehicle is parking in a for-fee parking area;

determining a registrant of the vehicle using the license plate number; and

,

charging an account of the registrant in response to the vehicle parking in the for-fee parking area.

12. A computer program product comprising tangible media which encodes instructions for performing the method of claim 1.

13. A system for determining a parking violation comprising:

a detection device comprising memory which stores instructions for performing the method of claim 1 and a processor, in communication with the memory for executing the instructions.

14. A system for identifying a vehicle in a parking area, the system comprising:

a video buffer module adapted to receive video data in a sequence of frames provided by an associated video capture device observing a parking area from a first field of view over a duration of time;

an image buffer module adapted to receive image data from an associated image capture device observing the parking area from a second field of view at least partially overlapping the first field of view;

a vehicle detection module adapted to determine a presence of a vehicle captured by identifying an object in motion in the video data;

a vehicle tracking module adapted to track a location of the vehicle across the sequence of frames; and

,

a vehicle identification module adapted to;

compare a select frame captured by the associated video capture device with an image captured by the associated image capture device,

match the vehicle in the image with the vehicle in the frame, and

determine a license plate number of the vehicle by locating a license plate on the vehicle in the image,

a processor adapted to implement the modules.

15. The system according to claim 14, wherein the vehicle tracking module is adapted to:

determine a spatial location of the vehicle in a plurality of frames; and

,

determine spatio-temporal information describing the location of the vehicle as a function of time by associating the spatial location of the vehicle across the plurality of frames with a time instant at which each frame of the plurality of frames was captured.

16. The system according to claim 15, wherein the vehicle identification module is adapted to:

use the spatio-temporal information to determine a duration that the vehicle is stationary; and

,

provide the license plate number to an associated user device in response to the vehicle being stationary for a period meeting or exceeding a threshold.

17. The system of claim 14, wherein the vehicle detection module determines the presence of the vehicle by one of background subtraction, temporal difference, optical flow and an initialization process.

18. The system according to claim 14, wherein the vehicle identification module is adapted to:

compare the frame corresponding to a select time instant with an image captured at the same time instant.

19. The system according to claim 18, wherein the vehicle identification module is adapted to:

determine spatio-temporal information describing the location of the vehicle as a function of time by associating the spatial location of the vehicle across the plurality of frames with the time instant at which the frame was captured

determine a change in the spatio-temporal information; and

,

associate a time corresponding the change as the select time instant.

20. The system according to claim 14, wherein the vehicle identification module is adapted to:

provide the license plate number to an associated user device.

21. The system according to claim 20, wherein the user device is associated with one of a violation enforcement authority and a for-fee parking collection authority.