Tracking Traffic Violations within an Intersection and Controlling Use of Parking Spaces Using Cameras

• US 20140211012A1
• Filed: 03/28/2014
• Published: 07/31/2014
• Est. Priority Date: 08/06/2012
• Status: Active Grant

• Current Assignee: Cloudparc, Inc.
• Original Assignee: Cloudparc, Inc.
• Inventors: Nerayoff, Steven David, Wong, Thompson S.
• Granted Patent: US 9,064,415 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 20/02 involving a neutral party, e.g. certification authority, notary or trusted third party [TTP]
• CPC Class Codes: G06Q 20/145 Payments according to the detected use or quantity
• CPC Class Codes: G06Q 30/0284 Time or distance, e.g. usage of parking meters or taximeters
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/625 : License plates
• CPC Class Codes: G06V 30/224 : of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 40/23 : Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G07B 15/00 : Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points handling coins or valuable papers, e.g. banknotes, G07D; apparatus for vending or hiring articles or services activated by coins, credit cards, paper currency or the like G07F7/00, G07F17/00
• CPC Class Codes: G07B 15/02 : taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems G07B15/06 takes precedence; taximeters G07B13/00; parking meters per se G07F17/24; car rental systems per se G07B15/00
• CPC Class Codes: G07F 17/24 : for parking meters
• CPC Class Codes: G08G 1/00 : Traffic control systems for road vehicles arrangement of road signs or traffic signals E01F9/00 ; automatic vehicle control B62D
• CPC Class Codes: G08G 1/017 : identifying vehicles G08G1/015, G08G1/054 take precedence
• CPC Class Codes: G08G 1/0175 : by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/052 : with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/056 : with provision for distinguishing direction of travel
• CPC Class Codes: G08G 1/133 : within the vehicle ; Indicators inside the vehicles or at stops
• CPC Class Codes: G08G 1/14 : indicating individual free spaces in parking areas
• CPC Class Codes: G08G 1/142 : external to the vehicles
• CPC Class Codes: G08G 1/143 : inside the vehicles
• CPC Class Codes: G08G 1/144 : on portable or mobile units, e.g. personal digital assistant [PDA]
• CPC Class Codes: G08G 1/146 : where the parking area is a limited parking space, e.g. parking garage, restricted space
• CPC Class Codes: G08G 1/148 : Management of a network of parking areas
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

Tracking traffic violations within an intersection and use of a destination location are disclosed. Initially, two or more first images from a first camera having a first field of view are received. Next, a first unique identifier of a first vehicle and a violated traffic restriction within the intersection are determined based on the two or more first images. Next, two or more second images from a second camera having a second field of view are received. A second unique identifier and a first characteristic of a second vehicle are determined based on the two or more second images. Next, two or more third images from a third camera having a third field of view are received. That the second vehicle is stopped in a destination location at a first time and that the second vehicle has left the destination location at a second time are determined based on the two or more third images.

Claims

1. A method of tracking traffic violations within an intersection and use of a destination location, the method comprising:

receiving two or more first images from a first camera having a first field of view, the two or more first images showing an intersection having a traffic control signal and a first vehicle;

receiving two or more second images from a second camera having a second field of view, the two or more second images showing a second vehicle, the second camera being different from the first camera, and the second field of view being different from the first field of view;

receiving two or more third images from a third camera having a third field of view, the two or more third images showing a destination location and the second vehicle, the third camera being different from the second camera, and the third field of view being different from and partially overlapping with the second field of view;

determining, based on the two or more first images, a first unique identifier of the first vehicle;

determining, based on the two or more first images, that the first vehicle is violating a traffic restriction within the intersection;

indicating, in response to the determination that the first vehicle is violating the traffic restriction within the intersection, the first unique identifier of the first vehicle and the traffic restriction that the first vehicle is violating;

determining, based on the two or more second images, a second unique identifier and a first characteristic of the second vehicle;

determining, based on the two or more third images, a second characteristic of the second vehicle;

comparing the second characteristic of the second vehicle to the first characteristic of the second vehicle;

determining, in response to the comparison of the second characteristic of the second vehicle and the first characteristic of the second vehicle, that the second characteristic of the second vehicle is approximately equal to the first characteristic of the second vehicle;

determining, in response to the approximate equivalence between the second characteristic of the second vehicle and the first characteristic of the second vehicle, that the second vehicle is present in the third field of view of the third camera;

determining, based on the two or more third images, that the second vehicle is stopped in the destination location at a first time;

determining, based on the two or more third images, that the second vehicle has left the destination location at a second time that is after the first time; and

indicating, in response to the determination that the second vehicle has left the destination location, the unique identifier of the second vehicle, the first time that the second vehicle began use of the destination location, and the second time that the second vehicle completed use of the destination location,

wherein the steps of receiving, determining, indicating and comparing are performed by one or more processors.

2. The method of claim 1, wherein the traffic control signal is a traffic light.

3. The method of claim 2, wherein the violation of the traffic restriction within the intersection is movement of the first vehicle within the intersection when the traffic light is late amber or red.

4. The method of claim 2, wherein the violation of the traffic restriction within the intersection is stoppage of the first vehicle within the intersection when the traffic light is red.

5. The method of claim 4, wherein determining that the first vehicle is stopped within the intersection when the traffic light is red comprises determining that the first vehicle is stationary within the intersection for greater than or equal to a predetermined period of time when the traffic light is red.

6. The method of claim 1, wherein determining that the first vehicle is violating the traffic restriction within the intersection comprises determining that a portion of at least one of the two or more first images corresponding to the first vehicle is within a portion of the at least one of the two or more second images corresponding to the intersection.

7. The method of claim 1, wherein indicating the first unique identifier of the first vehicle and the traffic restriction that the first vehicle is violating comprises indicating a fine associated with the violation of the traffic restriction by the first vehicle.

8. The method of claim 1, wherein indicating the first unique identifier of the first vehicle and the traffic restriction that the first vehicle is violating comprises requesting retention of at least one of the two or more first images used to determine that the first vehicle is violating the traffic restriction within the intersection.

9. The method of claim 1, further comprising:

automatically identifying a mailing address associated with the first unique identifier of the first vehicle without user interaction; and

automatically generating a citation requesting payment of a fee associated with the violation of the traffic restriction by the first vehicle without user interaction.

10. The method of claim 1, wherein the two or more second images from the second camera further show another intersection having a second traffic control signal and a third vehicle, the method further comprising:

determining, based on the two or more second images, a third unique identifier of the third vehicle;

determining, based on the two or more second images, that the third vehicle is violating a traffic restriction within the other intersection; and

indicating, in response to the determination that the third vehicle is violating the traffic restriction within the other intersection, the third unique identifier of the third vehicle and the traffic restriction that the third vehicle is violating.

11. The method of claim 1, wherein the two or more third images from the third camera further show another intersection having a second traffic control signal and a third vehicle, the method further comprising:

determining, based on the two or more third images, a third unique identifier of the third vehicle;

determining, based on the two or more third images, that the third vehicle is violating a traffic restriction within the other intersection; and

indicating, in response to the determination that the third vehicle is violating the traffic restriction within the other intersection, the third unique identifier of the third vehicle and the traffic restriction that the third vehicle is violating.

12. The method of claim 1, wherein:

the first unique identifier of the first vehicle are alphanumeric symbols of the license plate number of the first vehicle; and

the second unique identifier of the second vehicle are alphanumeric symbols of the license plate number of the second vehicle.

13. The method of claim 1, wherein:

the first characteristic of the second vehicle comprises a first static characteristic of the second vehicle and a first dynamic characteristic of the second vehicle; and

the second characteristic of the second vehicle comprises a second static characteristic of the second vehicle and a second dynamic characteristic of the second vehicle.

14. The method of claim 13, wherein

the first static characteristic of the second vehicle and the second static characteristic of the second vehicle are characteristics of the second vehicle that do not change over time;

and

the first dynamic characteristic of the second vehicle and the second dynamic characteristic of the second vehicle are characteristics of the second vehicle that change over time.

15. The method of claim 13, wherein:

the first static characteristic of the second vehicle is one or more of a vehicle make, a vehicle model, a vehicle year, a vehicle color, a vehicle outline, a vehicle size, and a vehicle dimension; and

the second static characteristic of the second vehicle is one or more of a vehicle make, a vehicle model, a vehicle year, a vehicle color, a vehicle outline, a vehicle size, and a vehicle dimension.

16. The method of claim 13, wherein:

the first dynamic characteristic of the second vehicle is one or more of a vehicle speed of travel, a lane identifier, and a vehicle direction of travel; and

the second dynamic characteristic of the second vehicle is one or more of a vehicle speed of travel, a lane identifier, and a vehicle direction of travel.

17. The method of claim 1, wherein:

the first characteristic of the second vehicle comprises two or more first static characteristics of the second vehicle; and

the second characteristic of the second vehicle comprises two or more second static characteristics of the second vehicle.

18. The method of claim 17, wherein determining that the second characteristic of the second vehicle is approximately equal to the first characteristic of the second vehicle comprises determining that each of the two or more second static characteristics of the second vehicle are approximately equal to each of the corresponding two or more first static characteristics of the second vehicle.

19. The method of claim 17, wherein determining that the second characteristic of the second vehicle is approximately equal to the first characteristic of the second vehicle comprises determining that at least one of the two or more second static characteristics of the second vehicle is approximately equal to at least one of the two or more first static characteristics of the second vehicle.

20. The method of claim 1, wherein the second field of view of the second camera partially overlaps with the first field of view of the first camera.

21. The method of claim 1, further comprising:

determining a cost for the second vehicle to occupy the destination location from the first time to the second time; and

charging the cost to an account associated with the second vehicle.

22. The method of claim 1, further comprising:

determining a cost for the second vehicle to occupy the destination location from the first time to the second time; and

receiving payment information for the cost from a third-party parking payment system.

23. The method of claim 22, wherein the third-party parking payment system is a third-party pay-by-phone parking payment system, a third-party pay-by-space parking payment system, a third-party pay-and-display parking payment system, or a third-party curbside parking meter payment system.

24. The method of claim 1, further comprising:

obtaining payment information for the destination location from a third-party parking payment system, the payment information specifying a period of time for which payment was received by the third-party parking payment system for use of the destination location by the second vehicle; and

determining that the use of the destination location by the second vehicle from the first time to the second time is outside of the period of time received from the third-party parking payment system.

25. The method of claim 24, further comprising:

providing, in response to the determination that the use of the destination location by the second vehicle from the first time to the second time is outside of the period of time received from the third-party parking payment system, data comprising the second unique identifier of the second vehicle, the period of time received from the third-party parking payment system, an identifier of the destination location, the first time, and the second time.

26. The method of claim 1, wherein the destination location comprises a plurality of directly adjacent destination locations.

27. The method of claim 1, further comprising:

obtaining a description of one or more restrictions for use of the destination location;

determining that the use of the destination location by the second vehicle from the first time to the second time violates at least one of the one or more restrictions; and

indicating the at least one of the one or more restrictions violated by the second vehicle.

28. The method of claim 1, wherein determining that the second vehicle is stopped in the destination location at the first time comprises determining that the second vehicle is stationary in the destination location for greater than or equal to a predetermined period of time.

29. A system for tracking traffic violations within an intersection and use of a destination location, the system comprising one or more processors connected to at least one storage device, the system being configured to:

receive two or more first images from a first camera having a first field of view, the two or more first images showing an intersection having a traffic control signal and a first vehicle;

receive two or more second images from a second camera having a second field of view, the two or more second images showing a second vehicle, the second camera being different from the first camera, and the second field of view being different from the first field of view;

receive two or more third images from a third camera having a third field of view, the two or more third images showing a destination location and the second vehicle, the third camera being different from the second camera, and the third field of view being different from and partially overlapping with the second field of view;

determine, based on the two or more first images, a first unique identifier of the first vehicle;

determine, based on the two or more first images, that the first vehicle is violating a traffic restriction within the intersection;

indicate, in response to the determination that the first vehicle is violating the traffic restriction within the intersection, the first unique identifier of the first vehicle and the traffic restriction that the first vehicle is violating;

determine, based on the two or more second images, a second unique identifier and a first characteristic of the second vehicle;

determine, based on the two or more third images, a second characteristic of the second vehicle;

compare the second characteristic of the second vehicle to the first characteristic of the second vehicle;

determine, in response to the comparison of the second characteristic of the second vehicle and the first characteristic of the second vehicle, that the second characteristic of the second vehicle is approximately equal to the first characteristic of the second vehicle;

determine, in response to the approximate equivalence between the second characteristic of the second vehicle and the first characteristic of the second vehicle, that the second vehicle is present in the third field of view of the third camera;

determine, based on the two or more third images, that the second vehicle is stopped in the destination location at a first time;

determine, based on the two or more third images, that the second vehicle has left the destination location at a second time that is after the first time; and

indicate, in response to the determination that the second vehicle has left the destination location, the unique identifier of the second vehicle, the first time that the second vehicle began use of the destination location, and the second time that the second vehicle completed use of the destination location.

30. A storage device storing a computer program for tracking traffic violations within an intersection and use of a destination location, the computer program comprising one or more code segments that, when executed, cause one or more processors to:

receive two or more first images from a first camera having a first field of view, the two or more first images showing an intersection having a traffic control signal and a first vehicle;

receive two or more second images from a second camera having a second field of view, the two or more second images showing a second vehicle, the second camera being different from the first camera, and the second field of view being different from the first field of view;

receive two or more third images from a third camera having a third field of view, the two or more third images showing a destination location and the second vehicle, the third camera being different from the second camera, and the third field of view being different from and partially overlapping with the second field of view;

determine, based on the two or more first images, a first unique identifier of the first vehicle;

determine, based on the two or more first images, that the first vehicle is violating a traffic restriction within the intersection;

indicate, in response to the determination that the first vehicle is violating the traffic restriction within the intersection, the first unique identifier of the first vehicle and the traffic restriction that the first vehicle is violating;

determine, based on the two or more second images, a second unique identifier and a first characteristic of the second vehicle;

determine, based on the two or more third images, a second characteristic of the second vehicle;

compare the second characteristic of the second vehicle to the first characteristic of the second vehicle;

determine, in response to the comparison of the second characteristic of the second vehicle and the first characteristic of the second vehicle, that the second characteristic of the second vehicle is approximately equal to the first characteristic of the second vehicle;

determine, in response to the approximate equivalence between the second characteristic of the second vehicle and the first characteristic of the second vehicle, that the second vehicle is present in the third field of view of the third camera;

determine, based on the two or more third images, that the second vehicle is stopped in the destination location at a first time;

determine, based on the two or more third images, that the second vehicle has left the destination location at a second time that is after the first time; and

indicate, in response to the determination that the second vehicle has left the destination location, the unique identifier of the second vehicle, the first time that the second vehicle began use of the destination location, and the second time that the second vehicle completed use of the destination location.