Controlling use of parking spaces using multiple cameras

• US 8,698,895 B2
• Filed: 11/27/2012
• Issued: 04/15/2014
• Est. Priority Date: 08/06/2012
• Status: Active Grant

• Current Assignee: Cloudparc, Inc.
• Original Assignee: Cloudparc, Inc.
• Inventors: Nerayoff, Steven David, Wong, Thompson S.
• Primary Examiner(s): Dastouri, Mehrdad
• Assistant Examiner(s): ANDERSON II, JAMES M
• Application Number:
  US13/686,802
• Publication Number:
  US 20140036076A1
• Time in Patent Office: 504 Days
• Field of Search: None
• US Class Current: 348/148
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 20/02 involving a neutral party, e.g. certification authority, notary or trusted third party [TTP]
• CPC Class Codes: G06Q 20/145 Payments according to the detected use or quantity
• CPC Class Codes: G06Q 30/0284 Time or distance, e.g. usage of parking meters or taximeters
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G06V 20/62 : Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/625 : License plates
• CPC Class Codes: G06V 30/224 : of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 40/23 : Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G07B 15/00 : Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points handling coins or valuable papers, e.g. banknotes, G07D; apparatus for vending or hiring articles or services activated by coins, credit cards, paper currency or the like G07F7/00, G07F17/00
• CPC Class Codes: G07B 15/02 : taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems G07B15/06 takes precedence; taximeters G07B13/00; parking meters per se G07F17/24; car rental systems per se G07B15/00
• CPC Class Codes: G07F 17/24 : for parking meters
• CPC Class Codes: G08G 1/00 : Traffic control systems for road vehicles arrangement of road signs or traffic signals E01F9/00 ; automatic vehicle control B62D
• CPC Class Codes: G08G 1/017 : identifying vehicles G08G1/015, G08G1/054 take precedence
• CPC Class Codes: G08G 1/0175 : by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/052 : with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/056 : with provision for distinguishing direction of travel
• CPC Class Codes: G08G 1/133 : within the vehicle ; Indicators inside the vehicles or at stops
• CPC Class Codes: G08G 1/14 : indicating individual free spaces in parking areas
• CPC Class Codes: G08G 1/142 : external to the vehicles
• CPC Class Codes: G08G 1/143 : inside the vehicles
• CPC Class Codes: G08G 1/144 : on portable or mobile units, e.g. personal digital assistant [PDA]
• CPC Class Codes: G08G 1/146 : where the parking area is a limited parking space, e.g. parking garage, restricted space
• CPC Class Codes: G08G 1/148 : Management of a network of parking areas
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A method of tracking the use of at least one destination location, the method including identifying a vehicle by use of identification images captured by an identification camera, such as by processing of images of license plates, determining characteristics of the vehicle visible in the identification images, and determining usage of a destination location, such as a parking spot, based on a camera monitoring the destination location capturing images of the vehicle having characteristics corresponding to those determined for the identification images.

Claims

1. A method of tracking the use of at least one destination location, the method comprising:

receiving a plurality of vehicle images captured by a plurality of cameras, wherein;

each vehicle image includes an image of a first vehicle,

the plurality of cameras include a first identification camera having a first field of view,

the plurality of cameras include a first destination camera having a second field of view, the second field of viewing being different from the first field of view and partially overlapping with the first field of view, at least part of the partially overlapping region corresponding to a handoff region,

the plurality of cameras include a second destination camera having a third field of view, the second destination camera being different from the first destination camera, the third field of viewing being different from the first and second fields of view, and the third field of view including at least one destination location, and

the vehicle images include;

a first identification image captured by the first identification camera at a first time showing the first vehicle at a first location,

a second identification image captured by the first identification camera at a second time showing the first vehicle at a second location, the second time being after the first time, and the second location being in the handoff region,

a first destination image captured by the first destination camera at the second time showing the first vehicle at the second location in the handoff region,

a second destination image captured by the second destination camera at a third time showing the first vehicle at a third location, the third time being after the second time, and the third location being outside of the at least one destination location,

a third destination image captured by the second destination camera at a fourth time showing the first vehicle at a fourth location, the fourth time being after the third time, and the fourth location being within the at least one destination location, and

a fourth destination image captured by the second destination camera at a fifth time showing the first vehicle at a fifth location, the fifth time being after the fourth time, the fifth location being outside of the at least one destination location, and the fifth location different from the third location;

determining a unique identifier and a first characteristic of the first vehicle based on the first identification image;

determining that the first vehicle is at the second location in the handoff region based on the second identification image;

determining a second characteristic of the first vehicle based on the first destination image;

determining that the first vehicle is present in the second field of view based on a comparison of the second characteristic to the first characteristic;

determining a third characteristic of the first vehicle based on the second destination image;

determining that the first vehicle is present in the third field of view based on a comparison of the third characteristic to the second characteristic;

determining that the first vehicle is occupying the at least one destination location based on the third destination image;

determining that the first vehicle has left the at least one destination location based on the fourth destination image;

indicating that the first vehicle began use of the at least one destination location at the fourth time;

indicating that the first vehicle completed use of the at least one destination location at the fifth time; and

indicating the unique identifier of the first vehicle,

wherein the steps of receiving, determining, and indicating are performed by one or more processors.

2. The method of claim 1, wherein the second characteristic is:

a speed of travel,

a direction of travel,

a position of a vehicle in a vehicle image,

a vehicle color, or

a vehicle size or dimension.

3. The method of claim 1, wherein:

the first vehicle is a first wheeled motor vehicle;

the at least one destination location is at least one parking space;

the unique identifier is a license plate; and

determining the unique identifier of the first vehicle comprises;

identifying an image of the license plate attached to the first vehicle in the first identification image, and

determining the unique identifier from the image of the license plate.

4. The method of claim 1, further comprising:

receiving a reservation request for use of the at least one destination location for a period of time at least partially overlapping with the period of time between the fourth time and the fifth time; and

generating an alert indicating that use of the at least one destination location by the first vehicle conflicts with the reservation request.

5. The method of claim 1, further comprising:

receiving a fifth destination image captured by the second destination camera at a sixth time showing that the at least one destination location is unoccupied, the sixth time being after the fifth time;

determining that the at least one destination location is available based on the fifth destination image;

receiving a request for an available destination location for an area including the at least one destination location; and

indicating that the at least one destination location is available in response to the request.

6. The method of claim 1, further comprising:

receiving the plurality of vehicle images at a central server comprising at least one processor,

wherein the central server is configured to;

determine the unique identifier of the first vehicle,

determine the first characteristic of the first vehicle, and

determine the second characteristic of the first vehicle.

7. The method of claim 1, further comprising:

receiving, between the fourth time and the fifth time, a request for an available destination location;

determining, between the fourth time and the fifth time, that no destination locations are available in response to the request;

issuing a notification that the at least one destination location is available in response to the determination that the first vehicle has left the at least one destination location; and

recording, after the fifth time, that the at least one destination location is reserved for use by a party that issued the request.

8. The method of claim 1, wherein the first identification image further shows a second vehicle and a third vehicle, the method further comprising:

determining a second unique identifier and a fourth characteristic of the second vehicle based on the first identification image;

determining that the fourth characteristic does not correspond to the first characteristic;

determining a third unique identifier and a fifth characteristic of the third vehicle based on the first identification image; and

determining that the fifth characteristic does not correspond to the first characteristic.

9. The method of claim 1, further comprising:

obtaining a description of one or more restrictions for use of the at least one destination location;

determining that the use of the at least one destination location by the first vehicle between the fourth time and the fifth time violates the one or more restrictions; and

sending an alert indicating inappropriate use of the at least one destination location by the first vehicle.

10. The method of claim 1, further comprising:

obtaining a description of one or more restrictions for use of the at least one destination location;

determining that the use of the at least one destination location by the first vehicle between the fourth time and the fifth time violates the one or more restrictions; and

generating a visual notification at the at least one destination location indicating inappropriate use of the at least one destination location by the first vehicle.

11. The method of claim 1, further comprising:

obtaining a description of one or more restrictions for use of the at least one destination location that will take effect at a sixth time between the fourth time and the fifth time;

determining that the use of the at least one destination location by the first vehicle during the sixth time would violate the one or more restrictions; and

sending an alert prior to the sixth time warning that use of the at least one destination location should be completed by the sixth time.

12. The method of claim 1, further comprising:

receiving the plurality of vehicle images via a cellular data network;

transmitting, via the cellular data network, a request for an additional destination image captured by the second destination camera between the fourth time and the fifth time; and

receiving, via the cellular data network, the additional destination image.

13. The method of claim 1, wherein:

determining the unique identifier of the first vehicle comprises;

obtaining, using a processor included in the first identification camera, an alphanumeric identifier displayed on the first vehicle based on the first identification image, and

transmitting the alphanumeric identifier from the first identification camera to a server system configured to identify vehicles based on alphanumeric identifiers.

14. The method of claim 1, further comprising:

requesting retention of the first identification image used to determine the unique identifier; and

requesting retention of the third destination image showing the first vehicle within the at least one destination location.

15. The method of claim 1, wherein each of the plurality of vehicle images includes a visual timestamp indicating a time at which the respective vehicle image was captured.

16. The method of claim 1, further comprising:

receiving the plurality of vehicle images via a network at a server system;

initiating image transmission from the first identification camera via the network to the server system in response to motion detected by the first identification camera; and

initiating image transmission from the first and second destination cameras via the network to the server system in response to motion detected by the first and second destination cameras.

17. The method of claim 1, further comprising:

providing destination location usage information to a preexisting parking payment system or receiving information from the preexisting parking payment system describing payments received for use of destination locations.

18. The method of claim 1, further comprising:

obtaining a description of one or more restrictions for use of the at least one destination location;

determining that the use of the at least one destination location by the first vehicle between the fourth time and the fifth time violates the one or more restrictions;

automatically identifying a mailing address associated with the unique identifier without user interaction; and

automatically generating a citation requesting payment of a fee associated with the determined violation of the one or more restrictions without user interaction.

19. The method of claim 1, wherein determining that the first vehicle is occupying the at least one destination location is further based on a thermal image including the at least one destination location.

20. The method of claim 1, further comprising determining that the first vehicle has an expired registration based on at least one of the plurality of vehicle images.

21. The method of claim 1, further comprising:

obtaining a description of one or more restrictions for use of the at least one destination location;

determining that the use of the at least one destination location by the first vehicle between the fourth time and the fifth time violates the one or more restrictions;

identifying an enforcement officer to issue a citation for the first vehicle based on the location of the at least one destination location; and

notifying the identified enforcement officer that the first vehicle is at the at least one destination location.

22. The method of claim 1, further comprising:

receiving a request from a party to report observation of a vehicle having a target vehicle identifier;

determining that the unique identifier of the first vehicle corresponds to the target identifier; and

reporting to the party that the first vehicle was observed by the first identification camera.

23. The method of claim 1, wherein the second characteristic is a dynamic characteristic.

24. The method of claim 23, wherein the dynamic characteristic is a speed of travel or a direction of travel.

25. The method of claim 1, wherein the second characteristic is at least one dynamic characteristic and at least one static characteristic.

26. The method of claim 1, wherein the first characteristic, the second characteristic, and the third characteristic are different from the unique identifier.

27. The method of claim 26, wherein the type of first characteristic differs from the type of second characteristic.

28. The method of claim 1, further comprising automatically determining identifiers of lanes in the second identification image and the first destination image.

29. A system for tracking use of at least one destination location, the system comprising one or more processors connected to at least one storage device, the system being configured to:

receive a plurality of vehicle images captured by a plurality of cameras, wherein;

each vehicle image includes an image of a first vehicle,

the plurality of cameras include a first identification camera having a first field of view,

the plurality of cameras include a first destination camera having a second field of view, the second field of viewing being different from the first field of view and partially overlapping with the first field of view, at least part of the partially overlapping region corresponding to a handoff region,

the plurality of cameras include a second destination camera having a third field of view, the second destination camera being different from the first destination camera, the third field of viewing being different from the first and second fields of view, and the third field of view including at least one destination location, and

the vehicle images include;

a first identification image captured by the first identification camera at a first time showing the first vehicle at a first location,

a second identification image captured by the first identification camera at a second time showing the first vehicle at a second location, the second time being after the first time, and the second location being in the handoff region,

a first destination image captured by the first destination camera at the second time showing the first vehicle at the second location in the handoff region,

a second destination image captured by the second destination camera at a third time showing the first vehicle at a third location, the third time being after the second time, and the third location being outside of the at least one destination location,

a third destination image captured by the second destination camera at a fourth time showing the first vehicle at a fourth location, the fourth time being after the third time, and the fourth location being within the at least one destination location, and

a fourth destination image captured by the second destination camera at a fifth time showing the first vehicle at a fifth location, the fifth time being after the fourth time, the fifth location being outside of the at least one destination location, and the fifth location different from the third location;

determine a unique identifier and a first characteristic of the first vehicle based on the first identification image;

determining that the first vehicle is at the second location in the handoff region based on the second identification image;

determine a second characteristic of the first vehicle based on the first destination image;

determine that the first vehicle is present in the second field of view based on a comparison of the second characteristic to the first characteristic;

determine a third characteristic of the first vehicle based on the second destination image;

determine that the first vehicle is present in the third field of view based on a comparison of the third characteristic to the second characteristic;

determine that the first vehicle is occupying the at least one destination location based on the third destination image;

determine that the first vehicle has left the at least one destination location based on the fourth destination image;

indicate that the first vehicle began use of the at least one destination location at the fourth time;

indicate that the first vehicle completed use of the at least one destination location at the fifth time; and

indicate the unique identifier of the first vehicle.

30. A storage device storing a computer program for tracking use of at least one destination location, the computer program comprising one or more code segments that, when executed, cause one or more processors to:

receive a plurality of vehicle images captured by a plurality of cameras, wherein;

each vehicle image includes an image of a first vehicle,

the plurality of cameras include a first identification camera having a first field of view,

the plurality of cameras include a first destination camera having a second field of view, the second field of viewing being different from the first field of view and partially overlapping with the first field of view, at least part of the partially overlapping region corresponding to a handoff region,

the plurality of cameras include a second destination camera having a third field of view, the second destination camera being different from the first destination camera, the third field of viewing being different from the first and second fields of view, and the third field of view including at least one destination location, and

the vehicle images include;

a first identification image captured by the first identification camera at a first time showing the first vehicle at a first location,

a second identification image captured by the first identification camera at a second time showing the first vehicle at a second location, the second time being after the first time, and the second location being in the handoff region,

a first destination image captured by the first destination camera at the second time showing the first vehicle at the second location in the handoff region,

a second destination image captured by the second destination camera at a third time showing the first vehicle at a third location, the third time being after the second time, and the third location being outside of the at least one destination location,

a third destination image captured by the second destination camera at a fourth time showing the first vehicle at a fourth location, the fourth time being after the third time, and the fourth location being within the at least one destination location, and

a fourth destination image captured by the second destination camera at a fifth time showing the first vehicle at a fifth location, the fifth time being after the fourth time, the fifth location being outside of the at least one destination location, and the fifth location different from the third location;

determine a unique identifier and a first characteristic of the first vehicle based on the first identification image;

determining that the first vehicle is at the second location in the handoff region based on the second identification image;

determine a second characteristic of the first vehicle based on the first destination image;

determine that the first vehicle is present in the second field of view based on a comparison of the second characteristic to the first characteristic;

determine a third characteristic of the first vehicle based on the second destination image;

determine that the first vehicle is present in the third field of view based on a comparison of the third characteristic to the second characteristic;

determine that the first vehicle is occupying the at least one destination location based on the third destination image;

determine that the first vehicle has left the at least one destination location based on the fourth destination image;

indicate that the first vehicle began use of the at least one destination location at the fourth time;

indicate that the first vehicle completed use of the at least one destination location at the fifth time; and

indicate the unique identifier of the first vehicle.