Human Review of an Image Stream for a Parking Camera System

• US 20140236786A1
• Filed: 04/28/2014
• Published: 08/21/2014
• Est. Priority Date: 08/06/2012
• Status: Active Grant

• Current Assignee: Cloudparc, Inc.
• Original Assignee: Cloudparc, Inc.
• Inventors: Nerayoff, Steven David, Wong, Thompson S.
• Granted Patent: US 9,652,666 B2
• Time in Patent Office: Days
• US Class Current: 705/34
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 20/02 involving a neutral party, e.g. certification authority, notary or trusted third party [TTP]
• CPC Class Codes: G06Q 20/145 Payments according to the detected use or quantity
• CPC Class Codes: G06Q 30/0284 Time or distance, e.g. usage of parking meters or taximeters
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/625 : License plates
• CPC Class Codes: G06V 30/224 : of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 40/23 : Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G07B 15/00 : Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points handling coins or valuable papers, e.g. banknotes, G07D; apparatus for vending or hiring articles or services activated by coins, credit cards, paper currency or the like G07F7/00, G07F17/00
• CPC Class Codes: G07B 15/02 : taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems G07B15/06 takes precedence; taximeters G07B13/00; parking meters per se G07F17/24; car rental systems per se G07B15/00
• CPC Class Codes: G07F 17/24 : for parking meters
• CPC Class Codes: G08G 1/00 : Traffic control systems for road vehicles arrangement of road signs or traffic signals E01F9/00 ; automatic vehicle control B62D
• CPC Class Codes: G08G 1/017 : identifying vehicles G08G1/015, G08G1/054 take precedence
• CPC Class Codes: G08G 1/0175 : by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/052 : with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/056 : with provision for distinguishing direction of travel
• CPC Class Codes: G08G 1/133 : within the vehicle ; Indicators inside the vehicles or at stops
• CPC Class Codes: G08G 1/14 : indicating individual free spaces in parking areas
• CPC Class Codes: G08G 1/142 : external to the vehicles
• CPC Class Codes: G08G 1/143 : inside the vehicles
• CPC Class Codes: G08G 1/144 : on portable or mobile units, e.g. personal digital assistant [PDA]
• CPC Class Codes: G08G 1/146 : where the parking area is a limited parking space, e.g. parking garage, restricted space
• CPC Class Codes: G08G 1/148 : Management of a network of parking areas
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

Providing human review of an image stream for a parking camera system is disclosed. Initially, a first image stream is received from a first camera having a first field of view showing a first vehicle or at least one destination location. Next, it is determined that a value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected. In response, an exemption event is generated. Presentation of the at least part of the first image stream to a human operator is then enabled. Finally, the value for the at least one type of information relating to the at least one destination location or the first vehicle is received from the human operator.

Claims

1. A method of providing human review of an image stream for a parking camera system, the method comprising:

receiving a first image stream from a first camera having a first field of view, at least part of the first image stream showing a first vehicle or at least one destination location;

determining, based on the at least part of the first image stream, that a value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected;

generating, in response to the determination that the value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected, an exemption event;

enabling, in response to the generation of the exemption event, presentation of the at least part of the first image stream to a human operator; and

receiving, from the human operator in response to enablement of the presentation of the at least part of the first image stream, the value for the at least one type of information relating to the at least one destination location or the first vehicle,

wherein the steps of receiving, determining, generating, and enabling are performed by one or more processors.

2. The method of claim 1, wherein:

the value for the at least one type of information relating to the at least one destination location or the first vehicle is a license plate identifier of the first vehicle; and

receiving the value for the at least one type of information relating to the at least one destination location or the first vehicle comprises receiving alphanumeric characters of the license plate identifier of the first vehicle.

3. The method of claim 1, wherein:

the first field of view includes a parking meter adjacent to the at least one destination location;

the value for the at least one type of information relating to the at least one destination location or the first vehicle is a status of an expiration flag of the parking meter adjacent to the at least one destination location; and

receiving the value for the at least one type of information relating to the at least one destination location or the first vehicle comprises receiving an indication that the expiration flag of the parking meter adjacent to the at least one destination location is visible.

4. The method of claim 1, wherein:

a pay-and-display ticket is visible within the first vehicle;

the value for the at least one type of information relating to the at least one destination location or the first vehicle is a bar code or printed information on the pay-and-display ticket visible within the first vehicle; and

receiving the value for the at least one type of information relating to the at least one destination location or the first vehicle comprises receiving an image of the bar code or alphanumeric characters of the printed information on the pay-and-display ticket visible within the first vehicle.

5. The method of claim 4, wherein the printed information on the pay-and-display ticket is a parking expiration time.

6. The method of claim 1, wherein the value for the at least one type of information relating to the at least one destination location or the first vehicle is information visible on a handicap parking decal, information visible on handicap parking mirror-hanger, information visible on a resident parking decal, or information visible on a vehicle registration decal.

7. The method of claim 1, further comprising receiving, from the human operator in response to enablement of the presentation of the at least part of the first image stream, a request to rewind, fast forward, pause, or freeze-frame the at least part of the first image stream.

8. The method of claim 1, further comprising receiving, from the human operator in response to enablement of the presentation of the at least part of the first image stream, a request to zoom in or zoom out on an area of interest within the at least part of the first image stream.

9. The method of claim 1, further comprising:

receiving, from the human operator in response to enablement of the presentation of the at least part of the first image stream, a request to adjust the field of view of the first camera by changing the pan, tilt, or zoom of the first camera;

receiving, in response to reception of the request to adjust the field of view of the first camera, a second image stream from the first camera having a second field of view that is different from the first field of view; and

enabling, in response to the reception of the second image stream from the first camera, presentation of at least part of the second image stream to the human operator.

10. The method of claim 9, wherein receiving the value for the at least one type of information relating to the at least one destination location or the first vehicle comprises receiving, from the human operator in response to enablement of the presentation of the at least part of the second image stream, the value for the at least one type of information relating to the at least one destination location or the first vehicle.

11. The method of claim 1, further comprising receiving, from the human operator in response to enablement of the presentation of the at least part of the first image stream, a request for personnel to perform an inspection relating to the at least one destination location or the first vehicle.

12. The method of claim 11, further comprising:

identifying, in response to reception of the request for the personnel to perform inspection relating to the at least one destination location or the first vehicle, personnel to perform the inspection based on the location of the at least one destination location; and

notifying the personnel that the first vehicle is at the at least one destination location.

13. The method of claim 11, further comprising receiving, from a mobile phone carried by the personnel, one or more images of the area surrounding the at least one destination location or the first vehicle.

14. The method of claim 1, wherein enabling presentation of the at least part of the first image stream to the human operator comprises simultaneously forwarding the at least part of the first image stream to multiple different locations.

15. The method of claim 1, wherein enabling presentation of the at least part of the first image stream to the human operator comprises forwarding the at least part of the first image stream using an Internet Protocol communications protocol.

16. The method of claim 1, wherein enabling presentation of the at least part of the first image stream to the human operator comprises displaying the at least part of the first image stream to the human operator.

17. The method of claim 1, further comprising enabling presentation of a unique identifier of the at least one destination location.

18. The method of claim 1, further comprising:

receiving a third image stream from a second camera having a second field of view, the second field of view being different from and at least partially overlapping with the first field of view, and at least part of the second image stream showing the first vehicle or the at least one destination location; and

enabling, in response to the generation of the exemption event, presentation of the at least part of the second image stream to the human operator.

19. The method of claim 1, further comprising:

determining, based on the first image stream, one or more static characteristics of the first vehicle that do not change over time.

20. The method of claim 19, wherein the one or more static characteristics are one or more of a vehicle make, a vehicle model, a vehicle year, a vehicle color, a vehicle outline, a vehicle size, and a vehicle dimension.

21. The method of claim 1, further comprising:

determining, based on at least one frame of the first image stream, that the first vehicle is stopped within the at least one destination location at a first time;

determining, based on at least another frame of the first image stream, that the first vehicle has left the at least one destination location at a second time that is after the first time;

indicating that the first vehicle began use of the destination location at the first time; and

indicating that the first vehicle completed use of the destination location at the second time.

22. The method of claim 1, further comprising indicating, in response to the reception of the value for the at least one type of information relating to the at least one destination location or the first vehicle, a first unique identifier of the first vehicle, an identifier of the at least one destination location, and a type of parking violation by the first vehicle within the at least one destination location.

23. The method of claim 1, wherein the first vehicle is stopped within the at least one destination location, the method further comprising determining, in response to the reception of the value for the at least one type of information relating to the at least one destination location or the first vehicle, a cost for the first vehicle to occupy the at least one destination location or a fine for violation of one or more rules associated with the at least one destination location.

24. The method of claim 23, wherein the cost for the first vehicle to occupy the at least one destination location is determined, the method further comprising:

identifying a mailing address associated with an owner of the first vehicle; and

automatically generating, in response to identification of the mailing address associated with the owner of the first vehicle, a citation requesting payment of the cost for the first vehicle to occupy the at least one destination location or the fine for violation of one or more rules associated with the at least one destination location.

25. The method of claim 24, wherein identifying the mailing address associated with the owner of the first vehicle comprises automatically determining a license plate identifier of the first vehicle based on the at least part of the first image stream without human interaction.

26. The method of claim 24, wherein identifying the mailing address associated with the owner of the first vehicle comprises receiving a license plate identifier of the first vehicle from the human operator.

27. The method of claim 23, further comprising charging, in response to the determination of the cost for the first vehicle to occupy the at least one destination location or the fine for violation of one or more rules associated with the at least one destination location, the cost or the fine to an account associated with the first vehicle.

28. The method of claim 27, wherein charging the cost or the fine to the account associated with the first vehicle comprises charging the cost or the fine to a stored credit card in the account associated with the first vehicle.

29. A system for providing human review of an image stream for a parking camera system, the system comprising one or more processors connected to at least one storage device, and the system being configured to:

receive a first image stream from a first camera having a first field of view, at least part of the first image stream showing a first vehicle or at least one destination location;

determine, based on the at least part of the first image stream, that a value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected;

generate, in response to the determination that the value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected, an exemption event;

enable, in response to the generation of the exemption event, presentation of the at least part of the first image stream to a human operator; and

receive, from the human operator in response to enablement of the presentation of the at least part of the first image stream, the value for the at least one type of information relating to the at least one destination location or the first vehicle.

30. A storage device storing a computer program for providing human review of an image stream for a parking camera system, the computer program comprising one or more code segments that, when executed, cause one or more processors to:

receive a first image stream from a first camera having a first field of view, at least part of the first image stream showing a first vehicle or at least one destination location;

determine, based on the at least part of the first image stream, that a value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected;

generate, in response to the determination that the value for the at least one type of information relating to the at least one destination location or the first vehicle has failed to be automatically detected, an exemption event;

enable, in response to the generation of the exemption event, presentation of the at least part of the first image stream to a human operator; and

receive, from the human operator in response to enablement of the presentation of the at least part of the first image stream, the value for the at least one type of information relating to the at least one destination location or the first vehicle.