Vehicle identification based on machine-readable optical marker

• US 10,796,567 B1
• Filed: 04/17/2019
• Issued: 10/06/2020
• Est. Priority Date: 04/17/2019
• Status: Active Grant

• Current Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Original Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Inventors: Tang, Qiaochu, Wylie, Stephen, Price, Micah, Hoover, Jason, Dagley, Geoffrey
• Primary Examiner(s): Tran, Khoi H
• Assistant Examiner(s): King, Rodney P
• Application Number:
  US16/387,154
• Publication Number:
  US 20200334977A1
• Time in Patent Office: 538 Days
• Field of Search: 701117
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06K 19/0614 the marking being selective to wavelength, e.g. color barcode or barcodes only visible under UV or IR methods or arrangements for sensing record carriers using a selected wavelength, see G06K7/12
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G08G 1/0116 from roadside infrastructure, e.g. beacons
• CPC Class Codes: G08G 1/017 identifying vehicles G08G1/015, G08G1/054 take precedence
• CPC Class Codes: G08G 1/0175 by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: G08G 1/052 with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication
• CPC Class Codes: G08G 1/207 with respect to certain areas, e.g. forbidden or allowed areas with possible alerting when inside or outside boundaries

Abstract

Various aspects generally relate to identifying a vehicle based on a machine-readable optical marker. In some implementations, a server device may receive one or more images of an object and metadata related thereto. In some implementations, based upon the one or more images, an image processing engine may identify at least one non-visible spectrum marker on a surface of the object (e.g., a machine-readable optical marker that encodes information associated with the object). The server device may determine that the object depicted in the one or more images corresponds to a particular vehicle based on the information encoded by the machine-readable optical marker corresponding to an identifier associated with the particular vehicle. Accordingly, the server device may associate information identifying the particular vehicle with information identifying a location based on the metadata related to the one or more images to permit subsequent determination of the location of the particular vehicle.

Claims

1. A method, comprising:

receiving, at a server device, information related to one or more images of an object;

identifying, using an image processing engine associated with the server device, two or more optical markers depicted in the one or more images of the object,

wherein the two or more optical markers are disposed over a surface of the object;

comparing, using the image processing engine associated with the server device, the two or more optical markers to stored information associated with a set of objects to determine a match of the two or more optical markers to corresponding stored information associated with a matching object;

assigning, by the server device, an object identifier to the object depicted in the one or more images based on the match of the two or more optical markers to the corresponding stored information associated with the matching object;

identifying, by the server device, a location of the object based on the information related to the one or more images of the object,

wherein the location of the object is identified based on a location of a camera that captured the one or more images of the object in combination with an angle at which the camera was positioned relative to the object depicted in the one or more images;

associating, by the server device, one or more of the object or the object identifier with information identifying the location to permit the location of the object to be tracked; and

transmitting, by the server device and to a client device, information associated with the object identifier based on a request from the client device,

wherein the object is a vehicle, and

wherein the object identifier is associated with descriptive information about the vehicle.

2. The method of claim 1, wherein the two or more optical markers comprise repeated instances of a machine-readable optical marker forming a pattern on the surface of the object.

3. The method of claim 2, wherein the information related to the one or more images includes multiple partial images of the machine-readable optical marker, and

wherein the method further comprises:

stitching the multiple partial images into a single image depicting at least one complete instance of the machine-readable optical marker; and

determining that the one or more images relate to the object based on determining that the at least one complete instance of the machine-readable optical marker encodes the object identifier assigned to the object.

4. The method of claim 1, wherein the two or more optical markers are formed from a non-visible spectrum material that is not visible to a human eye.

5. The method of claim 4, wherein the non-visible spectrum material comprises one or more of an infrared coating, an ultraviolet coating, or a light-reflective coating.

6. The method of claim 1, further comprising:

transmitting, to the client device, information indicating that the object was observed at the identified location at a time when the camera captured the one or more images.

7. The method of claim 1,

wherein the object identifier comprises one or more of a vehicle identification number or a license plate number associated with the vehicle.

8. The method of claim 7, wherein the object identifier is used to index information associated with a registered user of the vehicle and the descriptive information about the vehicle.

9. A server device, comprising:

a memory; and

one or more processors operatively coupled to the memory, the memory and the one or more processors configured to;

receive one or more images of an object and metadata related to the one or more images,

wherein the metadata related to the one or more images includes one or more of a location of a camera that captured the one or more images of the object, an angle at which the camera was positioned relative to the object depicted in the one or more images, or a time when the camera captured the one or more images;

identify, via an image processing engine and based upon the one or more images, at least one non-visible spectrum optical marker on a surface of the object,

wherein the at least one non-visible spectrum optical marker is a machine-readable optical marker that encodes information associated with the object;

determine that the object depicted in the one or more images corresponds to a particular vehicle based on the information encoded by the machine-readable optical marker corresponding to an identifier associated with the particular vehicle;

associate information identifying the particular vehicle with information identifying a location based on the metadata related to the one or more images to permit subsequent determination of the location of the particular vehicle; and

transmit, to a client device, information associated with the identifier associated with the particular vehicle based on a request from the client device,

wherein the identifier associated with the particular vehicle is associated with descriptive information about the particular vehicle.

10. The server device of claim 9, wherein the at least one non-visible spectrum optical marker includes a plurality of non-visible spectrum optical markers formed in a pattern on multiple surfaces of the particular vehicle.

11. The server device of claim 9, wherein:

the at least one non-visible spectrum optical marker is subjected to a homographic transformation prior to application to the surface of the object, and

the memory and the one or more processors are configured to identify the at least one non-visible spectrum optical marker by solving an inverse of the homographic transformation.

12. The server device of claim 9, wherein the one or more images include multiple partial images of the machine-readable optical marker, and

wherein the memory and the one or more processors are further configured to:

stitch the multiple partial images into a single image depicting a complete instance of the machine-readable optical marker; and

identify the information encoded by the machine-readable optical marker based on the complete instance of the machine-readable optical marker.

13. The server device of claim 9, wherein the information encoded by the machine-readable optical marker is used to index one or more of a vehicle identification number associated with the particular vehicle, a license plate number associated with the particular vehicle, information associated with a registered user of the particular vehicle, or the descriptive information about the particular vehicle.

14. The server device of claim 13, wherein the memory and the one or more processors are further configured to transmit, to the client device, a timestamped location associated with the particular vehicle based on the request from the client device including one or more search parameters matched to the information encoded by the machine-readable optical marker.

15. The server device of claim 9, wherein the memory and the one or more processors are further configured to process a transaction based on a timestamped location associated with the particular vehicle.

16. A non-transitory computer-readable medium storing one or more instructions, the one or more instructions comprising:

one or more instructions that, when executed by one or more processors of a server device, cause the one or more processors to;

receive information indicating that a camera having non-visible spectrum imaging capabilities captured one or more images depicting a plurality of machine-readable optical markers disposed over an exterior surface of a vehicle;

determine that the plurality of machine-readable optical markers are associated with an encoded identifier associated with a group of vehicles;

match the received information to corresponding stored information associated with the group of vehicles based on the encoded identifier; and

transmit, to a client device;

information indicating that the vehicle is a member of the group of vehicles based on matching the received information to the group of vehicles, and

information associated with the encoded identifier based on a request from the client device,

wherein the encoded identifier is associated with descriptive information about the vehicle.

17. The non-transitory computer-readable medium of claim 16, wherein the plurality of machine-readable optical markers are formed from a non-visible spectrum material that comprises one or more of an infrared coating, an ultraviolet coating, or a light-reflective coating.

18. The non-transitory computer-readable medium of claim 16, wherein the plurality of machine-readable optical markers are a plurality of two-dimensional barcodes.

19. The non-transitory computer-readable medium of claim 16, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

identify a location of the vehicle based on a location of the camera that captured the one or more images in combination with an angle at which the camera was positioned when the camera captured the one or more images; and

transmit, to the client device, information to indicate the identified location of the vehicle.

20. The non-transitory computer-readable medium of claim 19, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to transmit, to the client device, information to indicate whether the vehicle is authorized to be at the identified location.