Association of unique person to point-of-sale transaction data
First Claim
1. A method for associating at least an image of a face of at least a person with Point-of-Sale (PoS) data by aligning a first event time series with a second event time series based on a dynamic time disparity, and utilizing at least a camera and at least a processor for executing the steps comprising:
- a. generating a first event time series using an Event Time Series Generation module,b. generating a second event time series using the Event Time Series Generation module,c. aligning the first event time series with the second event time series based on the dynamic time disparity between the time series, using an Event Time Series Clock Alignment module, comprising the steps of;
i. performing a dynamic time warping to find a warping path between corresponding events between the first event time series and the second event time series, wherein the dynamic time warping can be one of a discrete dynamic time warping or a continuous dynamic time warping,ii. checking for convergence by determining whether the standard deviation of a time difference between corresponding events in the first event time series and the second event time series is less than a predetermined threshold,iii. adjusting the time index of the second event time series based on the time disparity between the event time series,iv. testing the alignment of the time series to see if the best alignment has been obtained,v. sorting the corresponding events based on the time disparity between events, and removing outliers that have a time disparity greater than a threshold, andvi. repeating the Event Time Series Clock Alignment module steps until the best alignment is obtained,d. matching first time series events with second time series events based on the alignment of the time series, using an Event Matching module,e. registering face images from a series of checkout events to a series of PoS events using a Face-to-PoS Registration module, andf. storing the time series and registration data in a database.
12 Assignments
0 Petitions
Accused Products
Abstract
A method and system for associating an image of a face of at least a person with Point-of-Sale (PoS) data by aligning a first event time series with a second event time series based on a dynamic time disparity. An exemplary embodiment can generate an event time series containing facial recognition data for a person or persons during the PoS transaction process. These data can form a vision-based checkout event time series. An embodiment can also collect PoS transaction data from the retail checkout system, using timestamp information to create a second event time series. As there may be a time disparity between the time series, they can then be aligned in order to match events from one time series to the other. Faces identified in checkout events in the first time series can be registered to PoS events and the results stored in a database.
-
Citations
16 Claims
-
1. A method for associating at least an image of a face of at least a person with Point-of-Sale (PoS) data by aligning a first event time series with a second event time series based on a dynamic time disparity, and utilizing at least a camera and at least a processor for executing the steps comprising:
-
a. generating a first event time series using an Event Time Series Generation module, b. generating a second event time series using the Event Time Series Generation module, c. aligning the first event time series with the second event time series based on the dynamic time disparity between the time series, using an Event Time Series Clock Alignment module, comprising the steps of; i. performing a dynamic time warping to find a warping path between corresponding events between the first event time series and the second event time series, wherein the dynamic time warping can be one of a discrete dynamic time warping or a continuous dynamic time warping, ii. checking for convergence by determining whether the standard deviation of a time difference between corresponding events in the first event time series and the second event time series is less than a predetermined threshold, iii. adjusting the time index of the second event time series based on the time disparity between the event time series, iv. testing the alignment of the time series to see if the best alignment has been obtained, v. sorting the corresponding events based on the time disparity between events, and removing outliers that have a time disparity greater than a threshold, and vi. repeating the Event Time Series Clock Alignment module steps until the best alignment is obtained, d. matching first time series events with second time series events based on the alignment of the time series, using an Event Matching module, e. registering face images from a series of checkout events to a series of PoS events using a Face-to-PoS Registration module, and f. storing the time series and registration data in a database. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system for associating at least an image of a face of at least a person with Point-of-Sale (PoS) data by aligning a first event time series with a second event time series based on a dynamic time disparity, and utilizing at least a camera and at least a processor for executing the steps comprising:
-
a. generating a first event time series using an Event Time Series Generation module, b. generating a second event time series using the Event Time Series Generation module, c. aligning the first event time series with the second event time series based on the dynamic time disparity between the time series, using an Event Time Series Clock Alignment module, d. comprising the steps of; i. performing a dynamic time warping to find a warping path between corresponding events between the first event time series and the second event time series, wherein the dynamic time warping can be one of a discrete dynamic time warping or a continuous dynamic time warping, ii. checking for convergence by determining whether the standard deviation of a time difference between corresponding events in the first event time series and the second event time series is less than a predetermined threshold, iii. adjusting the time index of the second event time series based on the time disparity between the event time series, iv. testing the alignment of the time series to see if the best alignment has been obtained, v. sorting the corresponding events based on the time disparity between events, and removing outliers that have a time disparity greater than a threshold, and vi. repeating the Event Time Series Clock Alignment module steps until the best alignment is obtained, e. matching first time series events with second time series events based on the alignment of the time series, using an Event Matching module, f. registering face images from a series of checkout events to a series of PoS events using a Face-to-PoS Registration module, and g. storing the time series and registration data in a database. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
Specification