Disambiguating between multiple users
First Claim
Patent Images
1. A computer implemented method, comprising:
- under control of one or more computing systems configured with executable instructions,in response to a detection, by one or more input components, of an occurrence of an event at an event location within a materials handling facility receiving;
an event notification that includes an indication of the event location and an event time indicating a time of the occurrence of the event;
a first user pattern location corresponding to a first user pattern at the event time; and
a second user pattern location corresponding to a second user pattern at the event time;
specifying, based on the event time, an event time window that includes the event time;
determining, based at least in part on the first user pattern location, that the first user pattern is located within a defined distance of the event location during the event time window;
determining, based at least in part on the second user pattern location, that the second user pattern is located within the defined distance of the event location during the event time window;
processing a plurality of images generated during the event time window to at least;
identify a first object positioned between the first user pattern and the event location;
determine a first trajectory information of the first object between the first user pattern and the event location;
identify a second object positioned between the second user pattern and the event location; and
determine a second trajectory information of the second object between the second user pattern and the event location;
determining, based at least in part on the first trajectory information, a first probability that the first user pattern is to be associated with the event;
determining, based at least in part on the second trajectory information, a second probability that the second user pattern is to be associated with the event;
determining, based at least in part on a difference between the first probability and the second probability, a confidence score representative of a confidence that the first user pattern is to be associated with the event;
determining that the confidence score exceeds a threshold; and
in response to determining that the confidence score exceeds the threshold, associating the event with the first user pattern.
1 Assignment
0 Petitions
Accused Products
Abstract
Described is a multiple-camera system and process for disambiguating between multiple users and identifying which of the multiple users performed an event. For example, when an event is detected, user patterns near the location of the event are determined, along with touch points at the location of the event. User pattern orientation and/or arm trajectories between the event location and the user patterns may be determined and processed to disambiguate between multiple users and determine which user pattern is involved in the event.
152 Citations
20 Claims
-
1. A computer implemented method, comprising:
under control of one or more computing systems configured with executable instructions, in response to a detection, by one or more input components, of an occurrence of an event at an event location within a materials handling facility receiving; an event notification that includes an indication of the event location and an event time indicating a time of the occurrence of the event; a first user pattern location corresponding to a first user pattern at the event time; and a second user pattern location corresponding to a second user pattern at the event time; specifying, based on the event time, an event time window that includes the event time; determining, based at least in part on the first user pattern location, that the first user pattern is located within a defined distance of the event location during the event time window; determining, based at least in part on the second user pattern location, that the second user pattern is located within the defined distance of the event location during the event time window; processing a plurality of images generated during the event time window to at least; identify a first object positioned between the first user pattern and the event location; determine a first trajectory information of the first object between the first user pattern and the event location; identify a second object positioned between the second user pattern and the event location; and determine a second trajectory information of the second object between the second user pattern and the event location; determining, based at least in part on the first trajectory information, a first probability that the first user pattern is to be associated with the event; determining, based at least in part on the second trajectory information, a second probability that the second user pattern is to be associated with the event; determining, based at least in part on a difference between the first probability and the second probability, a confidence score representative of a confidence that the first user pattern is to be associated with the event; determining that the confidence score exceeds a threshold; and
in response to determining that the confidence score exceeds the threshold, associating the event with the first user pattern.- View Dependent Claims (2, 3, 4)
-
5. A computing system, comprising:
-
a processor; and a memory coupled to the processor and storing program instructions that when executed by the processor cause the processor to at least; in response to a detection, by one or more input components, of an occurrence of an event at an event location within, a materials handling facility, receive; an event notification that includes an indication of the event location; a first user pattern location corresponding to a first user pattern; and a second user pattern location corresponding to a second user pattern; determine, based at least in part on the first user pattern location, that the first user pattern is within a defined distance of the event location; determine, based at least in part on the second user pattern location, that the second user pattern is within the defined distance of the event location; process a plurality of images that include a representation of the event location to determine an object between the event location and at least one of the first user pattern or the second user pattern; determine, based at least in part on the object and the first user pattern location, a first probability that the object is a first arm extending from the first user pattern to the event location; determine, based at least in part on the object and the second user pattern location, a second probability that the object is a second arm extending from the second user pattern to the event location; and associate the first user pattern with the event based at least in part on a determination that the first probability is greater than the second probability. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A computer implemented method, comprising:
under control of one or more computing systems configured with executable instructions, in response to a detection, by one or more input components, of an occurrence of an event at an event location within a materials handling facility, receiving; an event notification that includes an indication of the event location for the event and an event time indicating a time of the occurrence of the event; a first user pattern location corresponding to a first user pattern at the event time; and a second user pattern location corresponding to a second user pattern the event time; specifying, based on the event time, an event time window that begins before the event time and ends after the event time; determining, based at least in part on the, first user pattern location, that the first user pattern is located within a defined distance of the event location during the event time window; determining, based at least in part on the second user pattern location, that the second user pattern is located within the defined distance of the event location during the event time window; processing a plurality of images received from a first camera positioned above an area within the defined distance to at least identify a first object positioned between the event location and at least one of the first user pattern or the second user pattern, wherein the plurality of images are received from a first camera positioned above the area; determining, based at least in part on the first user pattern location, a first probability that the first object is a first arm extending from the first user pattern to the event location; determining, based at least in part on the second user pattern location, a second probability that the first object is a second arm extending from the second user pattern to the event location; and associating the first user pattern with the event based at least in part on a determination that the first probability is greater than the second probability. - View Dependent Claims (16, 17, 18, 19, 20)
Specification